Sep 15 11:23:21.674303 ip-10-0-132-240 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 15 11:23:21.674316 ip-10-0-132-240 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 15 11:23:21.674326 ip-10-0-132-240 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 15 11:23:21.674561 ip-10-0-132-240 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 15 11:23:31.887459 ip-10-0-132-240 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 15 11:23:31.887481 ip-10-0-132-240 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 4c1458dd8ba14a4fb348a4b03da253ba --
Sep 15 11:25:27.860272 ip-10-0-132-240 systemd[1]: Starting Kubernetes Kubelet...
Sep 15 11:25:28.281451 ip-10-0-132-240 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 11:25:28.281451 ip-10-0-132-240 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 15 11:25:28.281451 ip-10-0-132-240 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 11:25:28.281451 ip-10-0-132-240 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 15 11:25:28.281451 ip-10-0-132-240 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 11:25:28.282260 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.282129    2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 15 11:25:28.285988 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.285966    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 11:25:28.285988 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.285987    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 11:25:28.285988 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.285991    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 11:25:28.286094 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.285996    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 11:25:28.286094 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.285999    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 11:25:28.286094 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286002    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 11:25:28.286094 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286005    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 11:25:28.286094 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286008    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 11:25:28.286094 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286011    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 11:25:28.286094 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286014    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 11:25:28.286094 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286017    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 11:25:28.286094 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286020    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 11:25:28.286094 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286023    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 11:25:28.286094 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286037    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 11:25:28.286094 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286040    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 11:25:28.286094 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286044    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 11:25:28.286094 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286046    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 11:25:28.286094 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286049    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 11:25:28.286094 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286052    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 11:25:28.286094 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286055    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 11:25:28.286094 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286057    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 11:25:28.286094 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286060    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 11:25:28.286094 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286063    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 11:25:28.286591 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286065    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 11:25:28.286591 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286068    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 11:25:28.286591 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286072    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 11:25:28.286591 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286077    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 11:25:28.286591 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286080    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 11:25:28.286591 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286083    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 11:25:28.286591 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286086    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 11:25:28.286591 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286088    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 11:25:28.286591 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286091    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 11:25:28.286591 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286094    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 11:25:28.286591 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286096    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 11:25:28.286591 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286099    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 11:25:28.286591 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286102    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 11:25:28.286591 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286105    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 11:25:28.286591 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286109    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 11:25:28.286591 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286137    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 11:25:28.286591 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286141    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 11:25:28.286591 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286144    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 11:25:28.286591 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286149    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 11:25:28.287085 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286153    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 11:25:28.287085 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286156    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 11:25:28.287085 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286159    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 11:25:28.287085 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286162    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 11:25:28.287085 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286165    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 11:25:28.287085 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286168    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 11:25:28.287085 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286171    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 11:25:28.287085 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286173    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 11:25:28.287085 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286176    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 11:25:28.287085 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286178    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 11:25:28.287085 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286181    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 11:25:28.287085 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286183    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 11:25:28.287085 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286187    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 11:25:28.287085 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286189    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 11:25:28.287085 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286193    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 11:25:28.287085 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286196    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 11:25:28.287085 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286198    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 11:25:28.287085 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286202    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 11:25:28.287085 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286205    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 11:25:28.287085 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286207    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 11:25:28.287615 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286210    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 11:25:28.287615 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286212    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 11:25:28.287615 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286215    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 11:25:28.287615 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286217    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 11:25:28.287615 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286220    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 11:25:28.287615 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286223    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 11:25:28.287615 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286225    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 11:25:28.287615 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286228    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 11:25:28.287615 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286231    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 11:25:28.287615 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286233    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 11:25:28.287615 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286236    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 11:25:28.287615 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286238    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 11:25:28.287615 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286241    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 11:25:28.287615 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286243    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 11:25:28.287615 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286246    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 11:25:28.287615 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286249    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 11:25:28.287615 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286251    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 11:25:28.287615 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286254    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 11:25:28.287615 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286257    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 11:25:28.287615 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286260    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 11:25:28.288122 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286263    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 11:25:28.288122 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286266    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 11:25:28.288122 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286268    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 11:25:28.288122 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286271    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 11:25:28.288122 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286274    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 11:25:28.288122 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286278    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 11:25:28.288122 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286280    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 11:25:28.288122 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286283    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 11:25:28.288122 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286288    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 11:25:28.288122 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286292    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 11:25:28.288122 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286295    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 11:25:28.288122 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286298    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 11:25:28.288122 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286300    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 11:25:28.288122 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286303    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 11:25:28.288122 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286305    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 11:25:28.288122 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286308    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 11:25:28.288122 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.286311    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 11:25:28.288122 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287067    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 11:25:28.288122 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287074    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 11:25:28.288122 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287077    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 11:25:28.288614 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287080    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 11:25:28.288614 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287084    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 11:25:28.288614 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287086    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 11:25:28.288614 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287089    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 11:25:28.288614 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287092    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 11:25:28.288614 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287095    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 11:25:28.288614 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287098    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 11:25:28.288614 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287101    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 11:25:28.288614 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287103    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 11:25:28.288614 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287106    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 11:25:28.288614 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287111    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 11:25:28.288614 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287114    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 11:25:28.288614 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287117    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 11:25:28.288614 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287120    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 11:25:28.288614 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287122    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 11:25:28.288614 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287125    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 11:25:28.288614 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287129    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 11:25:28.288614 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287132    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 11:25:28.288614 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287135    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 11:25:28.288614 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287138    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 11:25:28.289149 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287141    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 11:25:28.289149 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287143    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 11:25:28.289149 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287146    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 11:25:28.289149 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287149    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 11:25:28.289149 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287152    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 11:25:28.289149 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287155    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 11:25:28.289149 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287157    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 11:25:28.289149 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287160    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 11:25:28.289149 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287163    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 11:25:28.289149 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287165    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 11:25:28.289149 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287168    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 11:25:28.289149 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287171    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 11:25:28.289149 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287174    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 11:25:28.289149 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287176    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 11:25:28.289149 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287179    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 11:25:28.289149 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287182    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 11:25:28.289149 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287185    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 11:25:28.289149 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287188    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 11:25:28.289149 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287191    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 11:25:28.289615 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287193    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 11:25:28.289615 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287198    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 11:25:28.289615 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287202    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 11:25:28.289615 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287207    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 11:25:28.289615 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287211    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 11:25:28.289615 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287214    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 11:25:28.289615 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287217    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 11:25:28.289615 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287220    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 11:25:28.289615 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287223    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 11:25:28.289615 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287227    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 11:25:28.289615 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287230    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 11:25:28.289615 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287233    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 11:25:28.289615 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287235    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 11:25:28.289615 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287238    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 11:25:28.289615 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287240    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 11:25:28.289615 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287243    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 11:25:28.289615 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287246    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 11:25:28.289615 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287248    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 11:25:28.289615 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287250    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 11:25:28.290129 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287253    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 11:25:28.290129 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287256    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 11:25:28.290129 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287258    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 11:25:28.290129 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287261    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 11:25:28.290129 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287263    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 11:25:28.290129 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287266    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 11:25:28.290129 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287268    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 11:25:28.290129 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287271    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 11:25:28.290129 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287274    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 11:25:28.290129 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287276    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 11:25:28.290129 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287280    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 11:25:28.290129 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287283    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 11:25:28.290129 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287286    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 11:25:28.290129 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287289    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 11:25:28.290129 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287292    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 11:25:28.290129 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287294    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 11:25:28.290129 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287298    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 11:25:28.290129 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287301    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 11:25:28.290129 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287306    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 11:25:28.290129 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287309    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 11:25:28.290648 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287311    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 11:25:28.290648 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287314    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 11:25:28.290648 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287317    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 11:25:28.290648 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287320    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 11:25:28.290648 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287323    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 11:25:28.290648 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287325    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 11:25:28.290648 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287328    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 11:25:28.290648 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287331    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 11:25:28.290648 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287334    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 11:25:28.290648 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287336    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 11:25:28.290648 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287339    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 11:25:28.290648 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287341    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 11:25:28.290648 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287344    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 11:25:28.290648 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287347    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 11:25:28.290648 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287349    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 11:25:28.290648 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287352    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 11:25:28.290648 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287354    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 11:25:28.290648 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287357    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 11:25:28.290648 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287759    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 11:25:28.290648 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287764    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 11:25:28.291183 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287767    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 11:25:28.291183 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287769    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 11:25:28.291183 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287773    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 11:25:28.291183 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287775    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 11:25:28.291183 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287778    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 11:25:28.291183 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287781    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 11:25:28.291183 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287784    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 11:25:28.291183 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287788    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 11:25:28.291183 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287791    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 11:25:28.291183 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287794    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 11:25:28.291183 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287797    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 11:25:28.291183 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287800    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 11:25:28.291183 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287803    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 11:25:28.291183 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287806    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 11:25:28.291183 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287808    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 11:25:28.291183 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287811    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 11:25:28.291183 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287814    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 11:25:28.291183 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287816    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 11:25:28.291183 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287819    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 11:25:28.291653 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287822    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 11:25:28.291653 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287824    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 11:25:28.291653 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287827    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 11:25:28.291653 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287830    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 11:25:28.291653 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287833    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 11:25:28.291653 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287835    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 11:25:28.291653 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287838    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 11:25:28.291653 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287840    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 11:25:28.291653 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287843    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 11:25:28.291653 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287846    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 11:25:28.291653 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287849    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 11:25:28.291653 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287851    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 11:25:28.291653 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287854    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 11:25:28.291653 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287856    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 11:25:28.291653 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287859    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 11:25:28.291653 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287862    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 11:25:28.291653 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287864    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 11:25:28.291653 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287867    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 11:25:28.291653 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287869    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 11:25:28.291653 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287872    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 11:25:28.292174 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287875    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 11:25:28.292174 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287880    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 11:25:28.292174 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287883    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 11:25:28.292174 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287886    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 11:25:28.292174 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287891    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 11:25:28.292174 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287895    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 11:25:28.292174 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287899    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 11:25:28.292174 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287902    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 11:25:28.292174 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287920    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 11:25:28.292174 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287923    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 11:25:28.292174 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287926    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 11:25:28.292174 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287929    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 11:25:28.292174 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287932    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 11:25:28.292174 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287935    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 11:25:28.292174 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287937    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 11:25:28.292174 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287940    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 11:25:28.292174 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287943    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 11:25:28.292174 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287946    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 11:25:28.292174 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287949    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 11:25:28.292675 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287952    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 11:25:28.292675 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287955    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 11:25:28.292675 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287958    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 11:25:28.292675 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287960    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 11:25:28.292675 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287963    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 11:25:28.292675 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287966    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 11:25:28.292675 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287968    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 11:25:28.292675 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287971    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 11:25:28.292675 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287973    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 11:25:28.292675 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287976    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 11:25:28.292675 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287978    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 11:25:28.292675 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287981    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 11:25:28.292675 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287989    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 11:25:28.292675 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287993    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 11:25:28.292675 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.287997    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 11:25:28.292675 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288000    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 11:25:28.292675 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288003    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 11:25:28.292675 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288006    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 11:25:28.292675 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288009    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 11:25:28.292675 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288012    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 11:25:28.293197 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288016    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 11:25:28.293197 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288018    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 11:25:28.293197 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288021    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 11:25:28.293197 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288024    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 11:25:28.293197 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288028    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 11:25:28.293197 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288032    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 11:25:28.293197 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288035    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 11:25:28.293197 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288038    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 11:25:28.293197 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288041    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 11:25:28.293197 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288044    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 11:25:28.293197 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288047    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 11:25:28.293197 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288050    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 11:25:28.293197 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288053    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 11:25:28.293197 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288055    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 11:25:28.293197 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288058    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 11:25:28.293197 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288060    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 11:25:28.293197 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288063    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 11:25:28.293197 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288066    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 11:25:28.293197 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288069    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 11:25:28.293197 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288151    2575 flags.go:64] FLAG: --address="0.0.0.0"
Sep 15 11:25:28.293681 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288191    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 15 11:25:28.293681 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288197    2575 flags.go:64] FLAG: --anonymous-auth="true"
Sep 15 11:25:28.293681 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288202    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 15 11:25:28.293681 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288210    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 15 11:25:28.293681 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288216    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 15 11:25:28.293681 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288221    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 15 11:25:28.293681 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288227    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 15 11:25:28.293681 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288231    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 15 11:25:28.293681 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288234    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 15 11:25:28.293681 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288238    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 15 11:25:28.293681 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288242    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 15 11:25:28.293681 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288246    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 15 11:25:28.293681 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288249    2575 flags.go:64] FLAG: --cgroup-root=""
Sep 15 11:25:28.293681 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288253    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 15 11:25:28.293681 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288256    2575 flags.go:64] FLAG: --client-ca-file=""
Sep 15 11:25:28.293681 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288259    2575 flags.go:64] FLAG: --cloud-provider="external"
Sep 15 11:25:28.293681 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288262    2575 flags.go:64] FLAG: --cluster-dns="[]"
Sep 15 11:25:28.293681 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288268    2575 flags.go:64] FLAG: --cluster-domain=""
Sep 15 11:25:28.293681 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288271    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 15 11:25:28.293681 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288274    2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 15 11:25:28.293681 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288277    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 15 11:25:28.293681 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288281    2575 flags.go:64] FLAG: --container-log-max-files="5"
Sep 15 11:25:28.293681 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288285    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 15 11:25:28.293681 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288288    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 15 11:25:28.294281 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288292    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 15 11:25:28.294281 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288295    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 15 11:25:28.294281 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288299    2575 flags.go:64] FLAG: --contention-profiling="false"
Sep 15 11:25:28.294281 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288302    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 15 11:25:28.294281 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288305    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 15 11:25:28.294281 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288309    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 15 11:25:28.294281 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288312    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 15 11:25:28.294281 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288317    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 15 11:25:28.294281 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288320    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 15 11:25:28.294281 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288323    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 15 11:25:28.294281 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288326    2575 flags.go:64] FLAG: --enable-load-reader="false"
Sep 15 11:25:28.294281 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288329    2575 flags.go:64] FLAG: --enable-server="true"
Sep 15 11:25:28.294281 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288334    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 15 11:25:28.294281 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288338    2575 flags.go:64] FLAG: --event-burst="100"
Sep 15 11:25:28.294281 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288343    2575 flags.go:64] FLAG: --event-qps="50"
Sep 15 11:25:28.294281 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288346    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 15 11:25:28.294281 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288349    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 15 11:25:28.294281 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288353    2575 flags.go:64] FLAG: --eviction-hard=""
Sep 15 11:25:28.294281 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288357    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 15 11:25:28.294281 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288361    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 15 11:25:28.294281 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288364    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 15 11:25:28.294281 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288368    2575 flags.go:64] FLAG: --eviction-soft=""
Sep 15 11:25:28.294281 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288371    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 15 11:25:28.294281 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288374    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 15 11:25:28.294281 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288377    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 15 11:25:28.294922 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288380    2575 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 15 11:25:28.294922 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288383    2575 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 15 11:25:28.294922 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288386    2575 flags.go:64] FLAG: --fail-swap-on="true"
Sep 15 11:25:28.294922 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288389    2575 flags.go:64] FLAG: --feature-gates=""
Sep 15 11:25:28.294922 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288394    2575 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 15 11:25:28.294922 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288398    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 15 11:25:28.294922 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288401    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 15 11:25:28.294922 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288404    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 15 11:25:28.294922 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288407    2575 flags.go:64] FLAG: --healthz-port="10248"
Sep 15 11:25:28.294922 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288410    2575 flags.go:64] FLAG: --help="false"
Sep 15 11:25:28.294922 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288413    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-132-240.ec2.internal"
Sep 15 11:25:28.294922 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288416    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 15 11:25:28.294922 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288419    2575 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 15 11:25:28.294922 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288422    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 15 11:25:28.294922 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288426    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 15 11:25:28.294922 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288429    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 15 11:25:28.294922 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288432    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 15 11:25:28.294922 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288436    2575 flags.go:64] FLAG: --image-service-endpoint=""
Sep 15 11:25:28.294922 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288439    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 15 11:25:28.294922 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288444    2575 flags.go:64] FLAG: --kube-api-burst="100"
Sep 15 11:25:28.294922 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288447    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 15 11:25:28.294922 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288452    2575 flags.go:64] FLAG: --kube-api-qps="50"
Sep 15 11:25:28.294922 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288456    2575 flags.go:64] FLAG: --kube-reserved=""
Sep 15 11:25:28.294922 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288459    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 15 11:25:28.295529 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288462    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 15 11:25:28.295529 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288465    2575 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 15 11:25:28.295529 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288468    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 15 11:25:28.295529 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288471    2575 flags.go:64] FLAG: --lock-file=""
Sep 15 11:25:28.295529 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288475    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 15 11:25:28.295529 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288478    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 15 11:25:28.295529 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288481    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 15 11:25:28.295529 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288487    2575 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 15 11:25:28.295529 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288490    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 15 11:25:28.295529 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288493    2575 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 15 11:25:28.295529 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288496    2575 flags.go:64] FLAG: --logging-format="text"
Sep 15 11:25:28.295529 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288499    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 15 11:25:28.295529 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288503    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 15 11:25:28.295529 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288506    2575 flags.go:64] FLAG: --manifest-url=""
Sep 15 11:25:28.295529 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288509    2575 flags.go:64] FLAG: --manifest-url-header=""
Sep 15 11:25:28.295529 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288513    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 15 11:25:28.295529 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288516    2575 flags.go:64] FLAG: --max-open-files="1000000"
Sep 15 11:25:28.295529 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288520    2575 flags.go:64] FLAG: --max-pods="110"
Sep 15 11:25:28.295529 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288523    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 15 11:25:28.295529 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288527    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 15 11:25:28.295529 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288529    2575 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 15 11:25:28.295529 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288532    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 15 11:25:28.295529 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288535    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 15 11:25:28.295529 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288538    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 15 11:25:28.295529 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288542    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 15 11:25:28.296379 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288550    2575 flags.go:64] FLAG: --node-status-max-images="50"
Sep 15 11:25:28.296379 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288553    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 15 11:25:28.296379 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288558    2575 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 15 11:25:28.296379 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288561    2575 flags.go:64] FLAG: --pod-cidr=""
Sep 15 11:25:28.296379 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288566    2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 15 11:25:28.296379 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288574    2575 flags.go:64] FLAG: --pod-manifest-path=""
Sep 15 11:25:28.296379 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288577    2575 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 15 11:25:28.296379 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288580    2575 flags.go:64] FLAG: --pods-per-core="0"
Sep 15 11:25:28.296379 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288584    2575 flags.go:64] FLAG: --port="10250"
Sep 15 11:25:28.296379 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288587    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 15 11:25:28.296379 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288590    2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-056fe959a412e0b13"
Sep 15 11:25:28.296379 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288593    2575 flags.go:64] FLAG: --qos-reserved=""
Sep 15 11:25:28.296379 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288597    2575 flags.go:64] FLAG: --read-only-port="10255"
Sep 15 11:25:28.296379 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288600    2575 flags.go:64] FLAG: --register-node="true"
Sep 15 11:25:28.296379 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288603    2575 flags.go:64] FLAG: --register-with-taints=""
Sep 15 11:25:28.296379 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288613    2575 flags.go:64] FLAG: --registry-burst="10"
Sep 15 11:25:28.296379 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288616    2575 flags.go:64] FLAG: --registry-qps="5"
Sep 15 11:25:28.296379 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288619    2575 flags.go:64] FLAG: --reserved-cpus=""
Sep 15 11:25:28.296379 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288622    2575 flags.go:64] FLAG: --reserved-memory=""
Sep 15 11:25:28.296379 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288627    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 15 11:25:28.296379 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288631    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 15 11:25:28.296379 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288634    2575 flags.go:64] FLAG: --rotate-certificates="false"
Sep 15 11:25:28.296379 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288637    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 15 11:25:28.296379 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288640    2575 flags.go:64] FLAG: --runonce="false"
Sep 15 11:25:28.296379 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288643    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 15 11:25:28.297262 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288646    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 15 11:25:28.297262 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288649    2575 flags.go:64] FLAG: --seccomp-default="false"
Sep 15 11:25:28.297262 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288653    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 15 11:25:28.297262 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288656    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 15 11:25:28.297262 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288659    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 15 11:25:28.297262 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288662    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 15 11:25:28.297262 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288666    2575 flags.go:64] FLAG: --storage-driver-password="root"
Sep 15 11:25:28.297262 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288669    2575 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 15 11:25:28.297262 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288672    2575 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 15 11:25:28.297262 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288676    2575 flags.go:64] FLAG: --storage-driver-user="root"
Sep 15 11:25:28.297262 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288679    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 15 11:25:28.297262 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288682    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 15 11:25:28.297262 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288686    2575 flags.go:64] FLAG: --system-cgroups=""
Sep 15 11:25:28.297262 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288689    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 15 11:25:28.297262 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288694    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 15 11:25:28.297262 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288697    2575 flags.go:64] FLAG: --tls-cert-file=""
Sep 15 11:25:28.297262 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288700    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 15 11:25:28.297262 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288705    2575 flags.go:64] FLAG: --tls-min-version=""
Sep 15 11:25:28.297262 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288708    2575 flags.go:64] FLAG: --tls-private-key-file=""
Sep 15 11:25:28.297262 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288711    2575 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 15 11:25:28.297262 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288714    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 15 11:25:28.297262 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288718    2575 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 15 11:25:28.297262 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288721    2575 flags.go:64] FLAG: --v="2"
Sep 15 11:25:28.297262 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288725    2575 flags.go:64] FLAG: --version="false"
Sep 15 11:25:28.297262 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288729    2575 flags.go:64] FLAG: --vmodule=""
Sep 15 11:25:28.297889 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288733    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 15 11:25:28.297889 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.288736    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 15 11:25:28.297889 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288855    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 11:25:28.297889 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288859    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 11:25:28.297889 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288862    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 11:25:28.297889 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288865    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 11:25:28.297889 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288868    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 11:25:28.297889 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288870    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 11:25:28.297889 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288873    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 11:25:28.297889 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288876    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 11:25:28.297889 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288878    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 11:25:28.297889 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288881    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 11:25:28.297889 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288884    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 11:25:28.297889 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288887    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 11:25:28.297889 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288890    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 11:25:28.297889 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288893    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 11:25:28.297889 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288896    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 11:25:28.297889 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288899    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 11:25:28.297889 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288902    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 11:25:28.297889 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288917    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 11:25:28.298515 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288920    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 11:25:28.298515 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288923    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 11:25:28.298515 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288926    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 11:25:28.298515 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288929    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 11:25:28.298515 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288932    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 11:25:28.298515 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288935    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 11:25:28.298515 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288937    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 11:25:28.298515 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288941    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 11:25:28.298515 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288944    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 11:25:28.298515 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288947    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 11:25:28.298515 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288950    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 11:25:28.298515 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288952    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 11:25:28.298515 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288955    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 11:25:28.298515 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288958    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 11:25:28.298515 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288961    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 11:25:28.298515 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288964    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 11:25:28.298515 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288967    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 11:25:28.298515 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288969    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 11:25:28.298515 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288972    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 11:25:28.298515 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288974    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 11:25:28.299088 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288977    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 11:25:28.299088 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288980    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 11:25:28.299088 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288983    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 11:25:28.299088 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288985    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 11:25:28.299088 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288987    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 11:25:28.299088 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288990    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 11:25:28.299088 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288993    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 11:25:28.299088 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288996    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 11:25:28.299088 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.288999    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 11:25:28.299088 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289002    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 11:25:28.299088 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289004    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 11:25:28.299088 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289007    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 11:25:28.299088 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289010    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 11:25:28.299088 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289013    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 11:25:28.299088 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289016    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 11:25:28.299088 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289018    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 11:25:28.299088 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289021    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 11:25:28.299088 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289024    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 11:25:28.299088 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289026    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 11:25:28.299088 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289029    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 11:25:28.299609 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289031    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 11:25:28.299609 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289034    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 11:25:28.299609 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289037    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 11:25:28.299609 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289040    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 11:25:28.299609 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289042    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 11:25:28.299609 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289045    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 11:25:28.299609 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289047    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 11:25:28.299609 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289050    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 11:25:28.299609 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289053    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 11:25:28.299609 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289055    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 11:25:28.299609 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289058    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 11:25:28.299609 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289062    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 11:25:28.299609 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289066    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 11:25:28.299609 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289070    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 11:25:28.299609 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289074    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 11:25:28.299609 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289077    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 11:25:28.299609 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289080    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 11:25:28.299609 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289083    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 11:25:28.300088 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289086    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 11:25:28.300088 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289089    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 11:25:28.300088 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289092    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 11:25:28.300088 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289095    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 11:25:28.300088 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289097    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 11:25:28.300088 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289100    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 11:25:28.300088 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289103    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 11:25:28.300088 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289106    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 11:25:28.300088 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289109    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 11:25:28.300088 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289111    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 11:25:28.300088 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289114    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 11:25:28.300088 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289117    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 11:25:28.300088 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289119    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 11:25:28.300088 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289122    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 11:25:28.300088 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289125    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 11:25:28.300088 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289127    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 11:25:28.300088 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289130    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 11:25:28.300088 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289133    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 11:25:28.300088 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289136    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 11:25:28.300088 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289140    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 11:25:28.300663 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289143    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 11:25:28.300663 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289146    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 11:25:28.300663 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.289149    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 11:25:28.300663 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.289660    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 11:25:28.300663 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.298192    2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 15 11:25:28.300663 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.298372    2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 15 11:25:28.300663 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.298398    2575 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 15 11:25:28.300663 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.298405    2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 15 11:25:28.300663 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298471    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 11:25:28.300663 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298476    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 11:25:28.300663 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298479    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 11:25:28.300663 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298483    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 11:25:28.300663 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298486    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 11:25:28.300663 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298490    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 11:25:28.300663 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298493    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 11:25:28.301051 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298496    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 11:25:28.301051 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298499    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 11:25:28.301051 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298502    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 11:25:28.301051 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298505    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 11:25:28.301051 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298508    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 11:25:28.301051 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298511    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 11:25:28.301051 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298513    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 11:25:28.301051 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298518    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 11:25:28.301051 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298523    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 11:25:28.301051 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298526    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 11:25:28.301051 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298529    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 11:25:28.301051 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298534    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 11:25:28.301051 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298539    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 11:25:28.301051 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298543    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 11:25:28.301051 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298547    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 11:25:28.301051 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298550    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 11:25:28.301051 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298553    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 11:25:28.301051 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298556    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 11:25:28.301051 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298560    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 11:25:28.301560 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298563    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 11:25:28.301560 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298565    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 11:25:28.301560 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298568    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 11:25:28.301560 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298571    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 11:25:28.301560 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298574    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 11:25:28.301560 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298577    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 11:25:28.301560 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298579    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 11:25:28.301560 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298582    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 11:25:28.301560 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298585    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 11:25:28.301560 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298588    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 11:25:28.301560 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298590    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 11:25:28.301560 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298593    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 11:25:28.301560 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298596    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 11:25:28.301560 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298599    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 11:25:28.301560 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298602    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 11:25:28.301560 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298605    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 11:25:28.301560 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298607    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 11:25:28.301560 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298610    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 11:25:28.301560 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298614    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 11:25:28.302051 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298616    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 11:25:28.302051 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298620    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 11:25:28.302051 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298623    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 11:25:28.302051 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298626    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 11:25:28.302051 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298628    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 11:25:28.302051 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298632    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 11:25:28.302051 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298634    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 11:25:28.302051 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298638    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 11:25:28.302051 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298642    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 11:25:28.302051 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298645    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 11:25:28.302051 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298648    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 11:25:28.302051 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298651    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 11:25:28.302051 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298654    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 11:25:28.302051 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298657    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 11:25:28.302051 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298659    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 11:25:28.302051 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298662    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 11:25:28.302051 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298665    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 11:25:28.302051 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298668    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 11:25:28.302051 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298671    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 11:25:28.302533 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298674    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 11:25:28.302533 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298677    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 11:25:28.302533 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298679    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 11:25:28.302533 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298682    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 11:25:28.302533 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298685    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 11:25:28.302533 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298687    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 11:25:28.302533 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298690    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 11:25:28.302533 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298693    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 11:25:28.302533 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298696    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 11:25:28.302533 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298698    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 11:25:28.302533 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298701    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 11:25:28.302533 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298704    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 11:25:28.302533 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298707    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 11:25:28.302533 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298710    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 11:25:28.302533 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298712    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 11:25:28.302533 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298717    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 11:25:28.302533 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298720    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 11:25:28.302533 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298722    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 11:25:28.302533 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298725    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 11:25:28.302533 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298727    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 11:25:28.303152 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298730    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 11:25:28.303152 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298733    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 11:25:28.303152 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298735    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 11:25:28.303152 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298738    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 11:25:28.303152 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298741    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 11:25:28.303152 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298744    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 11:25:28.303152 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298746    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 11:25:28.303152 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298749    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 11:25:28.303152 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298751    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 11:25:28.303152 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298754    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 11:25:28.303152 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298757    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 11:25:28.303152 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298760    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 11:25:28.303152 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298762    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 11:25:28.303152 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298765    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 11:25:28.303152 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298768    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 11:25:28.303523 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.298774    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 11:25:28.303523 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298900    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 11:25:28.303523 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298923    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 11:25:28.303523 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298926    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 11:25:28.303523 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298929    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 11:25:28.303523 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298932    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 11:25:28.303523 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298936    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 11:25:28.303523 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298939    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 11:25:28.303523 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298942    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 11:25:28.303523 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298945    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 11:25:28.303523 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298948    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 11:25:28.303523 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298950    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 11:25:28.303523 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298953    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 11:25:28.303523 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298957    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 11:25:28.303881 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298961    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 11:25:28.303881 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298964    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 11:25:28.303881 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298966    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 11:25:28.303881 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298969    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 11:25:28.303881 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298972    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 11:25:28.303881 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298975    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 11:25:28.303881 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298978    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 11:25:28.303881 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298980    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 11:25:28.303881 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298983    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 11:25:28.303881 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298986    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 11:25:28.303881 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298988    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 11:25:28.303881 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298991    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 11:25:28.303881 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298994    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 11:25:28.303881 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.298997    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 11:25:28.303881 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299000    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 11:25:28.303881 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299003    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 11:25:28.303881 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299006    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 11:25:28.303881 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299009    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 11:25:28.303881 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299012    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 11:25:28.303881 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299015    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 11:25:28.304406 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299017    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 11:25:28.304406 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299020    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 11:25:28.304406 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299023    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 11:25:28.304406 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299026    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 11:25:28.304406 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299029    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 11:25:28.304406 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299031    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 11:25:28.304406 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299034    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 11:25:28.304406 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299037    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 11:25:28.304406 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299039    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 11:25:28.304406 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299042    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 11:25:28.304406 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299045    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 11:25:28.304406 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299048    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 11:25:28.304406 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299051    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 11:25:28.304406 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299054    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 11:25:28.304406 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299056    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 11:25:28.304406 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299059    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 11:25:28.304406 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299062    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 11:25:28.304406 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299064    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 11:25:28.304406 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299067    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 11:25:28.304406 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299069    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 11:25:28.304922 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299072    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 11:25:28.304922 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299075    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 11:25:28.304922 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299077    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 11:25:28.304922 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299083    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 11:25:28.304922 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299086    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 11:25:28.304922 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299090    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 11:25:28.304922 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299093    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 11:25:28.304922 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299096    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 11:25:28.304922 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299099    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 11:25:28.304922 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299102    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 11:25:28.304922 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299105    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 11:25:28.304922 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299108    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 11:25:28.304922 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299111    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 11:25:28.304922 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299114    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 11:25:28.304922 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299116    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 11:25:28.304922 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299119    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 11:25:28.304922 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299122    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 11:25:28.304922 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299124    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 11:25:28.304922 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299127    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 11:25:28.304922 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299130    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 11:25:28.305428 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299134    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 11:25:28.305428 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299138    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 11:25:28.305428 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299141    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 11:25:28.305428 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299144    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 11:25:28.305428 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299147    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 11:25:28.305428 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299152    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 11:25:28.305428 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299155    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 11:25:28.305428 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299157    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 11:25:28.305428 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299160    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 11:25:28.305428 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299163    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 11:25:28.305428 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299165    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 11:25:28.305428 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299168    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 11:25:28.305428 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299170    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 11:25:28.305428 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299173    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 11:25:28.305428 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299177    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 11:25:28.305428 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299181    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 11:25:28.305428 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299184    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 11:25:28.305428 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299187    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 11:25:28.305428 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299190    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 11:25:28.305932 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299193    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 11:25:28.305932 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299196    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 11:25:28.305932 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299198    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 11:25:28.305932 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299202    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 11:25:28.305932 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299205    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 11:25:28.305932 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299208    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 11:25:28.305932 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:28.299210    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 11:25:28.305932 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.299216    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 11:25:28.305932 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.299361    2575 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 15 11:25:28.305932 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.301506    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 15 11:25:28.305932 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.302796    2575 server.go:1019] "Starting client certificate rotation"
Sep 15 11:25:28.305932 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.302903    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 11:25:28.305932 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.302984    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 11:25:28.306306 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.305521    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 11:25:28.306790 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.306763    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 11:25:28.317554 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.317528    2575 log.go:25] "Validated CRI v1 runtime API"
Sep 15 11:25:28.323075 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.323052    2575 log.go:25] "Validated CRI v1 image API"
Sep 15 11:25:28.324165 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.324145    2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 15 11:25:28.327795 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.327765    2575 fs.go:135] Filesystem UUIDs: map[5fb7d9a8-d0db-4dcb-b7ee-32a5c97fc66c:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 91d4c74b-c150-4c2b-9636-1211d397f969:/dev/nvme0n1p3]
Sep 15 11:25:28.327932 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.327793    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 15 11:25:28.331826 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.331794    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 11:25:28.334267 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.334138    2575 manager.go:216] Machine: {Timestamp:2026-09-15 11:25:28.332828467 +0000 UTC m=+0.350906412 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100696 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec274818695f6ad5302ce7229bdcd269 SystemUUID:ec274818-695f-6ad5-302c-e7229bdcd269 BootID:4c1458dd-8ba1-4a4f-b348-a4b03da253ba Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d3:ae:ee:07 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d3:ae:ee:07 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:18:96:80:a9:5f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 15 11:25:28.334267 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.334254    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 15 11:25:28.334416 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.334408    2575 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 15 11:25:28.335543 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.335515    2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 15 11:25:28.335696 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.335547    2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-240.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 15 11:25:28.336921 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.336895    2575 topology_manager.go:138] "Creating topology manager with none policy"
Sep 15 11:25:28.336965 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.336922    2575 container_manager_linux.go:309] "Creating device plugin manager"
Sep 15 11:25:28.336965 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.336933    2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 11:25:28.337634 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.337621    2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 11:25:28.338392 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.338380    2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 15 11:25:28.341204 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.341188    2575 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 11:25:28.341537 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.341526    2575 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 15 11:25:28.341587 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.341560    2575 kubelet.go:486] "Attempting to sync node with API server"
Sep 15 11:25:28.341587 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.341572    2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 15 11:25:28.341656 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.341592    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 15 11:25:28.341656 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.341610    2575 kubelet.go:398] "Adding apiserver pod source"
Sep 15 11:25:28.341656 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.341620    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 15 11:25:28.342037 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.342019    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 11:25:28.342037 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.342039    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 11:25:28.344843 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.344821    2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 15 11:25:28.346632 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.346616    2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 15 11:25:28.346683 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.346649    2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 15 11:25:28.348818 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.348805    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 15 11:25:28.348862 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.348823    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 15 11:25:28.348862 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.348830    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 15 11:25:28.348862 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.348835    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 15 11:25:28.348862 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.348843    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 15 11:25:28.348862 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.348849    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 15 11:25:28.348862 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.348862    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 15 11:25:28.349040 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.348870    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 15 11:25:28.349040 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.348877    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 15 11:25:28.349040 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.348882    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 15 11:25:28.349040 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.348891    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 15 11:25:28.349040 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.348896    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 15 11:25:28.350269 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.350257    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 15 11:25:28.350269 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.350268    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 15 11:25:28.353056 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.353029    2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-240.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 15 11:25:28.353693 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:28.353659    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-240.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 15 11:25:28.353693 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:28.353658    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 15 11:25:28.354332 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.354315    2575 server.go:1268] "Started kubelet"
Sep 15 11:25:28.354420 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.354376    2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 15 11:25:28.354468 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.354419    2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 15 11:25:28.354506 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.354492    2575 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 15 11:25:28.355495 ip-10-0-132-240 systemd[1]: Started Kubernetes Kubelet.
Sep 15 11:25:28.356112 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.356083    2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 15 11:25:28.356807 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.356697    2575 server.go:310] "Adding debug handlers to kubelet server"
Sep 15 11:25:28.358833 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:28.358805    2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 15 11:25:28.360157 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.360141    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kjsvx"
Sep 15 11:25:28.360406 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.360384    2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 15 11:25:28.360507 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.360407    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 15 11:25:28.360507 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:28.359255    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-240.ec2.internal.18d57adfbf3b7b54  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-240.ec2.internal,UID:ip-10-0-132-240.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-240.ec2.internal,},FirstTimestamp:2026-09-15 11:25:28.354282324 +0000 UTC m=+0.372360268,LastTimestamp:2026-09-15 11:25:28.354282324 +0000 UTC m=+0.372360268,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-240.ec2.internal,}"
Sep 15 11:25:28.360613 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:28.360541    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-240.ec2.internal\" not found"
Sep 15 11:25:28.361098 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.361066    2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 15 11:25:28.361098 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.361068    2575 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 15 11:25:28.361098 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.361110    2575 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 15 11:25:28.361299 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.361191    2575 reconstruct.go:97] "Volume reconstruction finished"
Sep 15 11:25:28.361299 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.361202    2575 reconciler.go:29] "Reconciler: start to sync state"
Sep 15 11:25:28.361506 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.361490    2575 factory.go:55] Registering systemd factory
Sep 15 11:25:28.361599 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.361510    2575 factory.go:223] Registration of the systemd container factory successfully
Sep 15 11:25:28.361820 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.361791    2575 factory.go:153] Registering CRI-O factory
Sep 15 11:25:28.361820 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.361821    2575 factory.go:223] Registration of the crio container factory successfully
Sep 15 11:25:28.361964 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.361875    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 15 11:25:28.361964 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.361894    2575 factory.go:103] Registering Raw factory
Sep 15 11:25:28.361964 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.361928    2575 manager.go:1196] Started watching for new ooms in manager
Sep 15 11:25:28.362403 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.362390    2575 manager.go:349] Starting recovery of all containers
Sep 15 11:25:28.367448 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.367419    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kjsvx"
Sep 15 11:25:28.373112 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:28.373076    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 15 11:25:28.374697 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.374664    2575 manager.go:354] Recovery completed
Sep 15 11:25:28.380017 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.380001    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 11:25:28.383215 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:28.383186    2575 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-132-240.ec2.internal\" not found" node="ip-10-0-132-240.ec2.internal"
Sep 15 11:25:28.383890 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.383873    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-240.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 11:25:28.383969 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.383919    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-240.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 11:25:28.383969 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.383933    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-240.ec2.internal" event="NodeHasSufficientPID"
Sep 15 11:25:28.384587 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.384570    2575 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 15 11:25:28.384587 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.384586    2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 15 11:25:28.384679 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.384605    2575 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 11:25:28.384679 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.384576    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 11:25:28.385445 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.385428    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-240.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 11:25:28.385528 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.385465    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-240.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 11:25:28.385528 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.385480    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-240.ec2.internal" event="NodeHasSufficientPID"
Sep 15 11:25:28.386033 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.386020    2575 policy_none.go:49] "None policy: Start"
Sep 15 11:25:28.386067 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.386037    2575 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 15 11:25:28.386067 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.386048    2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 15 11:25:28.387172 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.387160    2575 policy_none.go:47] "Start"
Sep 15 11:25:28.425676 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.425654    2575 manager.go:337] "Starting Device Plugin manager"
Sep 15 11:25:28.431644 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:28.425707    2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 15 11:25:28.431644 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.425721    2575 server.go:87] "Starting device plugin registration server"
Sep 15 11:25:28.431644 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.426091    2575 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 15 11:25:28.431644 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.426107    2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 15 11:25:28.431644 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.426209    2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 15 11:25:28.431644 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.426308    2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 15 11:25:28.431644 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.426317    2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 15 11:25:28.431644 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:28.426926    2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 15 11:25:28.431644 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:28.426990    2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-240.ec2.internal\" not found"
Sep 15 11:25:28.493503 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.493453    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 15 11:25:28.494929 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.494893    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 15 11:25:28.495110 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.494966    2575 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 15 11:25:28.495110 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.494998    2575 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 15 11:25:28.495110 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:28.495052    2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 15 11:25:28.497168 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.497141    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 11:25:28.527070 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.527033    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 11:25:28.528411 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.528383    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-240.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 11:25:28.528525 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.528417    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-240.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 11:25:28.528525 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.528432    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-240.ec2.internal" event="NodeHasSufficientPID"
Sep 15 11:25:28.528525 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.528481    2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-240.ec2.internal"
Sep 15 11:25:28.536757 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.536677    2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-240.ec2.internal"
Sep 15 11:25:28.536757 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:28.536708    2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-240.ec2.internal\": node \"ip-10-0-132-240.ec2.internal\" not found"
Sep 15 11:25:28.552623 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:28.552588    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-240.ec2.internal\" not found"
Sep 15 11:25:28.595690 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.595650    2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-240.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-240.ec2.internal"]
Sep 15 11:25:28.595810 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.595759    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 11:25:28.596823 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.596808    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-240.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 11:25:28.596947 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.596834    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-240.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 11:25:28.596947 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.596845    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-240.ec2.internal" event="NodeHasSufficientPID"
Sep 15 11:25:28.598123 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.598111    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 11:25:28.598673 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.598648    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-240.ec2.internal"
Sep 15 11:25:28.598743 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.598682    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 11:25:28.598836 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.598822    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-240.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 11:25:28.598889 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.598848    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-240.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 11:25:28.598889 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.598857    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-240.ec2.internal" event="NodeHasSufficientPID"
Sep 15 11:25:28.599346 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.599334    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-240.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 11:25:28.599400 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.599359    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-240.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 11:25:28.599400 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.599372    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-240.ec2.internal" event="NodeHasSufficientPID"
Sep 15 11:25:28.600062 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.600044    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-240.ec2.internal"
Sep 15 11:25:28.600155 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.600071    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 11:25:28.602267 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.602252    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-240.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 11:25:28.602345 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.602278    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-240.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 11:25:28.602345 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.602290    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-240.ec2.internal" event="NodeHasSufficientPID"
Sep 15 11:25:28.628002 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:28.627970    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-240.ec2.internal\" not found" node="ip-10-0-132-240.ec2.internal"
Sep 15 11:25:28.632916 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:28.632880    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-240.ec2.internal\" not found" node="ip-10-0-132-240.ec2.internal"
Sep 15 11:25:28.653407 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:28.653370    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-240.ec2.internal\" not found"
Sep 15 11:25:28.754309 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:28.754256    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-240.ec2.internal\" not found"
Sep 15 11:25:28.762627 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.762599    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8f566853e3e8fb004fd376160386ffbe-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-240.ec2.internal\" (UID: \"8f566853e3e8fb004fd376160386ffbe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-240.ec2.internal"
Sep 15 11:25:28.762729 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.762631    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f566853e3e8fb004fd376160386ffbe-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-240.ec2.internal\" (UID: \"8f566853e3e8fb004fd376160386ffbe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-240.ec2.internal"
Sep 15 11:25:28.762729 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.762653    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/87bfeb81dec9b16ad8c9fded8c51d913-config\") pod \"kube-apiserver-proxy-ip-10-0-132-240.ec2.internal\" (UID: \"87bfeb81dec9b16ad8c9fded8c51d913\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-240.ec2.internal"
Sep 15 11:25:28.855105 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:28.855024    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-240.ec2.internal\" not found"
Sep 15 11:25:28.863398 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.863371    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8f566853e3e8fb004fd376160386ffbe-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-240.ec2.internal\" (UID: \"8f566853e3e8fb004fd376160386ffbe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-240.ec2.internal"
Sep 15 11:25:28.863449 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.863401    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f566853e3e8fb004fd376160386ffbe-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-240.ec2.internal\" (UID: \"8f566853e3e8fb004fd376160386ffbe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-240.ec2.internal"
Sep 15 11:25:28.863449 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.863418    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/87bfeb81dec9b16ad8c9fded8c51d913-config\") pod \"kube-apiserver-proxy-ip-10-0-132-240.ec2.internal\" (UID: \"87bfeb81dec9b16ad8c9fded8c51d913\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-240.ec2.internal"
Sep 15 11:25:28.863449 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.863446    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/87bfeb81dec9b16ad8c9fded8c51d913-config\") pod \"kube-apiserver-proxy-ip-10-0-132-240.ec2.internal\" (UID: \"87bfeb81dec9b16ad8c9fded8c51d913\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-240.ec2.internal"
Sep 15 11:25:28.863549 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.863464    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8f566853e3e8fb004fd376160386ffbe-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-240.ec2.internal\" (UID: \"8f566853e3e8fb004fd376160386ffbe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-240.ec2.internal"
Sep 15 11:25:28.863549 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.863469    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f566853e3e8fb004fd376160386ffbe-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-240.ec2.internal\" (UID: \"8f566853e3e8fb004fd376160386ffbe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-240.ec2.internal"
Sep 15 11:25:28.930537 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.930495    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-240.ec2.internal"
Sep 15 11:25:28.935455 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:28.935434    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-240.ec2.internal"
Sep 15 11:25:28.955610 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:28.955566    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-240.ec2.internal\" not found"
Sep 15 11:25:29.056200 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:29.056154    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-240.ec2.internal\" not found"
Sep 15 11:25:29.156755 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:29.156666    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-240.ec2.internal\" not found"
Sep 15 11:25:29.257347 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:29.257310    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-240.ec2.internal\" not found"
Sep 15 11:25:29.302855 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:29.302807    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 15 11:25:29.303350 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:29.303016    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 15 11:25:29.357560 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:29.357519    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-240.ec2.internal\" not found"
Sep 15 11:25:29.362406 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:29.362383    2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 11:25:29.373034 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:29.372993    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-14 11:20:29 +0000 UTC" deadline="2028-05-02 20:48:00.99568552 +0000 UTC"
Sep 15 11:25:29.373034 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:29.373026    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14289h22m31.622663392s"
Sep 15 11:25:29.386711 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:29.386678    2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 11:25:29.395478 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:29.395451    2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 11:25:29.460772 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:29.460748    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-240.ec2.internal"
Sep 15 11:25:29.462049 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:29.462025    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87bfeb81dec9b16ad8c9fded8c51d913.slice/crio-a2316d41514c81b024b7edc715dc4e8152a46ccede6db7feda9f7e2ba4612481 WatchSource:0}: Error finding container a2316d41514c81b024b7edc715dc4e8152a46ccede6db7feda9f7e2ba4612481: Status 404 returned error can't find the container with id a2316d41514c81b024b7edc715dc4e8152a46ccede6db7feda9f7e2ba4612481
Sep 15 11:25:29.470835 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:29.470815    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 11:25:29.472807 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:29.472790    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 11:25:29.473920 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:29.473893    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-240.ec2.internal"
Sep 15 11:25:29.481528 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:29.481504    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 11:25:29.499193 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:29.499131    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-240.ec2.internal" event={"ID":"87bfeb81dec9b16ad8c9fded8c51d913","Type":"ContainerStarted","Data":"a2316d41514c81b024b7edc715dc4e8152a46ccede6db7feda9f7e2ba4612481"}
Sep 15 11:25:30.342643 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.342602    2575 apiserver.go:52] "Watching apiserver"
Sep 15 11:25:30.351494 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.351458    2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 15 11:25:30.351920 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.351877    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-4dmcz","openshift-multus/multus-additional-cni-plugins-q6x2d","openshift-network-diagnostics/network-check-target-zpbfk","openshift-network-operator/iptables-alerter-5rpc8","kube-system/konnectivity-agent-ttwvq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6h7vw","openshift-dns/node-resolver-26srz","openshift-image-registry/node-ca-t82xl","openshift-multus/network-metrics-daemon-k79mk","openshift-ovn-kubernetes/ovnkube-node-nvpfc","kube-system/global-pull-secret-syncer-q96s9","kube-system/kube-apiserver-proxy-ip-10-0-132-240.ec2.internal","openshift-cluster-node-tuning-operator/tuned-88vmx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-240.ec2.internal"]
Sep 15 11:25:30.353386 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.353361    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-26srz"
Sep 15 11:25:30.354557 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.354534    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:30.355558 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.355413    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qbmqv\""
Sep 15 11:25:30.355558 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.355466    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 15 11:25:30.355558 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.355479    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 15 11:25:30.355770 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.355703    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zpbfk"
Sep 15 11:25:30.355825 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:30.355769    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zpbfk" podUID="80feec19-977b-483e-a7a2-f9badf61b984"
Sep 15 11:25:30.356568 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.356548    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 15 11:25:30.356661 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.356600    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8xqtk\""
Sep 15 11:25:30.356871 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.356756    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 15 11:25:30.357106 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.357085    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5rpc8"
Sep 15 11:25:30.358552 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.358443    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ttwvq"
Sep 15 11:25:30.359072 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.359050    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 15 11:25:30.359174 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.359156    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 15 11:25:30.359313 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.359280    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 15 11:25:30.359313 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.359303    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jhvzr\""
Sep 15 11:25:30.359686 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.359671    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6h7vw"
Sep 15 11:25:30.360603 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.360420    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 15 11:25:30.360713 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.360695    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 15 11:25:30.361056 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.361006    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-sv5sv\""
Sep 15 11:25:30.361144 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.361111    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k79mk"
Sep 15 11:25:30.361208 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:30.361183    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k79mk" podUID="8f55f467-8c61-4930-b097-6636d194db5d"
Sep 15 11:25:30.361263 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.361218    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 15 11:25:30.361619 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.361597    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 15 11:25:30.361960 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.361941    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 15 11:25:30.362089 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.362032    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-77gk9\""
Sep 15 11:25:30.362089 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.362040    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 15 11:25:30.362308 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.362290    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.363585 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.363566    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-q6x2d"
Sep 15 11:25:30.364362 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.364341    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 15 11:25:30.364455 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.364437    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 15 11:25:30.364613 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.364597    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-47zqv\""
Sep 15 11:25:30.365979 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.365276    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 15 11:25:30.365979 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.365408    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:30.365979 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.365575    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 15 11:25:30.365979 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.365937    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ss95z\""
Sep 15 11:25:30.367238 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.367058    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 15 11:25:30.367238 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.367163    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 15 11:25:30.367716 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.367693    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 15 11:25:30.368150 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.367931    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 15 11:25:30.368150 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.367938    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 15 11:25:30.368994 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.368608    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 15 11:25:30.368994 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.368815    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 15 11:25:30.369152 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.369095    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 15 11:25:30.370462 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.370436    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d39f711a-375d-4905-96a8-d11a45374133-run\") pod \"tuned-88vmx\" (UID: \"d39f711a-375d-4905-96a8-d11a45374133\") " pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:30.370546 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.370481    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d39f711a-375d-4905-96a8-d11a45374133-lib-modules\") pod \"tuned-88vmx\" (UID: \"d39f711a-375d-4905-96a8-d11a45374133\") " pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:30.370546 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.370494    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-m958l\""
Sep 15 11:25:30.370546 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.370509    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d39f711a-375d-4905-96a8-d11a45374133-host\") pod \"tuned-88vmx\" (UID: \"d39f711a-375d-4905-96a8-d11a45374133\") " pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:30.370546 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.370532    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d39f711a-375d-4905-96a8-d11a45374133-etc-tuned\") pod \"tuned-88vmx\" (UID: \"d39f711a-375d-4905-96a8-d11a45374133\") " pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:30.370739 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.370579    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnpxj\" (UniqueName: \"kubernetes.io/projected/80feec19-977b-483e-a7a2-f9badf61b984-kube-api-access-vnpxj\") pod \"network-check-target-zpbfk\" (UID: \"80feec19-977b-483e-a7a2-f9badf61b984\") " pod="openshift-network-diagnostics/network-check-target-zpbfk"
Sep 15 11:25:30.370739 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.370623    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c5e5dc64-36c8-49a9-b823-185c56534d6a-agent-certs\") pod \"konnectivity-agent-ttwvq\" (UID: \"c5e5dc64-36c8-49a9-b823-185c56534d6a\") " pod="kube-system/konnectivity-agent-ttwvq"
Sep 15 11:25:30.370739 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.370649    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cc08c447-fc8f-4246-b543-08c147ced784-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6h7vw\" (UID: \"cc08c447-fc8f-4246-b543-08c147ced784\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6h7vw"
Sep 15 11:25:30.370739 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.370680    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c04ca25-e153-4f97-89db-aba1b15106bb-cni-binary-copy\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.370739 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.370716    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8c04ca25-e153-4f97-89db-aba1b15106bb-host-var-lib-cni-multus\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.370984 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.370745    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8c04ca25-e153-4f97-89db-aba1b15106bb-hostroot\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.370984 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.370768    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c04ca25-e153-4f97-89db-aba1b15106bb-etc-kubernetes\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.370984 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.370802    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d39f711a-375d-4905-96a8-d11a45374133-etc-modprobe-d\") pod \"tuned-88vmx\" (UID: \"d39f711a-375d-4905-96a8-d11a45374133\") " pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:30.370984 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.370826    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d39f711a-375d-4905-96a8-d11a45374133-etc-kubernetes\") pod \"tuned-88vmx\" (UID: \"d39f711a-375d-4905-96a8-d11a45374133\") " pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:30.370984 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.370863    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cc08c447-fc8f-4246-b543-08c147ced784-device-dir\") pod \"aws-ebs-csi-driver-node-6h7vw\" (UID: \"cc08c447-fc8f-4246-b543-08c147ced784\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6h7vw"
Sep 15 11:25:30.370984 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.370889    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx7w6\" (UniqueName: \"kubernetes.io/projected/cc08c447-fc8f-4246-b543-08c147ced784-kube-api-access-sx7w6\") pod \"aws-ebs-csi-driver-node-6h7vw\" (UID: \"cc08c447-fc8f-4246-b543-08c147ced784\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6h7vw"
Sep 15 11:25:30.370984 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.370957    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f55f467-8c61-4930-b097-6636d194db5d-metrics-certs\") pod \"network-metrics-daemon-k79mk\" (UID: \"8f55f467-8c61-4930-b097-6636d194db5d\") " pod="openshift-multus/network-metrics-daemon-k79mk"
Sep 15 11:25:30.371240 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.370996    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q96s9"
Sep 15 11:25:30.371240 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:30.371062    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q96s9" podUID="c0bac93c-2a52-439c-a4a6-d4d31424d653"
Sep 15 11:25:30.371240 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.370994    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8c04ca25-e153-4f97-89db-aba1b15106bb-multus-socket-dir-parent\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.371240 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.371108    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr75g\" (UniqueName: \"kubernetes.io/projected/8c04ca25-e153-4f97-89db-aba1b15106bb-kube-api-access-mr75g\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.371240 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.371132    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d39f711a-375d-4905-96a8-d11a45374133-sys\") pod \"tuned-88vmx\" (UID: \"d39f711a-375d-4905-96a8-d11a45374133\") " pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:30.371240 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.371154    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d39f711a-375d-4905-96a8-d11a45374133-var-lib-kubelet\") pod \"tuned-88vmx\" (UID: \"d39f711a-375d-4905-96a8-d11a45374133\") " pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:30.371240 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.371174    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c5e5dc64-36c8-49a9-b823-185c56534d6a-konnectivity-ca\") pod \"konnectivity-agent-ttwvq\" (UID: \"c5e5dc64-36c8-49a9-b823-185c56534d6a\") " pod="kube-system/konnectivity-agent-ttwvq"
Sep 15 11:25:30.371240 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.371195    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cc08c447-fc8f-4246-b543-08c147ced784-etc-selinux\") pod \"aws-ebs-csi-driver-node-6h7vw\" (UID: \"cc08c447-fc8f-4246-b543-08c147ced784\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6h7vw"
Sep 15 11:25:30.371240 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.371215    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c04ca25-e153-4f97-89db-aba1b15106bb-system-cni-dir\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.371240 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.371236    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8c04ca25-e153-4f97-89db-aba1b15106bb-host-run-netns\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.371688 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.371257    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6145cbf4-342d-4e4d-a322-2fc77d67553a-tmp-dir\") pod \"node-resolver-26srz\" (UID: \"6145cbf4-342d-4e4d-a322-2fc77d67553a\") " pod="openshift-dns/node-resolver-26srz"
Sep 15 11:25:30.371688 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.371279    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngpjt\" (UniqueName: \"kubernetes.io/projected/6145cbf4-342d-4e4d-a322-2fc77d67553a-kube-api-access-ngpjt\") pod \"node-resolver-26srz\" (UID: \"6145cbf4-342d-4e4d-a322-2fc77d67553a\") " pod="openshift-dns/node-resolver-26srz"
Sep 15 11:25:30.371688 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.371301    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2966eccf-c3c2-458b-a2a1-5a7e36112634-iptables-alerter-script\") pod \"iptables-alerter-5rpc8\" (UID: \"2966eccf-c3c2-458b-a2a1-5a7e36112634\") " pod="openshift-network-operator/iptables-alerter-5rpc8"
Sep 15 11:25:30.371688 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.371322    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cc08c447-fc8f-4246-b543-08c147ced784-socket-dir\") pod \"aws-ebs-csi-driver-node-6h7vw\" (UID: \"cc08c447-fc8f-4246-b543-08c147ced784\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6h7vw"
Sep 15 11:25:30.371688 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.371342    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c04ca25-e153-4f97-89db-aba1b15106bb-multus-cni-dir\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.371688 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.371362    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8c04ca25-e153-4f97-89db-aba1b15106bb-host-run-k8s-cni-cncf-io\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.371688 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.371383    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8c04ca25-e153-4f97-89db-aba1b15106bb-multus-daemon-config\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.371688 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.371415    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6145cbf4-342d-4e4d-a322-2fc77d67553a-hosts-file\") pod \"node-resolver-26srz\" (UID: \"6145cbf4-342d-4e4d-a322-2fc77d67553a\") " pod="openshift-dns/node-resolver-26srz"
Sep 15 11:25:30.371688 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.371435    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d39f711a-375d-4905-96a8-d11a45374133-etc-sysctl-conf\") pod \"tuned-88vmx\" (UID: \"d39f711a-375d-4905-96a8-d11a45374133\") " pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:30.371688 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.371454    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d39f711a-375d-4905-96a8-d11a45374133-etc-systemd\") pod \"tuned-88vmx\" (UID: \"d39f711a-375d-4905-96a8-d11a45374133\") " pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:30.371688 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.371474    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d39f711a-375d-4905-96a8-d11a45374133-tmp\") pod \"tuned-88vmx\" (UID: \"d39f711a-375d-4905-96a8-d11a45374133\") " pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:30.371688 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.371498    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv5xz\" (UniqueName: \"kubernetes.io/projected/d39f711a-375d-4905-96a8-d11a45374133-kube-api-access-hv5xz\") pod \"tuned-88vmx\" (UID: \"d39f711a-375d-4905-96a8-d11a45374133\") " pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:30.371688 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.371530    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cc08c447-fc8f-4246-b543-08c147ced784-registration-dir\") pod \"aws-ebs-csi-driver-node-6h7vw\" (UID: \"cc08c447-fc8f-4246-b543-08c147ced784\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6h7vw"
Sep 15 11:25:30.371688 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.371556    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c04ca25-e153-4f97-89db-aba1b15106bb-cnibin\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.371688 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.371614    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c04ca25-e153-4f97-89db-aba1b15106bb-multus-conf-dir\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.371688 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.371641    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d39f711a-375d-4905-96a8-d11a45374133-etc-sysconfig\") pod \"tuned-88vmx\" (UID: \"d39f711a-375d-4905-96a8-d11a45374133\") " pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:30.371688 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.371670    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2966eccf-c3c2-458b-a2a1-5a7e36112634-host-slash\") pod \"iptables-alerter-5rpc8\" (UID: \"2966eccf-c3c2-458b-a2a1-5a7e36112634\") " pod="openshift-network-operator/iptables-alerter-5rpc8"
Sep 15 11:25:30.372486 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.371696    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvffj\" (UniqueName: \"kubernetes.io/projected/2966eccf-c3c2-458b-a2a1-5a7e36112634-kube-api-access-cvffj\") pod \"iptables-alerter-5rpc8\" (UID: \"2966eccf-c3c2-458b-a2a1-5a7e36112634\") " pod="openshift-network-operator/iptables-alerter-5rpc8"
Sep 15 11:25:30.372486 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.371720    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cc08c447-fc8f-4246-b543-08c147ced784-sys-fs\") pod \"aws-ebs-csi-driver-node-6h7vw\" (UID: \"cc08c447-fc8f-4246-b543-08c147ced784\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6h7vw"
Sep 15 11:25:30.372486 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.371744    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8c04ca25-e153-4f97-89db-aba1b15106bb-host-var-lib-cni-bin\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.372486 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.371768    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c04ca25-e153-4f97-89db-aba1b15106bb-host-var-lib-kubelet\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.372486 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.371794    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8c04ca25-e153-4f97-89db-aba1b15106bb-host-run-multus-certs\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.372486 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.371818    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d39f711a-375d-4905-96a8-d11a45374133-etc-sysctl-d\") pod \"tuned-88vmx\" (UID: \"d39f711a-375d-4905-96a8-d11a45374133\") " pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:30.372486 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.371839    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s5df\" (UniqueName: \"kubernetes.io/projected/8f55f467-8c61-4930-b097-6636d194db5d-kube-api-access-8s5df\") pod \"network-metrics-daemon-k79mk\" (UID: \"8f55f467-8c61-4930-b097-6636d194db5d\") " pod="openshift-multus/network-metrics-daemon-k79mk"
Sep 15 11:25:30.372486 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.372102    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t82xl"
Sep 15 11:25:30.373865 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.373843    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 11:25:30.374341 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.374324    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fl5hm\""
Sep 15 11:25:30.374458 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.374346    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 15 11:25:30.374458 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.374323    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 15 11:25:30.374458 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.374329    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 15 11:25:30.395017 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.394987    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-sx7ws"
Sep 15 11:25:30.402733 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.402706    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-sx7ws"
Sep 15 11:25:30.462334 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.462304    2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 15 11:25:30.472186 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.472135    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8c04ca25-e153-4f97-89db-aba1b15106bb-host-run-multus-certs\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.472397 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.472198    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/000e6b60-7f5f-4af5-9e06-31a6cd4d8ef4-serviceca\") pod \"node-ca-t82xl\" (UID: \"000e6b60-7f5f-4af5-9e06-31a6cd4d8ef4\") " pod="openshift-image-registry/node-ca-t82xl"
Sep 15 11:25:30.472397 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.472296    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8c04ca25-e153-4f97-89db-aba1b15106bb-host-run-multus-certs\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.472397 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.472307    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2966eccf-c3c2-458b-a2a1-5a7e36112634-host-slash\") pod \"iptables-alerter-5rpc8\" (UID: \"2966eccf-c3c2-458b-a2a1-5a7e36112634\") " pod="openshift-network-operator/iptables-alerter-5rpc8"
Sep 15 11:25:30.472397 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.472349    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2966eccf-c3c2-458b-a2a1-5a7e36112634-host-slash\") pod \"iptables-alerter-5rpc8\" (UID: \"2966eccf-c3c2-458b-a2a1-5a7e36112634\") " pod="openshift-network-operator/iptables-alerter-5rpc8"
Sep 15 11:25:30.472397 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.472366    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c04ca25-e153-4f97-89db-aba1b15106bb-host-var-lib-kubelet\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.472620 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.472402    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-host-slash\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:30.472620 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.472425    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c04ca25-e153-4f97-89db-aba1b15106bb-host-var-lib-kubelet\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.472620 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.472429    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-run-ovn\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:30.472620 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.472479    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/35547786-abe3-420c-b9d8-036558749849-cni-binary-copy\") pod \"multus-additional-cni-plugins-q6x2d\" (UID: \"35547786-abe3-420c-b9d8-036558749849\") " pod="openshift-multus/multus-additional-cni-plugins-q6x2d"
Sep 15 11:25:30.472620 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.472508    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d39f711a-375d-4905-96a8-d11a45374133-run\") pod \"tuned-88vmx\" (UID: \"d39f711a-375d-4905-96a8-d11a45374133\") " pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:30.472620 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.472533    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d39f711a-375d-4905-96a8-d11a45374133-etc-tuned\") pod \"tuned-88vmx\" (UID: \"d39f711a-375d-4905-96a8-d11a45374133\") " pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:30.472620 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.472557    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnpxj\" (UniqueName: \"kubernetes.io/projected/80feec19-977b-483e-a7a2-f9badf61b984-kube-api-access-vnpxj\") pod \"network-check-target-zpbfk\" (UID: \"80feec19-977b-483e-a7a2-f9badf61b984\") " pod="openshift-network-diagnostics/network-check-target-zpbfk"
Sep 15 11:25:30.472620 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.472581    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c04ca25-e153-4f97-89db-aba1b15106bb-cni-binary-copy\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.472620 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.472588    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d39f711a-375d-4905-96a8-d11a45374133-run\") pod \"tuned-88vmx\" (UID: \"d39f711a-375d-4905-96a8-d11a45374133\") " pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:30.472620 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.472606    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8c04ca25-e153-4f97-89db-aba1b15106bb-host-var-lib-cni-multus\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.473108 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.472629    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c04ca25-e153-4f97-89db-aba1b15106bb-etc-kubernetes\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.473108 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.472653    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/35547786-abe3-420c-b9d8-036558749849-system-cni-dir\") pod \"multus-additional-cni-plugins-q6x2d\" (UID: \"35547786-abe3-420c-b9d8-036558749849\") " pod="openshift-multus/multus-additional-cni-plugins-q6x2d"
Sep 15 11:25:30.473108 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.472661    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8c04ca25-e153-4f97-89db-aba1b15106bb-host-var-lib-cni-multus\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.473108 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.472680    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d39f711a-375d-4905-96a8-d11a45374133-etc-modprobe-d\") pod \"tuned-88vmx\" (UID: \"d39f711a-375d-4905-96a8-d11a45374133\") " pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:30.473108 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.472705    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f55f467-8c61-4930-b097-6636d194db5d-metrics-certs\") pod \"network-metrics-daemon-k79mk\" (UID: \"8f55f467-8c61-4930-b097-6636d194db5d\") " pod="openshift-multus/network-metrics-daemon-k79mk"
Sep 15 11:25:30.473108 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.472703    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c04ca25-e153-4f97-89db-aba1b15106bb-etc-kubernetes\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.473108 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.472731    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8c04ca25-e153-4f97-89db-aba1b15106bb-multus-socket-dir-parent\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.473108 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.472754    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr75g\" (UniqueName: \"kubernetes.io/projected/8c04ca25-e153-4f97-89db-aba1b15106bb-kube-api-access-mr75g\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.473108 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.472774    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/35547786-abe3-420c-b9d8-036558749849-tuning-conf-dir\") pod \"multus-additional-cni-plugins-q6x2d\" (UID: \"35547786-abe3-420c-b9d8-036558749849\") " pod="openshift-multus/multus-additional-cni-plugins-q6x2d"
Sep 15 11:25:30.473108 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.472825    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqfhc\" (UniqueName: \"kubernetes.io/projected/35547786-abe3-420c-b9d8-036558749849-kube-api-access-dqfhc\") pod \"multus-additional-cni-plugins-q6x2d\" (UID: \"35547786-abe3-420c-b9d8-036558749849\") " pod="openshift-multus/multus-additional-cni-plugins-q6x2d"
Sep 15 11:25:30.473108 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:30.472837    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:25:30.473108 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.472850    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-node-log\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:30.473108 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.472874    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-ovn-node-metrics-cert\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:30.473108 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.472902    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d39f711a-375d-4905-96a8-d11a45374133-sys\") pod \"tuned-88vmx\" (UID: \"d39f711a-375d-4905-96a8-d11a45374133\") " pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:30.473108 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.472943    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c5e5dc64-36c8-49a9-b823-185c56534d6a-konnectivity-ca\") pod \"konnectivity-agent-ttwvq\" (UID: \"c5e5dc64-36c8-49a9-b823-185c56534d6a\") " pod="kube-system/konnectivity-agent-ttwvq"
Sep 15 11:25:30.473108 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.472969    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cc08c447-fc8f-4246-b543-08c147ced784-etc-selinux\") pod \"aws-ebs-csi-driver-node-6h7vw\" (UID: \"cc08c447-fc8f-4246-b543-08c147ced784\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6h7vw"
Sep 15 11:25:30.473108 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.472993    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c04ca25-e153-4f97-89db-aba1b15106bb-system-cni-dir\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.473108 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.472840    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d39f711a-375d-4905-96a8-d11a45374133-etc-modprobe-d\") pod \"tuned-88vmx\" (UID: \"d39f711a-375d-4905-96a8-d11a45374133\") " pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:30.473995 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.473015    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8c04ca25-e153-4f97-89db-aba1b15106bb-host-run-netns\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.473995 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.473041    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sv7k\" (UniqueName: \"kubernetes.io/projected/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-kube-api-access-8sv7k\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:30.473995 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.473047    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8c04ca25-e153-4f97-89db-aba1b15106bb-multus-socket-dir-parent\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.473995 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:30.473102    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f55f467-8c61-4930-b097-6636d194db5d-metrics-certs podName:8f55f467-8c61-4930-b097-6636d194db5d nodeName:}" failed. No retries permitted until 2026-09-15 11:25:30.973059965 +0000 UTC m=+2.991137897 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f55f467-8c61-4930-b097-6636d194db5d-metrics-certs") pod "network-metrics-daemon-k79mk" (UID: "8f55f467-8c61-4930-b097-6636d194db5d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:25:30.473995 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.473130    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d39f711a-375d-4905-96a8-d11a45374133-sys\") pod \"tuned-88vmx\" (UID: \"d39f711a-375d-4905-96a8-d11a45374133\") " pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:30.473995 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.473165    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8c04ca25-e153-4f97-89db-aba1b15106bb-host-run-netns\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.473995 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.473213    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cc08c447-fc8f-4246-b543-08c147ced784-etc-selinux\") pod \"aws-ebs-csi-driver-node-6h7vw\" (UID: \"cc08c447-fc8f-4246-b543-08c147ced784\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6h7vw"
Sep 15 11:25:30.473995 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.473243    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c0bac93c-2a52-439c-a4a6-d4d31424d653-kubelet-config\") pod \"global-pull-secret-syncer-q96s9\" (UID: \"c0bac93c-2a52-439c-a4a6-d4d31424d653\") " pod="kube-system/global-pull-secret-syncer-q96s9"
Sep 15 11:25:30.473995 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.473261    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c04ca25-e153-4f97-89db-aba1b15106bb-system-cni-dir\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.473995 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.473302    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6145cbf4-342d-4e4d-a322-2fc77d67553a-tmp-dir\") pod \"node-resolver-26srz\" (UID: \"6145cbf4-342d-4e4d-a322-2fc77d67553a\") " pod="openshift-dns/node-resolver-26srz"
Sep 15 11:25:30.473995 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.473360    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngpjt\" (UniqueName: \"kubernetes.io/projected/6145cbf4-342d-4e4d-a322-2fc77d67553a-kube-api-access-ngpjt\") pod \"node-resolver-26srz\" (UID: \"6145cbf4-342d-4e4d-a322-2fc77d67553a\") " pod="openshift-dns/node-resolver-26srz"
Sep 15 11:25:30.473995 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.473348    2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 15 11:25:30.473995 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.473418    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2966eccf-c3c2-458b-a2a1-5a7e36112634-iptables-alerter-script\") pod \"iptables-alerter-5rpc8\" (UID: \"2966eccf-c3c2-458b-a2a1-5a7e36112634\") " pod="openshift-network-operator/iptables-alerter-5rpc8"
Sep 15 11:25:30.473995 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.473542    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c04ca25-e153-4f97-89db-aba1b15106bb-multus-cni-dir\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.473995 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.473570    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:30.473995 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.473615    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-env-overrides\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:30.473995 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.473618    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6145cbf4-342d-4e4d-a322-2fc77d67553a-tmp-dir\") pod \"node-resolver-26srz\" (UID: \"6145cbf4-342d-4e4d-a322-2fc77d67553a\") " pod="openshift-dns/node-resolver-26srz"
Sep 15 11:25:30.474761 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.473643    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6145cbf4-342d-4e4d-a322-2fc77d67553a-hosts-file\") pod \"node-resolver-26srz\" (UID: \"6145cbf4-342d-4e4d-a322-2fc77d67553a\") " pod="openshift-dns/node-resolver-26srz"
Sep 15 11:25:30.474761 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.473681    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d39f711a-375d-4905-96a8-d11a45374133-etc-sysctl-conf\") pod \"tuned-88vmx\" (UID: \"d39f711a-375d-4905-96a8-d11a45374133\") " pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:30.474761 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.473719    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv5xz\" (UniqueName: \"kubernetes.io/projected/d39f711a-375d-4905-96a8-d11a45374133-kube-api-access-hv5xz\") pod \"tuned-88vmx\" (UID: \"d39f711a-375d-4905-96a8-d11a45374133\") " pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:30.474761 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.473718    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c5e5dc64-36c8-49a9-b823-185c56534d6a-konnectivity-ca\") pod \"konnectivity-agent-ttwvq\" (UID: \"c5e5dc64-36c8-49a9-b823-185c56534d6a\") " pod="kube-system/konnectivity-agent-ttwvq"
Sep 15 11:25:30.474761 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.473745    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cc08c447-fc8f-4246-b543-08c147ced784-registration-dir\") pod \"aws-ebs-csi-driver-node-6h7vw\" (UID: \"cc08c447-fc8f-4246-b543-08c147ced784\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6h7vw"
Sep 15 11:25:30.474761 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.473754    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c04ca25-e153-4f97-89db-aba1b15106bb-cni-binary-copy\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.474761 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.473772    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c04ca25-e153-4f97-89db-aba1b15106bb-multus-conf-dir\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.474761 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.473818    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c04ca25-e153-4f97-89db-aba1b15106bb-multus-conf-dir\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.474761 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.473959    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d39f711a-375d-4905-96a8-d11a45374133-etc-sysctl-conf\") pod \"tuned-88vmx\" (UID: \"d39f711a-375d-4905-96a8-d11a45374133\") " pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:30.474761 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.473994    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/35547786-abe3-420c-b9d8-036558749849-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-q6x2d\" (UID: \"35547786-abe3-420c-b9d8-036558749849\") " pod="openshift-multus/multus-additional-cni-plugins-q6x2d"
Sep 15 11:25:30.474761 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.474033    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cc08c447-fc8f-4246-b543-08c147ced784-registration-dir\") pod \"aws-ebs-csi-driver-node-6h7vw\" (UID: \"cc08c447-fc8f-4246-b543-08c147ced784\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6h7vw"
Sep 15 11:25:30.474761 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.474076    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-run-openvswitch\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:30.474761 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.474102    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-ovnkube-config\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:30.474761 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.474153    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d39f711a-375d-4905-96a8-d11a45374133-etc-sysconfig\") pod \"tuned-88vmx\" (UID: \"d39f711a-375d-4905-96a8-d11a45374133\") " pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:30.474761 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.474175    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2966eccf-c3c2-458b-a2a1-5a7e36112634-iptables-alerter-script\") pod \"iptables-alerter-5rpc8\" (UID: \"2966eccf-c3c2-458b-a2a1-5a7e36112634\") " pod="openshift-network-operator/iptables-alerter-5rpc8"
Sep 15 11:25:30.474761 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.474409    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvffj\" (UniqueName: \"kubernetes.io/projected/2966eccf-c3c2-458b-a2a1-5a7e36112634-kube-api-access-cvffj\") pod \"iptables-alerter-5rpc8\" (UID: \"2966eccf-c3c2-458b-a2a1-5a7e36112634\") " pod="openshift-network-operator/iptables-alerter-5rpc8"
Sep 15 11:25:30.474761 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.474231    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d39f711a-375d-4905-96a8-d11a45374133-etc-sysconfig\") pod \"tuned-88vmx\" (UID: \"d39f711a-375d-4905-96a8-d11a45374133\") " pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:30.475627 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.473839    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c04ca25-e153-4f97-89db-aba1b15106bb-multus-cni-dir\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.475627 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.474448    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cc08c447-fc8f-4246-b543-08c147ced784-sys-fs\") pod \"aws-ebs-csi-driver-node-6h7vw\" (UID: \"cc08c447-fc8f-4246-b543-08c147ced784\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6h7vw"
Sep 15 11:25:30.475627 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.474180    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6145cbf4-342d-4e4d-a322-2fc77d67553a-hosts-file\") pod \"node-resolver-26srz\" (UID: \"6145cbf4-342d-4e4d-a322-2fc77d67553a\") " pod="openshift-dns/node-resolver-26srz"
Sep 15 11:25:30.475627 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.474512    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8c04ca25-e153-4f97-89db-aba1b15106bb-host-var-lib-cni-bin\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.475627 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.474549    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/000e6b60-7f5f-4af5-9e06-31a6cd4d8ef4-host\") pod \"node-ca-t82xl\" (UID: \"000e6b60-7f5f-4af5-9e06-31a6cd4d8ef4\") " pod="openshift-image-registry/node-ca-t82xl"
Sep 15 11:25:30.475627 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.474558    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cc08c447-fc8f-4246-b543-08c147ced784-sys-fs\") pod \"aws-ebs-csi-driver-node-6h7vw\" (UID: \"cc08c447-fc8f-4246-b543-08c147ced784\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6h7vw"
Sep 15 11:25:30.475627 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.474573    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d39f711a-375d-4905-96a8-d11a45374133-etc-sysctl-d\") pod \"tuned-88vmx\" (UID: \"d39f711a-375d-4905-96a8-d11a45374133\") " pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:30.475627 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.474597    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s5df\" (UniqueName: \"kubernetes.io/projected/8f55f467-8c61-4930-b097-6636d194db5d-kube-api-access-8s5df\") pod \"network-metrics-daemon-k79mk\" (UID: \"8f55f467-8c61-4930-b097-6636d194db5d\") " pod="openshift-multus/network-metrics-daemon-k79mk"
Sep 15 11:25:30.475627 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.474620    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-host-run-ovn-kubernetes\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:30.475627 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.474644    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d39f711a-375d-4905-96a8-d11a45374133-lib-modules\") pod \"tuned-88vmx\" (UID: \"d39f711a-375d-4905-96a8-d11a45374133\") " pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:30.475627 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.474665    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d39f711a-375d-4905-96a8-d11a45374133-host\") pod \"tuned-88vmx\" (UID: \"d39f711a-375d-4905-96a8-d11a45374133\") " pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:30.475627 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.474645    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8c04ca25-e153-4f97-89db-aba1b15106bb-host-var-lib-cni-bin\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.475627 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.474703    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c5e5dc64-36c8-49a9-b823-185c56534d6a-agent-certs\") pod \"konnectivity-agent-ttwvq\" (UID: \"c5e5dc64-36c8-49a9-b823-185c56534d6a\") " pod="kube-system/konnectivity-agent-ttwvq"
Sep 15 11:25:30.475627 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.474725    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cc08c447-fc8f-4246-b543-08c147ced784-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6h7vw\" (UID: \"cc08c447-fc8f-4246-b543-08c147ced784\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6h7vw"
Sep 15 11:25:30.475627 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.474746    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8c04ca25-e153-4f97-89db-aba1b15106bb-hostroot\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.475627 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.474751    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d39f711a-375d-4905-96a8-d11a45374133-lib-modules\") pod \"tuned-88vmx\" (UID: \"d39f711a-375d-4905-96a8-d11a45374133\") " pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:30.475627 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.474765    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-host-kubelet\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:30.475627 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.474763    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d39f711a-375d-4905-96a8-d11a45374133-etc-sysctl-d\") pod \"tuned-88vmx\" (UID: \"d39f711a-375d-4905-96a8-d11a45374133\") " pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:30.476364 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.474804    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8c04ca25-e153-4f97-89db-aba1b15106bb-hostroot\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.476364 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.474808    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cc08c447-fc8f-4246-b543-08c147ced784-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6h7vw\" (UID: \"cc08c447-fc8f-4246-b543-08c147ced784\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6h7vw"
Sep 15 11:25:30.476364 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.474828    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-host-run-netns\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:30.476364 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.474855    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-systemd-units\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:30.476364 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.474877    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-run-systemd\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:30.476364 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.474920    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-etc-openvswitch\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:30.476364 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.474952    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-log-socket\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:30.476364 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.474975    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c0bac93c-2a52-439c-a4a6-d4d31424d653-dbus\") pod \"global-pull-secret-syncer-q96s9\" (UID: \"c0bac93c-2a52-439c-a4a6-d4d31424d653\") " pod="kube-system/global-pull-secret-syncer-q96s9"
Sep 15 11:25:30.476364 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.475001    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/35547786-abe3-420c-b9d8-036558749849-cnibin\") pod \"multus-additional-cni-plugins-q6x2d\" (UID: \"35547786-abe3-420c-b9d8-036558749849\") " pod="openshift-multus/multus-additional-cni-plugins-q6x2d"
Sep 15 11:25:30.476364 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.475030    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d39f711a-375d-4905-96a8-d11a45374133-etc-kubernetes\") pod \"tuned-88vmx\" (UID: \"d39f711a-375d-4905-96a8-d11a45374133\") " pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:30.476364 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.475055    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cc08c447-fc8f-4246-b543-08c147ced784-device-dir\") pod \"aws-ebs-csi-driver-node-6h7vw\" (UID: \"cc08c447-fc8f-4246-b543-08c147ced784\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6h7vw"
Sep 15 11:25:30.476364 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.475081    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx7w6\" (UniqueName: \"kubernetes.io/projected/cc08c447-fc8f-4246-b543-08c147ced784-kube-api-access-sx7w6\") pod \"aws-ebs-csi-driver-node-6h7vw\" (UID: \"cc08c447-fc8f-4246-b543-08c147ced784\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6h7vw"
Sep 15 11:25:30.476364 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.475142    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d39f711a-375d-4905-96a8-d11a45374133-host\") pod \"tuned-88vmx\" (UID: \"d39f711a-375d-4905-96a8-d11a45374133\") " pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:30.476364 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.475167    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d39f711a-375d-4905-96a8-d11a45374133-etc-kubernetes\") pod \"tuned-88vmx\" (UID: \"d39f711a-375d-4905-96a8-d11a45374133\") " pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:30.476364 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.475207    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/35547786-abe3-420c-b9d8-036558749849-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-q6x2d\" (UID: \"35547786-abe3-420c-b9d8-036558749849\") " pod="openshift-multus/multus-additional-cni-plugins-q6x2d"
Sep 15 11:25:30.476364 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.475224    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cc08c447-fc8f-4246-b543-08c147ced784-device-dir\") pod \"aws-ebs-csi-driver-node-6h7vw\" (UID: \"cc08c447-fc8f-4246-b543-08c147ced784\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6h7vw"
Sep 15 11:25:30.476364 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.475237    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-host-cni-netd\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:30.477140 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.475266    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d39f711a-375d-4905-96a8-d11a45374133-var-lib-kubelet\") pod \"tuned-88vmx\" (UID: \"d39f711a-375d-4905-96a8-d11a45374133\") " pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:30.477140 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.475302    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2fqf\" (UniqueName: \"kubernetes.io/projected/000e6b60-7f5f-4af5-9e06-31a6cd4d8ef4-kube-api-access-c2fqf\") pod \"node-ca-t82xl\" (UID: \"000e6b60-7f5f-4af5-9e06-31a6cd4d8ef4\") " pod="openshift-image-registry/node-ca-t82xl"
Sep 15 11:25:30.477140 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.475328    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-var-lib-openvswitch\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:30.477140 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.475353    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d39f711a-375d-4905-96a8-d11a45374133-var-lib-kubelet\") pod \"tuned-88vmx\" (UID: \"d39f711a-375d-4905-96a8-d11a45374133\") " pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:30.477140 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.475353    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c0bac93c-2a52-439c-a4a6-d4d31424d653-original-pull-secret\") pod \"global-pull-secret-syncer-q96s9\" (UID: \"c0bac93c-2a52-439c-a4a6-d4d31424d653\") " pod="kube-system/global-pull-secret-syncer-q96s9"
Sep 15 11:25:30.477140 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.475385    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cc08c447-fc8f-4246-b543-08c147ced784-socket-dir\") pod \"aws-ebs-csi-driver-node-6h7vw\" (UID: \"cc08c447-fc8f-4246-b543-08c147ced784\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6h7vw"
Sep 15 11:25:30.477140 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.475417    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8c04ca25-e153-4f97-89db-aba1b15106bb-host-run-k8s-cni-cncf-io\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.477140 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.475441    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8c04ca25-e153-4f97-89db-aba1b15106bb-multus-daemon-config\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.477140 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.475485    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-host-cni-bin\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:30.477140 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.475490    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cc08c447-fc8f-4246-b543-08c147ced784-socket-dir\") pod \"aws-ebs-csi-driver-node-6h7vw\" (UID: \"cc08c447-fc8f-4246-b543-08c147ced784\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6h7vw"
Sep 15 11:25:30.477140 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.475501    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8c04ca25-e153-4f97-89db-aba1b15106bb-host-run-k8s-cni-cncf-io\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.477140 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.475510    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-ovnkube-script-lib\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:30.477140 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.475534    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d39f711a-375d-4905-96a8-d11a45374133-etc-systemd\") pod \"tuned-88vmx\" (UID: \"d39f711a-375d-4905-96a8-d11a45374133\") " pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:30.477140 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.475565    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d39f711a-375d-4905-96a8-d11a45374133-tmp\") pod \"tuned-88vmx\" (UID: \"d39f711a-375d-4905-96a8-d11a45374133\") " pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:30.477140 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.475591    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c04ca25-e153-4f97-89db-aba1b15106bb-cnibin\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.477140 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.475635    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d39f711a-375d-4905-96a8-d11a45374133-etc-systemd\") pod \"tuned-88vmx\" (UID: \"d39f711a-375d-4905-96a8-d11a45374133\") " pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:30.477140 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.475686    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c04ca25-e153-4f97-89db-aba1b15106bb-cnibin\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.477811 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.475981    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8c04ca25-e153-4f97-89db-aba1b15106bb-multus-daemon-config\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.478292 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.478266    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d39f711a-375d-4905-96a8-d11a45374133-etc-tuned\") pod \"tuned-88vmx\" (UID: \"d39f711a-375d-4905-96a8-d11a45374133\") " pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:30.478395 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.478290    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d39f711a-375d-4905-96a8-d11a45374133-tmp\") pod \"tuned-88vmx\" (UID: \"d39f711a-375d-4905-96a8-d11a45374133\") " pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:30.479332 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.479296    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c5e5dc64-36c8-49a9-b823-185c56534d6a-agent-certs\") pod \"konnectivity-agent-ttwvq\" (UID: \"c5e5dc64-36c8-49a9-b823-185c56534d6a\") " pod="kube-system/konnectivity-agent-ttwvq"
Sep 15 11:25:30.481890 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:30.481296    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 11:25:30.481890 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:30.481320    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 11:25:30.481890 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:30.481341    2575 projected.go:196] Error preparing data for projected volume kube-api-access-vnpxj for pod openshift-network-diagnostics/network-check-target-zpbfk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:25:30.481890 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:30.481411    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80feec19-977b-483e-a7a2-f9badf61b984-kube-api-access-vnpxj podName:80feec19-977b-483e-a7a2-f9badf61b984 nodeName:}" failed. No retries permitted until 2026-09-15 11:25:30.981393589 +0000 UTC m=+2.999471544 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vnpxj" (UniqueName: "kubernetes.io/projected/80feec19-977b-483e-a7a2-f9badf61b984-kube-api-access-vnpxj") pod "network-check-target-zpbfk" (UID: "80feec19-977b-483e-a7a2-f9badf61b984") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:25:30.485335 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.485308    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s5df\" (UniqueName: \"kubernetes.io/projected/8f55f467-8c61-4930-b097-6636d194db5d-kube-api-access-8s5df\") pod \"network-metrics-daemon-k79mk\" (UID: \"8f55f467-8c61-4930-b097-6636d194db5d\") " pod="openshift-multus/network-metrics-daemon-k79mk"
Sep 15 11:25:30.486983 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.486958    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx7w6\" (UniqueName: \"kubernetes.io/projected/cc08c447-fc8f-4246-b543-08c147ced784-kube-api-access-sx7w6\") pod \"aws-ebs-csi-driver-node-6h7vw\" (UID: \"cc08c447-fc8f-4246-b543-08c147ced784\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6h7vw"
Sep 15 11:25:30.487338 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.487315    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngpjt\" (UniqueName: \"kubernetes.io/projected/6145cbf4-342d-4e4d-a322-2fc77d67553a-kube-api-access-ngpjt\") pod \"node-resolver-26srz\" (UID: \"6145cbf4-342d-4e4d-a322-2fc77d67553a\") " pod="openshift-dns/node-resolver-26srz"
Sep 15 11:25:30.487425 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.487358    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvffj\" (UniqueName: \"kubernetes.io/projected/2966eccf-c3c2-458b-a2a1-5a7e36112634-kube-api-access-cvffj\") pod \"iptables-alerter-5rpc8\" (UID: \"2966eccf-c3c2-458b-a2a1-5a7e36112634\") " pod="openshift-network-operator/iptables-alerter-5rpc8"
Sep 15 11:25:30.487768 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.487744    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr75g\" (UniqueName: \"kubernetes.io/projected/8c04ca25-e153-4f97-89db-aba1b15106bb-kube-api-access-mr75g\") pod \"multus-4dmcz\" (UID: \"8c04ca25-e153-4f97-89db-aba1b15106bb\") " pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:30.488110 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:30.488093    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv5xz\" (UniqueName: \"kubernetes.io/projected/d39f711a-375d-4905-96a8-d11a45374133-kube-api-access-hv5xz\") pod \"tuned-88vmx\" (UID: \"d39f711a-375d-4905-96a8-d11a45374133\") " pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:32.168098 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.168042    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-node-log\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:32.168098 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.168091    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-ovn-node-metrics-cert\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:32.168396 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.168123    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sv7k\" (UniqueName: \"kubernetes.io/projected/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-kube-api-access-8sv7k\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:32.168396 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.168189    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-node-log\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:32.168396 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.168238    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c0bac93c-2a52-439c-a4a6-d4d31424d653-kubelet-config\") pod \"global-pull-secret-syncer-q96s9\" (UID: \"c0bac93c-2a52-439c-a4a6-d4d31424d653\") " pod="kube-system/global-pull-secret-syncer-q96s9"
Sep 15 11:25:32.168396 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.168276    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:32.168396 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.168302    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-env-overrides\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:32.168396 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.168331    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/35547786-abe3-420c-b9d8-036558749849-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-q6x2d\" (UID: \"35547786-abe3-420c-b9d8-036558749849\") " pod="openshift-multus/multus-additional-cni-plugins-q6x2d"
Sep 15 11:25:32.168396 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.168354    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-run-openvswitch\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:32.168396 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.168375    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-ovnkube-config\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:32.168396 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.168398    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/000e6b60-7f5f-4af5-9e06-31a6cd4d8ef4-host\") pod \"node-ca-t82xl\" (UID: \"000e6b60-7f5f-4af5-9e06-31a6cd4d8ef4\") " pod="openshift-image-registry/node-ca-t82xl"
Sep 15 11:25:32.168396 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.168395    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c0bac93c-2a52-439c-a4a6-d4d31424d653-kubelet-config\") pod \"global-pull-secret-syncer-q96s9\" (UID: \"c0bac93c-2a52-439c-a4a6-d4d31424d653\") " pod="kube-system/global-pull-secret-syncer-q96s9"
Sep 15 11:25:32.168883 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.168402    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:32.168883 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.168458    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-host-run-ovn-kubernetes\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:32.168883 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.168483    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-run-openvswitch\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:32.168883 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.168493    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-host-kubelet\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:32.168883 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.168462    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/000e6b60-7f5f-4af5-9e06-31a6cd4d8ef4-host\") pod \"node-ca-t82xl\" (UID: \"000e6b60-7f5f-4af5-9e06-31a6cd4d8ef4\") " pod="openshift-image-registry/node-ca-t82xl"
Sep 15 11:25:32.168883 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.168520    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-host-run-netns\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:32.168883 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.168543    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-systemd-units\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:32.168883 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.168545    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-host-run-ovn-kubernetes\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:32.168883 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.168577    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-host-run-netns\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:32.168883 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.168600    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-run-systemd\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:32.168883 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.168598    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-systemd-units\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:32.168883 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.168620    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-etc-openvswitch\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:32.168883 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.168640    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-log-socket\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:32.168883 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.168649    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-host-kubelet\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:32.168883 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.168678    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c0bac93c-2a52-439c-a4a6-d4d31424d653-dbus\") pod \"global-pull-secret-syncer-q96s9\" (UID: \"c0bac93c-2a52-439c-a4a6-d4d31424d653\") " pod="kube-system/global-pull-secret-syncer-q96s9"
Sep 15 11:25:32.168883 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.168707    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-etc-openvswitch\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:32.168883 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.168696    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/35547786-abe3-420c-b9d8-036558749849-cnibin\") pod \"multus-additional-cni-plugins-q6x2d\" (UID: \"35547786-abe3-420c-b9d8-036558749849\") " pod="openshift-multus/multus-additional-cni-plugins-q6x2d"
Sep 15 11:25:32.169623 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.168743    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-run-systemd\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:32.169623 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.168757    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/35547786-abe3-420c-b9d8-036558749849-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-q6x2d\" (UID: \"35547786-abe3-420c-b9d8-036558749849\") " pod="openshift-multus/multus-additional-cni-plugins-q6x2d"
Sep 15 11:25:32.169623 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.168765    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-log-socket\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:32.169623 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.168781    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-host-cni-netd\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:32.169623 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.168787    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/35547786-abe3-420c-b9d8-036558749849-cnibin\") pod \"multus-additional-cni-plugins-q6x2d\" (UID: \"35547786-abe3-420c-b9d8-036558749849\") " pod="openshift-multus/multus-additional-cni-plugins-q6x2d"
Sep 15 11:25:32.169623 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.168832    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2fqf\" (UniqueName: \"kubernetes.io/projected/000e6b60-7f5f-4af5-9e06-31a6cd4d8ef4-kube-api-access-c2fqf\") pod \"node-ca-t82xl\" (UID: \"000e6b60-7f5f-4af5-9e06-31a6cd4d8ef4\") " pod="openshift-image-registry/node-ca-t82xl"
Sep 15 11:25:32.169623 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.168852    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c0bac93c-2a52-439c-a4a6-d4d31424d653-dbus\") pod \"global-pull-secret-syncer-q96s9\" (UID: \"c0bac93c-2a52-439c-a4a6-d4d31424d653\") " pod="kube-system/global-pull-secret-syncer-q96s9"
Sep 15 11:25:32.169623 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.168864    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-var-lib-openvswitch\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:32.169623 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.168911    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-var-lib-openvswitch\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:32.169623 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.168922    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-env-overrides\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:32.169623 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.168943    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c0bac93c-2a52-439c-a4a6-d4d31424d653-original-pull-secret\") pod \"global-pull-secret-syncer-q96s9\" (UID: \"c0bac93c-2a52-439c-a4a6-d4d31424d653\") " pod="kube-system/global-pull-secret-syncer-q96s9"
Sep 15 11:25:32.169623 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.168980    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-host-cni-bin\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:32.169623 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.169007    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-ovnkube-script-lib\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:32.169623 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:32.169014    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 11:25:32.169623 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.169037    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/000e6b60-7f5f-4af5-9e06-31a6cd4d8ef4-serviceca\") pod \"node-ca-t82xl\" (UID: \"000e6b60-7f5f-4af5-9e06-31a6cd4d8ef4\") " pod="openshift-image-registry/node-ca-t82xl"
Sep 15 11:25:32.169623 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.169050    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/35547786-abe3-420c-b9d8-036558749849-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-q6x2d\" (UID: \"35547786-abe3-420c-b9d8-036558749849\") " pod="openshift-multus/multus-additional-cni-plugins-q6x2d"
Sep 15 11:25:32.169623 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:32.169065    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0bac93c-2a52-439c-a4a6-d4d31424d653-original-pull-secret podName:c0bac93c-2a52-439c-a4a6-d4d31424d653 nodeName:}" failed. No retries permitted until 2026-09-15 11:25:32.669047424 +0000 UTC m=+3.095377999 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c0bac93c-2a52-439c-a4a6-d4d31424d653-original-pull-secret") pod "global-pull-secret-syncer-q96s9" (UID: "c0bac93c-2a52-439c-a4a6-d4d31424d653") : object "kube-system"/"original-pull-secret" not registered
Sep 15 11:25:32.170299 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.169110    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-host-slash\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:32.170299 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.169129    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-host-cni-netd\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:32.170299 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.169138    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-run-ovn\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:32.170299 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.169171    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/35547786-abe3-420c-b9d8-036558749849-cni-binary-copy\") pod \"multus-additional-cni-plugins-q6x2d\" (UID: \"35547786-abe3-420c-b9d8-036558749849\") " pod="openshift-multus/multus-additional-cni-plugins-q6x2d"
Sep 15 11:25:32.170299 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.169234    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-run-ovn\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:32.170299 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.169257    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/35547786-abe3-420c-b9d8-036558749849-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-q6x2d\" (UID: \"35547786-abe3-420c-b9d8-036558749849\") " pod="openshift-multus/multus-additional-cni-plugins-q6x2d"
Sep 15 11:25:32.170299 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.169265    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-host-cni-bin\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:32.170299 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.169294    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/35547786-abe3-420c-b9d8-036558749849-system-cni-dir\") pod \"multus-additional-cni-plugins-q6x2d\" (UID: \"35547786-abe3-420c-b9d8-036558749849\") " pod="openshift-multus/multus-additional-cni-plugins-q6x2d"
Sep 15 11:25:32.170299 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.169309    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-host-slash\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:32.170299 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.169384    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-ovnkube-config\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:32.170299 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.169422    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/000e6b60-7f5f-4af5-9e06-31a6cd4d8ef4-serviceca\") pod \"node-ca-t82xl\" (UID: \"000e6b60-7f5f-4af5-9e06-31a6cd4d8ef4\") " pod="openshift-image-registry/node-ca-t82xl"
Sep 15 11:25:32.170299 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.169436    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/35547786-abe3-420c-b9d8-036558749849-tuning-conf-dir\") pod \"multus-additional-cni-plugins-q6x2d\" (UID: \"35547786-abe3-420c-b9d8-036558749849\") " pod="openshift-multus/multus-additional-cni-plugins-q6x2d"
Sep 15 11:25:32.170299 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.169443    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/35547786-abe3-420c-b9d8-036558749849-system-cni-dir\") pod \"multus-additional-cni-plugins-q6x2d\" (UID: \"35547786-abe3-420c-b9d8-036558749849\") " pod="openshift-multus/multus-additional-cni-plugins-q6x2d"
Sep 15 11:25:32.170299 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.169473    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqfhc\" (UniqueName: \"kubernetes.io/projected/35547786-abe3-420c-b9d8-036558749849-kube-api-access-dqfhc\") pod \"multus-additional-cni-plugins-q6x2d\" (UID: \"35547786-abe3-420c-b9d8-036558749849\") " pod="openshift-multus/multus-additional-cni-plugins-q6x2d"
Sep 15 11:25:32.170299 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.169618    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/35547786-abe3-420c-b9d8-036558749849-tuning-conf-dir\") pod \"multus-additional-cni-plugins-q6x2d\" (UID: \"35547786-abe3-420c-b9d8-036558749849\") " pod="openshift-multus/multus-additional-cni-plugins-q6x2d"
Sep 15 11:25:32.170299 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.169719    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/35547786-abe3-420c-b9d8-036558749849-cni-binary-copy\") pod \"multus-additional-cni-plugins-q6x2d\" (UID: \"35547786-abe3-420c-b9d8-036558749849\") " pod="openshift-multus/multus-additional-cni-plugins-q6x2d"
Sep 15 11:25:32.170299 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.169991    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-ovnkube-script-lib\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:32.171590 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.171565    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-ovn-node-metrics-cert\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:32.180293 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.180256    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqfhc\" (UniqueName: \"kubernetes.io/projected/35547786-abe3-420c-b9d8-036558749849-kube-api-access-dqfhc\") pod \"multus-additional-cni-plugins-q6x2d\" (UID: \"35547786-abe3-420c-b9d8-036558749849\") " pod="openshift-multus/multus-additional-cni-plugins-q6x2d"
Sep 15 11:25:32.180293 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.180281    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sv7k\" (UniqueName: \"kubernetes.io/projected/a0b1e3c8-ac60-42b1-9454-b66ae2d969f3-kube-api-access-8sv7k\") pod \"ovnkube-node-nvpfc\" (UID: \"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:32.180293 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.180293    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2fqf\" (UniqueName: \"kubernetes.io/projected/000e6b60-7f5f-4af5-9e06-31a6cd4d8ef4-kube-api-access-c2fqf\") pod \"node-ca-t82xl\" (UID: \"000e6b60-7f5f-4af5-9e06-31a6cd4d8ef4\") " pod="openshift-image-registry/node-ca-t82xl"
Sep 15 11:25:32.259380 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.259286    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-26srz"
Sep 15 11:25:32.265712 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.265684    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-88vmx"
Sep 15 11:25:32.274741 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.274709    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5rpc8"
Sep 15 11:25:32.279627 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.279601    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ttwvq"
Sep 15 11:25:32.286554 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.286515    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6h7vw"
Sep 15 11:25:32.292623 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.292583    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4dmcz"
Sep 15 11:25:32.298099 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.298064    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-q6x2d"
Sep 15 11:25:32.304249 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.304218    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:32.309577 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.309543    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t82xl"
Sep 15 11:25:32.456974 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.456945    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 11:25:32.572064 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.571964    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f55f467-8c61-4930-b097-6636d194db5d-metrics-certs\") pod \"network-metrics-daemon-k79mk\" (UID: \"8f55f467-8c61-4930-b097-6636d194db5d\") " pod="openshift-multus/network-metrics-daemon-k79mk"
Sep 15 11:25:32.572256 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:32.572116    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:25:32.572256 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:32.572185    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f55f467-8c61-4930-b097-6636d194db5d-metrics-certs podName:8f55f467-8c61-4930-b097-6636d194db5d nodeName:}" failed. No retries permitted until 2026-09-15 11:25:33.572165104 +0000 UTC m=+3.998495679 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f55f467-8c61-4930-b097-6636d194db5d-metrics-certs") pod "network-metrics-daemon-k79mk" (UID: "8f55f467-8c61-4930-b097-6636d194db5d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:25:32.673180 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.673145    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c0bac93c-2a52-439c-a4a6-d4d31424d653-original-pull-secret\") pod \"global-pull-secret-syncer-q96s9\" (UID: \"c0bac93c-2a52-439c-a4a6-d4d31424d653\") " pod="kube-system/global-pull-secret-syncer-q96s9"
Sep 15 11:25:32.673180 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.673189    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnpxj\" (UniqueName: \"kubernetes.io/projected/80feec19-977b-483e-a7a2-f9badf61b984-kube-api-access-vnpxj\") pod \"network-check-target-zpbfk\" (UID: \"80feec19-977b-483e-a7a2-f9badf61b984\") " pod="openshift-network-diagnostics/network-check-target-zpbfk"
Sep 15 11:25:32.673376 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:32.673313    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 11:25:32.673376 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:32.673316    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 11:25:32.673376 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:32.673329    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 11:25:32.673376 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:32.673341    2575 projected.go:196] Error preparing data for projected volume kube-api-access-vnpxj for pod openshift-network-diagnostics/network-check-target-zpbfk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:25:32.673500 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:32.673389    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0bac93c-2a52-439c-a4a6-d4d31424d653-original-pull-secret podName:c0bac93c-2a52-439c-a4a6-d4d31424d653 nodeName:}" failed. No retries permitted until 2026-09-15 11:25:33.673372986 +0000 UTC m=+4.099703559 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c0bac93c-2a52-439c-a4a6-d4d31424d653-original-pull-secret") pod "global-pull-secret-syncer-q96s9" (UID: "c0bac93c-2a52-439c-a4a6-d4d31424d653") : object "kube-system"/"original-pull-secret" not registered
Sep 15 11:25:32.673500 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:32.673405    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80feec19-977b-483e-a7a2-f9badf61b984-kube-api-access-vnpxj podName:80feec19-977b-483e-a7a2-f9badf61b984 nodeName:}" failed. No retries permitted until 2026-09-15 11:25:33.67339913 +0000 UTC m=+4.099729705 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vnpxj" (UniqueName: "kubernetes.io/projected/80feec19-977b-483e-a7a2-f9badf61b984-kube-api-access-vnpxj") pod "network-check-target-zpbfk" (UID: "80feec19-977b-483e-a7a2-f9badf61b984") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:25:32.686732 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:32.686696    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c04ca25_e153_4f97_89db_aba1b15106bb.slice/crio-7614c5e3dfbb456122388e0a348142a4cca86a23c6b2a6bba77ff4b6ea8b0d57 WatchSource:0}: Error finding container 7614c5e3dfbb456122388e0a348142a4cca86a23c6b2a6bba77ff4b6ea8b0d57: Status 404 returned error can't find the container with id 7614c5e3dfbb456122388e0a348142a4cca86a23c6b2a6bba77ff4b6ea8b0d57
Sep 15 11:25:32.690948 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:32.690922    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc08c447_fc8f_4246_b543_08c147ced784.slice/crio-dd39847f065d7b06e8ae2bd188ca54be378463e25978784e5232c60099747439 WatchSource:0}: Error finding container dd39847f065d7b06e8ae2bd188ca54be378463e25978784e5232c60099747439: Status 404 returned error can't find the container with id dd39847f065d7b06e8ae2bd188ca54be378463e25978784e5232c60099747439
Sep 15 11:25:32.692564 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:32.692536    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0b1e3c8_ac60_42b1_9454_b66ae2d969f3.slice/crio-babbe148aea3a0eedd92dde0c6fc48ba6d123348b80f0ebc584ceb2aab8b9e74 WatchSource:0}: Error finding container babbe148aea3a0eedd92dde0c6fc48ba6d123348b80f0ebc584ceb2aab8b9e74: Status 404 returned error can't find the container with id babbe148aea3a0eedd92dde0c6fc48ba6d123348b80f0ebc584ceb2aab8b9e74
Sep 15 11:25:32.693940 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:32.693916    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd39f711a_375d_4905_96a8_d11a45374133.slice/crio-a0ec1bd80f1a9cd14fb0d2ba402d2006b5b3c2cd39568b123cc2b8f715214785 WatchSource:0}: Error finding container a0ec1bd80f1a9cd14fb0d2ba402d2006b5b3c2cd39568b123cc2b8f715214785: Status 404 returned error can't find the container with id a0ec1bd80f1a9cd14fb0d2ba402d2006b5b3c2cd39568b123cc2b8f715214785
Sep 15 11:25:32.695717 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:32.695688    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2966eccf_c3c2_458b_a2a1_5a7e36112634.slice/crio-083f538294814b7aaedbcde4244b1afd12d7d66f828701f94dc07c5a70a61567 WatchSource:0}: Error finding container 083f538294814b7aaedbcde4244b1afd12d7d66f828701f94dc07c5a70a61567: Status 404 returned error can't find the container with id 083f538294814b7aaedbcde4244b1afd12d7d66f828701f94dc07c5a70a61567
Sep 15 11:25:32.697581 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:32.697072    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5e5dc64_36c8_49a9_b823_185c56534d6a.slice/crio-c02c4f3bdde59b088ff15978e58300092a774ea0b89a4f32abd63c4b9e9fa4d2 WatchSource:0}: Error finding container c02c4f3bdde59b088ff15978e58300092a774ea0b89a4f32abd63c4b9e9fa4d2: Status 404 returned error can't find the container with id c02c4f3bdde59b088ff15978e58300092a774ea0b89a4f32abd63c4b9e9fa4d2
Sep 15 11:25:32.698307 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:32.698143    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6145cbf4_342d_4e4d_a322_2fc77d67553a.slice/crio-d9cd622d6d6cef8b93ca71406aed4157bb117c320a6ba82e41ca9cd7c934847a WatchSource:0}: Error finding container d9cd622d6d6cef8b93ca71406aed4157bb117c320a6ba82e41ca9cd7c934847a: Status 404 returned error can't find the container with id d9cd622d6d6cef8b93ca71406aed4157bb117c320a6ba82e41ca9cd7c934847a
Sep 15 11:25:32.698606 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:32.698528    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod000e6b60_7f5f_4af5_9e06_31a6cd4d8ef4.slice/crio-6bd1f6d427c16e7177379fa787081989a787bcddbdcdc9246752f8deddefc364 WatchSource:0}: Error finding container 6bd1f6d427c16e7177379fa787081989a787bcddbdcdc9246752f8deddefc364: Status 404 returned error can't find the container with id 6bd1f6d427c16e7177379fa787081989a787bcddbdcdc9246752f8deddefc364
Sep 15 11:25:32.700102 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:32.699770    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35547786_abe3_420c_b9d8_036558749849.slice/crio-96bd312fe4e6132cede4c5aa3648232ab6f0458b42076087a96ff3840f8266c0 WatchSource:0}: Error finding container 96bd312fe4e6132cede4c5aa3648232ab6f0458b42076087a96ff3840f8266c0: Status 404 returned error can't find the container with id 96bd312fe4e6132cede4c5aa3648232ab6f0458b42076087a96ff3840f8266c0
Sep 15 11:25:32.997394 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.997264    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 11:20:31 +0000 UTC" deadline="2028-02-27 17:33:10.730825346 +0000 UTC"
Sep 15 11:25:32.997394 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:32.997323    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12726h7m37.733504546s"
Sep 15 11:25:33.087381 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:33.087344    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q96s9"
Sep 15 11:25:33.087571 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:33.087492    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q96s9" podUID="c0bac93c-2a52-439c-a4a6-d4d31424d653"
Sep 15 11:25:33.097423 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:33.097380    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q6x2d" event={"ID":"35547786-abe3-420c-b9d8-036558749849","Type":"ContainerStarted","Data":"96bd312fe4e6132cede4c5aa3648232ab6f0458b42076087a96ff3840f8266c0"}
Sep 15 11:25:33.099300 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:33.099260    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t82xl" event={"ID":"000e6b60-7f5f-4af5-9e06-31a6cd4d8ef4","Type":"ContainerStarted","Data":"6bd1f6d427c16e7177379fa787081989a787bcddbdcdc9246752f8deddefc364"}
Sep 15 11:25:33.101242 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:33.101054    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ttwvq" event={"ID":"c5e5dc64-36c8-49a9-b823-185c56534d6a","Type":"ContainerStarted","Data":"c02c4f3bdde59b088ff15978e58300092a774ea0b89a4f32abd63c4b9e9fa4d2"}
Sep 15 11:25:33.102805 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:33.102737    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4dmcz" event={"ID":"8c04ca25-e153-4f97-89db-aba1b15106bb","Type":"ContainerStarted","Data":"7614c5e3dfbb456122388e0a348142a4cca86a23c6b2a6bba77ff4b6ea8b0d57"}
Sep 15 11:25:33.105451 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:33.105412    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc" event={"ID":"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3","Type":"ContainerStarted","Data":"babbe148aea3a0eedd92dde0c6fc48ba6d123348b80f0ebc584ceb2aab8b9e74"}
Sep 15 11:25:33.107400 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:33.107361    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-26srz" event={"ID":"6145cbf4-342d-4e4d-a322-2fc77d67553a","Type":"ContainerStarted","Data":"d9cd622d6d6cef8b93ca71406aed4157bb117c320a6ba82e41ca9cd7c934847a"}
Sep 15 11:25:33.108854 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:33.108807    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5rpc8" event={"ID":"2966eccf-c3c2-458b-a2a1-5a7e36112634","Type":"ContainerStarted","Data":"083f538294814b7aaedbcde4244b1afd12d7d66f828701f94dc07c5a70a61567"}
Sep 15 11:25:33.110622 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:33.110591    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-88vmx" event={"ID":"d39f711a-375d-4905-96a8-d11a45374133","Type":"ContainerStarted","Data":"a0ec1bd80f1a9cd14fb0d2ba402d2006b5b3c2cd39568b123cc2b8f715214785"}
Sep 15 11:25:33.113378 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:33.113346    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6h7vw" event={"ID":"cc08c447-fc8f-4246-b543-08c147ced784","Type":"ContainerStarted","Data":"dd39847f065d7b06e8ae2bd188ca54be378463e25978784e5232c60099747439"}
Sep 15 11:25:33.116514 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:33.116208    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-240.ec2.internal" event={"ID":"87bfeb81dec9b16ad8c9fded8c51d913","Type":"ContainerStarted","Data":"4436c1efbbd912a9ad2e937352a66334fc62d3597e2f857dfc9e038751d13360"}
Sep 15 11:25:33.138114 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:33.138048    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-240.ec2.internal" podStartSLOduration=2.138025824 podStartE2EDuration="2.138025824s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:25:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:25:33.137840013 +0000 UTC m=+3.564170610" watchObservedRunningTime="2026-09-15 11:25:33.138025824 +0000 UTC m=+3.564356430"
Sep 15 11:25:33.579471 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:33.579428    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f55f467-8c61-4930-b097-6636d194db5d-metrics-certs\") pod \"network-metrics-daemon-k79mk\" (UID: \"8f55f467-8c61-4930-b097-6636d194db5d\") " pod="openshift-multus/network-metrics-daemon-k79mk"
Sep 15 11:25:33.579692 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:33.579582    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:25:33.579692 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:33.579646    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f55f467-8c61-4930-b097-6636d194db5d-metrics-certs podName:8f55f467-8c61-4930-b097-6636d194db5d nodeName:}" failed. No retries permitted until 2026-09-15 11:25:35.579627663 +0000 UTC m=+6.005958242 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f55f467-8c61-4930-b097-6636d194db5d-metrics-certs") pod "network-metrics-daemon-k79mk" (UID: "8f55f467-8c61-4930-b097-6636d194db5d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:25:33.681238 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:33.680749    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnpxj\" (UniqueName: \"kubernetes.io/projected/80feec19-977b-483e-a7a2-f9badf61b984-kube-api-access-vnpxj\") pod \"network-check-target-zpbfk\" (UID: \"80feec19-977b-483e-a7a2-f9badf61b984\") " pod="openshift-network-diagnostics/network-check-target-zpbfk"
Sep 15 11:25:33.681238 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:33.680851    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c0bac93c-2a52-439c-a4a6-d4d31424d653-original-pull-secret\") pod \"global-pull-secret-syncer-q96s9\" (UID: \"c0bac93c-2a52-439c-a4a6-d4d31424d653\") " pod="kube-system/global-pull-secret-syncer-q96s9"
Sep 15 11:25:33.681238 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:33.680973    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 11:25:33.681238 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:33.681034    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0bac93c-2a52-439c-a4a6-d4d31424d653-original-pull-secret podName:c0bac93c-2a52-439c-a4a6-d4d31424d653 nodeName:}" failed. No retries permitted until 2026-09-15 11:25:35.681016453 +0000 UTC m=+6.107347034 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c0bac93c-2a52-439c-a4a6-d4d31424d653-original-pull-secret") pod "global-pull-secret-syncer-q96s9" (UID: "c0bac93c-2a52-439c-a4a6-d4d31424d653") : object "kube-system"/"original-pull-secret" not registered
Sep 15 11:25:33.681613 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:33.681439    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 11:25:33.681613 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:33.681460    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 11:25:33.681613 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:33.681474    2575 projected.go:196] Error preparing data for projected volume kube-api-access-vnpxj for pod openshift-network-diagnostics/network-check-target-zpbfk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:25:33.681613 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:33.681516    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80feec19-977b-483e-a7a2-f9badf61b984-kube-api-access-vnpxj podName:80feec19-977b-483e-a7a2-f9badf61b984 nodeName:}" failed. No retries permitted until 2026-09-15 11:25:35.681504927 +0000 UTC m=+6.107835516 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vnpxj" (UniqueName: "kubernetes.io/projected/80feec19-977b-483e-a7a2-f9badf61b984-kube-api-access-vnpxj") pod "network-check-target-zpbfk" (UID: "80feec19-977b-483e-a7a2-f9badf61b984") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:25:33.997899 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:33.997732    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 11:20:31 +0000 UTC" deadline="2028-04-29 15:27:23.953924027 +0000 UTC"
Sep 15 11:25:33.997899 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:33.997778    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14212h1m49.956150903s"
Sep 15 11:25:34.088876 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:34.088070    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zpbfk"
Sep 15 11:25:34.088876 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:34.088199    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zpbfk" podUID="80feec19-977b-483e-a7a2-f9badf61b984"
Sep 15 11:25:34.088876 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:34.088714    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k79mk"
Sep 15 11:25:34.088876 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:34.088833    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k79mk" podUID="8f55f467-8c61-4930-b097-6636d194db5d"
Sep 15 11:25:35.088199 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:35.087675    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q96s9"
Sep 15 11:25:35.088199 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:35.087822    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q96s9" podUID="c0bac93c-2a52-439c-a4a6-d4d31424d653"
Sep 15 11:25:35.597664 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:35.597610    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f55f467-8c61-4930-b097-6636d194db5d-metrics-certs\") pod \"network-metrics-daemon-k79mk\" (UID: \"8f55f467-8c61-4930-b097-6636d194db5d\") " pod="openshift-multus/network-metrics-daemon-k79mk"
Sep 15 11:25:35.597875 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:35.597851    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:25:35.597936 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:35.597911    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f55f467-8c61-4930-b097-6636d194db5d-metrics-certs podName:8f55f467-8c61-4930-b097-6636d194db5d nodeName:}" failed. No retries permitted until 2026-09-15 11:25:39.597897999 +0000 UTC m=+10.024228573 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f55f467-8c61-4930-b097-6636d194db5d-metrics-certs") pod "network-metrics-daemon-k79mk" (UID: "8f55f467-8c61-4930-b097-6636d194db5d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:25:35.698821 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:35.698776    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c0bac93c-2a52-439c-a4a6-d4d31424d653-original-pull-secret\") pod \"global-pull-secret-syncer-q96s9\" (UID: \"c0bac93c-2a52-439c-a4a6-d4d31424d653\") " pod="kube-system/global-pull-secret-syncer-q96s9"
Sep 15 11:25:35.699021 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:35.698852    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnpxj\" (UniqueName: \"kubernetes.io/projected/80feec19-977b-483e-a7a2-f9badf61b984-kube-api-access-vnpxj\") pod \"network-check-target-zpbfk\" (UID: \"80feec19-977b-483e-a7a2-f9badf61b984\") " pod="openshift-network-diagnostics/network-check-target-zpbfk"
Sep 15 11:25:35.699157 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:35.699136    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 11:25:35.699227 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:35.699214    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0bac93c-2a52-439c-a4a6-d4d31424d653-original-pull-secret podName:c0bac93c-2a52-439c-a4a6-d4d31424d653 nodeName:}" failed. No retries permitted until 2026-09-15 11:25:39.699194109 +0000 UTC m=+10.125524686 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c0bac93c-2a52-439c-a4a6-d4d31424d653-original-pull-secret") pod "global-pull-secret-syncer-q96s9" (UID: "c0bac93c-2a52-439c-a4a6-d4d31424d653") : object "kube-system"/"original-pull-secret" not registered
Sep 15 11:25:35.699734 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:35.699583    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 11:25:35.699734 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:35.699618    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 11:25:35.699734 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:35.699634    2575 projected.go:196] Error preparing data for projected volume kube-api-access-vnpxj for pod openshift-network-diagnostics/network-check-target-zpbfk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:25:35.699734 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:35.699708    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80feec19-977b-483e-a7a2-f9badf61b984-kube-api-access-vnpxj podName:80feec19-977b-483e-a7a2-f9badf61b984 nodeName:}" failed. No retries permitted until 2026-09-15 11:25:39.699689501 +0000 UTC m=+10.126020079 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vnpxj" (UniqueName: "kubernetes.io/projected/80feec19-977b-483e-a7a2-f9badf61b984-kube-api-access-vnpxj") pod "network-check-target-zpbfk" (UID: "80feec19-977b-483e-a7a2-f9badf61b984") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:25:36.088687 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:36.088592    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k79mk"
Sep 15 11:25:36.089154 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:36.088720    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k79mk" podUID="8f55f467-8c61-4930-b097-6636d194db5d"
Sep 15 11:25:36.089154 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:36.088854    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zpbfk"
Sep 15 11:25:36.089154 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:36.088949    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zpbfk" podUID="80feec19-977b-483e-a7a2-f9badf61b984"
Sep 15 11:25:37.087691 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:37.087346    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q96s9"
Sep 15 11:25:37.087691 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:37.087473    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q96s9" podUID="c0bac93c-2a52-439c-a4a6-d4d31424d653"
Sep 15 11:25:38.088007 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:38.087862    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k79mk"
Sep 15 11:25:38.088007 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:38.087905    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zpbfk"
Sep 15 11:25:38.088579 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:38.088019    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k79mk" podUID="8f55f467-8c61-4930-b097-6636d194db5d"
Sep 15 11:25:38.088579 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:38.088154    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zpbfk" podUID="80feec19-977b-483e-a7a2-f9badf61b984"
Sep 15 11:25:39.087587 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:39.087548    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q96s9"
Sep 15 11:25:39.087782 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:39.087725    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q96s9" podUID="c0bac93c-2a52-439c-a4a6-d4d31424d653"
Sep 15 11:25:39.635730 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:39.635614    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f55f467-8c61-4930-b097-6636d194db5d-metrics-certs\") pod \"network-metrics-daemon-k79mk\" (UID: \"8f55f467-8c61-4930-b097-6636d194db5d\") " pod="openshift-multus/network-metrics-daemon-k79mk"
Sep 15 11:25:39.636266 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:39.635810    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:25:39.636266 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:39.635907    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f55f467-8c61-4930-b097-6636d194db5d-metrics-certs podName:8f55f467-8c61-4930-b097-6636d194db5d nodeName:}" failed. No retries permitted until 2026-09-15 11:25:47.635882346 +0000 UTC m=+18.062212928 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f55f467-8c61-4930-b097-6636d194db5d-metrics-certs") pod "network-metrics-daemon-k79mk" (UID: "8f55f467-8c61-4930-b097-6636d194db5d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:25:39.736753 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:39.736707    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnpxj\" (UniqueName: \"kubernetes.io/projected/80feec19-977b-483e-a7a2-f9badf61b984-kube-api-access-vnpxj\") pod \"network-check-target-zpbfk\" (UID: \"80feec19-977b-483e-a7a2-f9badf61b984\") " pod="openshift-network-diagnostics/network-check-target-zpbfk"
Sep 15 11:25:39.736924 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:39.736822    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c0bac93c-2a52-439c-a4a6-d4d31424d653-original-pull-secret\") pod \"global-pull-secret-syncer-q96s9\" (UID: \"c0bac93c-2a52-439c-a4a6-d4d31424d653\") " pod="kube-system/global-pull-secret-syncer-q96s9"
Sep 15 11:25:39.737000 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:39.736913    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 11:25:39.737000 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:39.736939    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 11:25:39.737000 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:39.736944    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 11:25:39.737000 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:39.736961    2575 projected.go:196] Error preparing data for projected volume kube-api-access-vnpxj for pod openshift-network-diagnostics/network-check-target-zpbfk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:25:39.737187 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:39.737007    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0bac93c-2a52-439c-a4a6-d4d31424d653-original-pull-secret podName:c0bac93c-2a52-439c-a4a6-d4d31424d653 nodeName:}" failed. No retries permitted until 2026-09-15 11:25:47.736986512 +0000 UTC m=+18.163317091 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c0bac93c-2a52-439c-a4a6-d4d31424d653-original-pull-secret") pod "global-pull-secret-syncer-q96s9" (UID: "c0bac93c-2a52-439c-a4a6-d4d31424d653") : object "kube-system"/"original-pull-secret" not registered
Sep 15 11:25:39.737187 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:39.737028    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80feec19-977b-483e-a7a2-f9badf61b984-kube-api-access-vnpxj podName:80feec19-977b-483e-a7a2-f9badf61b984 nodeName:}" failed. No retries permitted until 2026-09-15 11:25:47.737017109 +0000 UTC m=+18.163347682 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vnpxj" (UniqueName: "kubernetes.io/projected/80feec19-977b-483e-a7a2-f9badf61b984-kube-api-access-vnpxj") pod "network-check-target-zpbfk" (UID: "80feec19-977b-483e-a7a2-f9badf61b984") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:25:40.089472 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:40.088681    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k79mk"
Sep 15 11:25:40.089472 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:40.088819    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k79mk" podUID="8f55f467-8c61-4930-b097-6636d194db5d"
Sep 15 11:25:40.089472 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:40.089269    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zpbfk"
Sep 15 11:25:40.089472 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:40.089364    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zpbfk" podUID="80feec19-977b-483e-a7a2-f9badf61b984"
Sep 15 11:25:41.087081 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:41.087029    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q96s9"
Sep 15 11:25:41.087599 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:41.087188    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q96s9" podUID="c0bac93c-2a52-439c-a4a6-d4d31424d653"
Sep 15 11:25:42.087461 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:42.087423    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k79mk"
Sep 15 11:25:42.087917 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:42.087477    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zpbfk"
Sep 15 11:25:42.087917 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:42.087568    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k79mk" podUID="8f55f467-8c61-4930-b097-6636d194db5d"
Sep 15 11:25:42.087917 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:42.087717    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zpbfk" podUID="80feec19-977b-483e-a7a2-f9badf61b984"
Sep 15 11:25:43.087666 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:43.087616    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q96s9"
Sep 15 11:25:43.088083 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:43.087764    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q96s9" podUID="c0bac93c-2a52-439c-a4a6-d4d31424d653"
Sep 15 11:25:44.087685 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:44.087635    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zpbfk"
Sep 15 11:25:44.088168 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:44.087641    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k79mk"
Sep 15 11:25:44.088168 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:44.087778    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zpbfk" podUID="80feec19-977b-483e-a7a2-f9badf61b984"
Sep 15 11:25:44.088168 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:44.087876    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k79mk" podUID="8f55f467-8c61-4930-b097-6636d194db5d"
Sep 15 11:25:45.087634 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:45.087591    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q96s9"
Sep 15 11:25:45.087816 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:45.087755    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q96s9" podUID="c0bac93c-2a52-439c-a4a6-d4d31424d653"
Sep 15 11:25:46.087190 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:46.087159    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k79mk"
Sep 15 11:25:46.087355 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:46.087168    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zpbfk"
Sep 15 11:25:46.087355 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:46.087301    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k79mk" podUID="8f55f467-8c61-4930-b097-6636d194db5d"
Sep 15 11:25:46.087483 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:46.087355    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zpbfk" podUID="80feec19-977b-483e-a7a2-f9badf61b984"
Sep 15 11:25:47.087306 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:47.087269    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q96s9"
Sep 15 11:25:47.087856 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:47.087390    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q96s9" podUID="c0bac93c-2a52-439c-a4a6-d4d31424d653"
Sep 15 11:25:47.699561 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:47.699523    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f55f467-8c61-4930-b097-6636d194db5d-metrics-certs\") pod \"network-metrics-daemon-k79mk\" (UID: \"8f55f467-8c61-4930-b097-6636d194db5d\") " pod="openshift-multus/network-metrics-daemon-k79mk"
Sep 15 11:25:47.699780 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:47.699709    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:25:47.699852 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:47.699792    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f55f467-8c61-4930-b097-6636d194db5d-metrics-certs podName:8f55f467-8c61-4930-b097-6636d194db5d nodeName:}" failed. No retries permitted until 2026-09-15 11:26:03.699770203 +0000 UTC m=+34.126100789 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f55f467-8c61-4930-b097-6636d194db5d-metrics-certs") pod "network-metrics-daemon-k79mk" (UID: "8f55f467-8c61-4930-b097-6636d194db5d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:25:47.800607 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:47.800560    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnpxj\" (UniqueName: \"kubernetes.io/projected/80feec19-977b-483e-a7a2-f9badf61b984-kube-api-access-vnpxj\") pod \"network-check-target-zpbfk\" (UID: \"80feec19-977b-483e-a7a2-f9badf61b984\") " pod="openshift-network-diagnostics/network-check-target-zpbfk"
Sep 15 11:25:47.800820 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:47.800682    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c0bac93c-2a52-439c-a4a6-d4d31424d653-original-pull-secret\") pod \"global-pull-secret-syncer-q96s9\" (UID: \"c0bac93c-2a52-439c-a4a6-d4d31424d653\") " pod="kube-system/global-pull-secret-syncer-q96s9"
Sep 15 11:25:47.800820 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:47.800718    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 11:25:47.800820 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:47.800745    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 11:25:47.800820 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:47.800760    2575 projected.go:196] Error preparing data for projected volume kube-api-access-vnpxj for pod openshift-network-diagnostics/network-check-target-zpbfk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:25:47.800820 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:47.800794    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 11:25:47.801015 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:47.800829    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80feec19-977b-483e-a7a2-f9badf61b984-kube-api-access-vnpxj podName:80feec19-977b-483e-a7a2-f9badf61b984 nodeName:}" failed. No retries permitted until 2026-09-15 11:26:03.800810044 +0000 UTC m=+34.227140625 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vnpxj" (UniqueName: "kubernetes.io/projected/80feec19-977b-483e-a7a2-f9badf61b984-kube-api-access-vnpxj") pod "network-check-target-zpbfk" (UID: "80feec19-977b-483e-a7a2-f9badf61b984") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:25:47.801015 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:47.800849    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0bac93c-2a52-439c-a4a6-d4d31424d653-original-pull-secret podName:c0bac93c-2a52-439c-a4a6-d4d31424d653 nodeName:}" failed. No retries permitted until 2026-09-15 11:26:03.80084041 +0000 UTC m=+34.227170984 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c0bac93c-2a52-439c-a4a6-d4d31424d653-original-pull-secret") pod "global-pull-secret-syncer-q96s9" (UID: "c0bac93c-2a52-439c-a4a6-d4d31424d653") : object "kube-system"/"original-pull-secret" not registered
Sep 15 11:25:48.087855 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:48.087758    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k79mk"
Sep 15 11:25:48.087855 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:48.087813    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zpbfk"
Sep 15 11:25:48.088356 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:48.087932    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k79mk" podUID="8f55f467-8c61-4930-b097-6636d194db5d"
Sep 15 11:25:48.088356 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:48.088027    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zpbfk" podUID="80feec19-977b-483e-a7a2-f9badf61b984"
Sep 15 11:25:49.087203 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:49.087160    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q96s9"
Sep 15 11:25:49.087416 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:49.087282    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q96s9" podUID="c0bac93c-2a52-439c-a4a6-d4d31424d653"
Sep 15 11:25:49.918513 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:25:49.918462    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f566853e3e8fb004fd376160386ffbe.slice/crio-da04780878690535398b49dea7bf2a2cd4d90b0ac3171e99388a912da9154f4b WatchSource:0}: Error finding container da04780878690535398b49dea7bf2a2cd4d90b0ac3171e99388a912da9154f4b: Status 404 returned error can't find the container with id da04780878690535398b49dea7bf2a2cd4d90b0ac3171e99388a912da9154f4b
Sep 15 11:25:50.088605 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:50.088411    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k79mk"
Sep 15 11:25:50.088781 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:50.088493    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zpbfk"
Sep 15 11:25:50.088781 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:50.088704    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k79mk" podUID="8f55f467-8c61-4930-b097-6636d194db5d"
Sep 15 11:25:50.088781 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:50.088760    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zpbfk" podUID="80feec19-977b-483e-a7a2-f9badf61b984"
Sep 15 11:25:50.155522 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:50.155487    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc" event={"ID":"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3","Type":"ContainerStarted","Data":"f028a72cea3af9cbbd9581266a6e2f1eb8e120e4a25dc486bc28737217b89ac4"}
Sep 15 11:25:50.157083 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:50.157055    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-88vmx" event={"ID":"d39f711a-375d-4905-96a8-d11a45374133","Type":"ContainerStarted","Data":"83531be5a546b82c9e76fd5075a486b09380751bc462651a915dc7c35b5e7d82"}
Sep 15 11:25:50.158189 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:50.158166    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-240.ec2.internal" event={"ID":"8f566853e3e8fb004fd376160386ffbe","Type":"ContainerStarted","Data":"da04780878690535398b49dea7bf2a2cd4d90b0ac3171e99388a912da9154f4b"}
Sep 15 11:25:50.172072 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:50.171949    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-88vmx" podStartSLOduration=2.953137339 podStartE2EDuration="20.171934446s" totalImagesPullingTime="17.218797107s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:25:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:25:50.171789397 +0000 UTC m=+20.598120006" watchObservedRunningTime="2026-09-15 11:25:50.171934446 +0000 UTC m=+20.598265042"
Sep 15 11:25:51.087516 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:51.087229    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q96s9"
Sep 15 11:25:51.088398 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:51.087644    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q96s9" podUID="c0bac93c-2a52-439c-a4a6-d4d31424d653"
Sep 15 11:25:51.163090 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:51.163051    2575 generic.go:356] "Generic (PLEG): container finished" podID="35547786-abe3-420c-b9d8-036558749849" containerID="09e3f9ca1055ba6a464693b2c91d6a1f920f877399e076273aa8dba91229c3ce" exitCode=0
Sep 15 11:25:51.163279 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:51.163193    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q6x2d" event={"ID":"35547786-abe3-420c-b9d8-036558749849","Type":"ContainerDied","Data":"09e3f9ca1055ba6a464693b2c91d6a1f920f877399e076273aa8dba91229c3ce"}
Sep 15 11:25:51.165799 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:51.165341    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t82xl" event={"ID":"000e6b60-7f5f-4af5-9e06-31a6cd4d8ef4","Type":"ContainerStarted","Data":"b2da74ec56912eccfdb66380fe316a0f9f9098c1a46b9a291092d45658f2bbed"}
Sep 15 11:25:51.167380 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:51.167350    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ttwvq" event={"ID":"c5e5dc64-36c8-49a9-b823-185c56534d6a","Type":"ContainerStarted","Data":"3c49728bdac9429f78d92076db4a228361e79f703f89ea541403e6e9cc7d535f"}
Sep 15 11:25:51.169519 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:51.169454    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4dmcz" event={"ID":"8c04ca25-e153-4f97-89db-aba1b15106bb","Type":"ContainerStarted","Data":"e05e5e24a6f85d3353c65942f518b593009892b12713e21d8870f3a5fb2bc1cc"}
Sep 15 11:25:51.171692 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:51.171666    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc" event={"ID":"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3","Type":"ContainerStarted","Data":"5e08bc41c680043ab3a9504b8bceb580ea2a9c7156054c859697e3c92e5fdfd5"}
Sep 15 11:25:51.173759 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:51.173687    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-26srz" event={"ID":"6145cbf4-342d-4e4d-a322-2fc77d67553a","Type":"ContainerStarted","Data":"d333defda7037f193bb920197562208b4b719071abc087eafdeda189cda690a0"}
Sep 15 11:25:51.175304 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:51.175276    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6h7vw" event={"ID":"cc08c447-fc8f-4246-b543-08c147ced784","Type":"ContainerStarted","Data":"d21f28dc720d5a24d52c57d02629f5175fbe24fb47eb76ef3e8bba1926568221"}
Sep 15 11:25:51.199143 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:51.199090    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-26srz" podStartSLOduration=11.728313353 podStartE2EDuration="21.199067594s" totalImagesPullingTime="9.470754241s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:25:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:25:51.198546931 +0000 UTC m=+21.624877528" watchObservedRunningTime="2026-09-15 11:25:51.199067594 +0000 UTC m=+21.625398190"
Sep 15 11:25:51.212053 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:51.211995    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ttwvq" podStartSLOduration=14.956536087 podStartE2EDuration="21.211976172s" totalImagesPullingTime="6.255440085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:25:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:25:51.211956789 +0000 UTC m=+21.638287385" watchObservedRunningTime="2026-09-15 11:25:51.211976172 +0000 UTC m=+21.638306766"
Sep 15 11:25:51.230227 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:51.230179    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4dmcz" podStartSLOduration=3.839327325 podStartE2EDuration="21.230158463s" totalImagesPullingTime="17.390831138s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:25:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:25:51.230003276 +0000 UTC m=+21.656333872" watchObservedRunningTime="2026-09-15 11:25:51.230158463 +0000 UTC m=+21.656489061"
Sep 15 11:25:51.245424 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:51.245365    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-t82xl" podStartSLOduration=4.029381953 podStartE2EDuration="21.245343246s" totalImagesPullingTime="17.215961293s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:25:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:25:51.244571579 +0000 UTC m=+21.670902174" watchObservedRunningTime="2026-09-15 11:25:51.245343246 +0000 UTC m=+21.671673951"
Sep 15 11:25:52.050859 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:52.050598    2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 15 11:25:52.087216 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:52.087190    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zpbfk"
Sep 15 11:25:52.087365 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:52.087335    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zpbfk" podUID="80feec19-977b-483e-a7a2-f9badf61b984"
Sep 15 11:25:52.087624 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:52.087190    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k79mk"
Sep 15 11:25:52.087624 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:52.087587    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k79mk" podUID="8f55f467-8c61-4930-b097-6636d194db5d"
Sep 15 11:25:52.180372 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:52.180337    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc" event={"ID":"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3","Type":"ContainerStarted","Data":"5a95a6e7cbe424b719ec83351fd5d39f6a7c99af1b8ec36004dcabd0ce8cf6df"}
Sep 15 11:25:52.180546 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:52.180453    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc" event={"ID":"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3","Type":"ContainerStarted","Data":"68c39a58c3f546bef7f1a1f108edff7f52cb16e3a1d4ac556b61d4f03eac5edf"}
Sep 15 11:25:52.180546 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:52.180487    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc" event={"ID":"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3","Type":"ContainerStarted","Data":"e040ce8de84d65b69111e5ec85cc8b4b22416cbe9a1c3940f4211aebf0bbf79c"}
Sep 15 11:25:52.181782 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:52.181746    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5rpc8" event={"ID":"2966eccf-c3c2-458b-a2a1-5a7e36112634","Type":"ContainerStarted","Data":"03850f8ca2c088119f07bd82c431b5782cce150a418c508aa58cc018a0c9e70a"}
Sep 15 11:25:52.183580 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:52.183550    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6h7vw" event={"ID":"cc08c447-fc8f-4246-b543-08c147ced784","Type":"ContainerStarted","Data":"fe158c816ac462c0e88780c2cdf7465a71c16245a17f33b7dc958ba0e88ac5aa"}
Sep 15 11:25:52.185173 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:52.185148    2575 generic.go:356] "Generic (PLEG): container finished" podID="8f566853e3e8fb004fd376160386ffbe" containerID="2482c55365832fc7b30b8752bc4ad258f44a9c1a4bfedad6c10fa9700b566ac7" exitCode=0
Sep 15 11:25:52.185470 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:52.185398    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-240.ec2.internal" event={"ID":"8f566853e3e8fb004fd376160386ffbe","Type":"ContainerDied","Data":"2482c55365832fc7b30b8752bc4ad258f44a9c1a4bfedad6c10fa9700b566ac7"}
Sep 15 11:25:52.196237 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:52.196174    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5rpc8" podStartSLOduration=4.978034919 podStartE2EDuration="22.196152327s" totalImagesPullingTime="17.218117408s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:25:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:25:52.195906809 +0000 UTC m=+22.622237405" watchObservedRunningTime="2026-09-15 11:25:52.196152327 +0000 UTC m=+22.622482950"
Sep 15 11:25:53.031166 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:53.031032    2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-15T11:25:52.050850361Z","UUID":"729af709-f6ec-47ee-9b2c-74384b2aae62","Handler":null,"Name":"","Endpoint":""}
Sep 15 11:25:53.033094 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:53.033068    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 15 11:25:53.033236 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:53.033111    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 15 11:25:53.087686 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:53.087632    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q96s9"
Sep 15 11:25:53.088144 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:53.087790    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q96s9" podUID="c0bac93c-2a52-439c-a4a6-d4d31424d653"
Sep 15 11:25:53.187719 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:53.187681    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ttwvq"
Sep 15 11:25:53.188405 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:53.188381    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ttwvq"
Sep 15 11:25:53.192168 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:53.192135    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc" event={"ID":"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3","Type":"ContainerStarted","Data":"d3ff1d37396a55248d843330334511582820d85f0a589cc819e31ae22ee44175"}
Sep 15 11:25:53.194821 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:53.194784    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6h7vw" event={"ID":"cc08c447-fc8f-4246-b543-08c147ced784","Type":"ContainerStarted","Data":"fed8e1df5d1ea112b06f35db4c78451a994cf60a6b398af72315e8c7b4250e48"}
Sep 15 11:25:53.196789 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:53.196760    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-240.ec2.internal" event={"ID":"8f566853e3e8fb004fd376160386ffbe","Type":"ContainerStarted","Data":"8c940d6631b40c8c677b944c7e77dff91fb6fcf3b88b2e8da0e2de761e484696"}
Sep 15 11:25:53.197211 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:53.197181    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ttwvq"
Sep 15 11:25:53.197522 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:53.197499    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ttwvq"
Sep 15 11:25:53.219116 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:53.219046    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6h7vw" podStartSLOduration=3.801269869 podStartE2EDuration="23.219020815s" totalImagesPullingTime="19.417750946s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:25:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:25:53.218375699 +0000 UTC m=+23.644706294" watchObservedRunningTime="2026-09-15 11:25:53.219020815 +0000 UTC m=+23.645351415"
Sep 15 11:25:53.246235 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:53.246183    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-240.ec2.internal" podStartSLOduration=22.246166916 podStartE2EDuration="22.246166916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:25:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:25:53.245462107 +0000 UTC m=+23.671792702" watchObservedRunningTime="2026-09-15 11:25:53.246166916 +0000 UTC m=+23.672497512"
Sep 15 11:25:54.087550 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:54.087502    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k79mk"
Sep 15 11:25:54.087727 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:54.087502    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zpbfk"
Sep 15 11:25:54.087727 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:54.087672    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k79mk" podUID="8f55f467-8c61-4930-b097-6636d194db5d"
Sep 15 11:25:54.087727 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:54.087700    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zpbfk" podUID="80feec19-977b-483e-a7a2-f9badf61b984"
Sep 15 11:25:55.088018 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:55.087977    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q96s9"
Sep 15 11:25:55.088438 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:55.088107    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q96s9" podUID="c0bac93c-2a52-439c-a4a6-d4d31424d653"
Sep 15 11:25:56.087147 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:56.087117    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k79mk"
Sep 15 11:25:56.087266 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:56.087153    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zpbfk"
Sep 15 11:25:56.087329 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:56.087278    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k79mk" podUID="8f55f467-8c61-4930-b097-6636d194db5d"
Sep 15 11:25:56.087408 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:56.087390    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zpbfk" podUID="80feec19-977b-483e-a7a2-f9badf61b984"
Sep 15 11:25:56.206723 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:56.206686    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc" event={"ID":"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3","Type":"ContainerStarted","Data":"548fc7a9d2a3a6359bcc71da87891dcce5ea1d4178f590a45714e1115574f348"}
Sep 15 11:25:56.208538 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:56.208505    2575 generic.go:356] "Generic (PLEG): container finished" podID="35547786-abe3-420c-b9d8-036558749849" containerID="c10301d6dae72d6cd1fec86b45e7663477f3019c25ffca89bd3cc5ca02bf3605" exitCode=0
Sep 15 11:25:56.208691 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:56.208554    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q6x2d" event={"ID":"35547786-abe3-420c-b9d8-036558749849","Type":"ContainerDied","Data":"c10301d6dae72d6cd1fec86b45e7663477f3019c25ffca89bd3cc5ca02bf3605"}
Sep 15 11:25:57.087445 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:57.087410    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q96s9"
Sep 15 11:25:57.087640 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:57.087519    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q96s9" podUID="c0bac93c-2a52-439c-a4a6-d4d31424d653"
Sep 15 11:25:57.216279 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:57.216243    2575 generic.go:356] "Generic (PLEG): container finished" podID="35547786-abe3-420c-b9d8-036558749849" containerID="488f841b69c433a1648294927eace663ecb026aba6c3a1062f907f2ded475579" exitCode=0
Sep 15 11:25:57.216694 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:57.216288    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q6x2d" event={"ID":"35547786-abe3-420c-b9d8-036558749849","Type":"ContainerDied","Data":"488f841b69c433a1648294927eace663ecb026aba6c3a1062f907f2ded475579"}
Sep 15 11:25:58.087798 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:58.087526    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zpbfk"
Sep 15 11:25:58.088025 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:58.087586    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k79mk"
Sep 15 11:25:58.088025 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:58.087891    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zpbfk" podUID="80feec19-977b-483e-a7a2-f9badf61b984"
Sep 15 11:25:58.088025 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:58.087957    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k79mk" podUID="8f55f467-8c61-4930-b097-6636d194db5d"
Sep 15 11:25:58.222042 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:58.222000    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc" event={"ID":"a0b1e3c8-ac60-42b1-9454-b66ae2d969f3","Type":"ContainerStarted","Data":"3275a5c916974b7638d23f62c6c1bda7f71fb66c5c85e29be5aea89516d4e23b"}
Sep 15 11:25:58.222892 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:58.222253    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:58.222892 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:58.222322    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:58.225164 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:58.225129    2575 generic.go:356] "Generic (PLEG): container finished" podID="35547786-abe3-420c-b9d8-036558749849" containerID="eaebc5904cfb955af8259c149d07e8b9bc6b32085c41206f268b0d19ef088e1d" exitCode=0
Sep 15 11:25:58.225313 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:58.225183    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q6x2d" event={"ID":"35547786-abe3-420c-b9d8-036558749849","Type":"ContainerDied","Data":"eaebc5904cfb955af8259c149d07e8b9bc6b32085c41206f268b0d19ef088e1d"}
Sep 15 11:25:58.238932 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:58.238902    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:58.239078 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:58.239008    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:58.248073 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:58.248018    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc" podStartSLOduration=9.331240815 podStartE2EDuration="28.248001351s" totalImagesPullingTime="18.916760536s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:25:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:25:58.246544921 +0000 UTC m=+28.672875518" watchObservedRunningTime="2026-09-15 11:25:58.248001351 +0000 UTC m=+28.674331966"
Sep 15 11:25:58.580601 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:58.580566    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:25:59.087583 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:25:59.087550    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q96s9"
Sep 15 11:25:59.087782 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:25:59.087692    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q96s9" podUID="c0bac93c-2a52-439c-a4a6-d4d31424d653"
Sep 15 11:26:00.088342 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:00.088305    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k79mk"
Sep 15 11:26:00.088939 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:26:00.088410    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k79mk" podUID="8f55f467-8c61-4930-b097-6636d194db5d"
Sep 15 11:26:00.088939 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:00.088458    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zpbfk"
Sep 15 11:26:00.088939 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:26:00.088540    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zpbfk" podUID="80feec19-977b-483e-a7a2-f9badf61b984"
Sep 15 11:26:01.087665 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:01.087611    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q96s9"
Sep 15 11:26:01.087829 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:26:01.087767    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q96s9" podUID="c0bac93c-2a52-439c-a4a6-d4d31424d653"
Sep 15 11:26:02.088086 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:02.088054    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k79mk"
Sep 15 11:26:02.088592 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:02.088054    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zpbfk"
Sep 15 11:26:02.088592 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:26:02.088200    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k79mk" podUID="8f55f467-8c61-4930-b097-6636d194db5d"
Sep 15 11:26:02.088592 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:26:02.088269    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zpbfk" podUID="80feec19-977b-483e-a7a2-f9badf61b984"
Sep 15 11:26:03.087859 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:03.087816    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q96s9"
Sep 15 11:26:03.088233 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:26:03.087965    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q96s9" podUID="c0bac93c-2a52-439c-a4a6-d4d31424d653"
Sep 15 11:26:03.723699 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:03.723639    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f55f467-8c61-4930-b097-6636d194db5d-metrics-certs\") pod \"network-metrics-daemon-k79mk\" (UID: \"8f55f467-8c61-4930-b097-6636d194db5d\") " pod="openshift-multus/network-metrics-daemon-k79mk"
Sep 15 11:26:03.723971 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:26:03.723794    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:26:03.723971 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:26:03.723861    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f55f467-8c61-4930-b097-6636d194db5d-metrics-certs podName:8f55f467-8c61-4930-b097-6636d194db5d nodeName:}" failed. No retries permitted until 2026-09-15 11:26:35.723844807 +0000 UTC m=+66.150175380 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f55f467-8c61-4930-b097-6636d194db5d-metrics-certs") pod "network-metrics-daemon-k79mk" (UID: "8f55f467-8c61-4930-b097-6636d194db5d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:26:03.824553 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:03.824508    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c0bac93c-2a52-439c-a4a6-d4d31424d653-original-pull-secret\") pod \"global-pull-secret-syncer-q96s9\" (UID: \"c0bac93c-2a52-439c-a4a6-d4d31424d653\") " pod="kube-system/global-pull-secret-syncer-q96s9"
Sep 15 11:26:03.824771 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:03.824561    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnpxj\" (UniqueName: \"kubernetes.io/projected/80feec19-977b-483e-a7a2-f9badf61b984-kube-api-access-vnpxj\") pod \"network-check-target-zpbfk\" (UID: \"80feec19-977b-483e-a7a2-f9badf61b984\") " pod="openshift-network-diagnostics/network-check-target-zpbfk"
Sep 15 11:26:03.824771 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:26:03.824681    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 11:26:03.824771 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:26:03.824697    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 11:26:03.824771 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:26:03.824716    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 11:26:03.824771 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:26:03.824729    2575 projected.go:196] Error preparing data for projected volume kube-api-access-vnpxj for pod openshift-network-diagnostics/network-check-target-zpbfk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:26:03.824771 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:26:03.824755    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0bac93c-2a52-439c-a4a6-d4d31424d653-original-pull-secret podName:c0bac93c-2a52-439c-a4a6-d4d31424d653 nodeName:}" failed. No retries permitted until 2026-09-15 11:26:35.824740172 +0000 UTC m=+66.251070746 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c0bac93c-2a52-439c-a4a6-d4d31424d653-original-pull-secret") pod "global-pull-secret-syncer-q96s9" (UID: "c0bac93c-2a52-439c-a4a6-d4d31424d653") : object "kube-system"/"original-pull-secret" not registered
Sep 15 11:26:03.824985 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:26:03.824778    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80feec19-977b-483e-a7a2-f9badf61b984-kube-api-access-vnpxj podName:80feec19-977b-483e-a7a2-f9badf61b984 nodeName:}" failed. No retries permitted until 2026-09-15 11:26:35.824762749 +0000 UTC m=+66.251093324 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vnpxj" (UniqueName: "kubernetes.io/projected/80feec19-977b-483e-a7a2-f9badf61b984-kube-api-access-vnpxj") pod "network-check-target-zpbfk" (UID: "80feec19-977b-483e-a7a2-f9badf61b984") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:26:04.087564 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:04.087525    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zpbfk"
Sep 15 11:26:04.087738 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:04.087574    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k79mk"
Sep 15 11:26:04.087738 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:26:04.087709    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zpbfk" podUID="80feec19-977b-483e-a7a2-f9badf61b984"
Sep 15 11:26:04.087816 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:26:04.087769    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k79mk" podUID="8f55f467-8c61-4930-b097-6636d194db5d"
Sep 15 11:26:04.242856 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:04.242817    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q6x2d" event={"ID":"35547786-abe3-420c-b9d8-036558749849","Type":"ContainerStarted","Data":"51314c1fa2a5604b62aa0d34a7d746415863be651afedc75e5e6b49464c5e550"}
Sep 15 11:26:05.087518 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:05.087478    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q96s9"
Sep 15 11:26:05.087725 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:26:05.087586    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q96s9" podUID="c0bac93c-2a52-439c-a4a6-d4d31424d653"
Sep 15 11:26:05.248089 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:05.247801    2575 generic.go:356] "Generic (PLEG): container finished" podID="35547786-abe3-420c-b9d8-036558749849" containerID="51314c1fa2a5604b62aa0d34a7d746415863be651afedc75e5e6b49464c5e550" exitCode=0
Sep 15 11:26:05.248089 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:05.247883    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q6x2d" event={"ID":"35547786-abe3-420c-b9d8-036558749849","Type":"ContainerDied","Data":"51314c1fa2a5604b62aa0d34a7d746415863be651afedc75e5e6b49464c5e550"}
Sep 15 11:26:06.087525 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:06.087481    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k79mk"
Sep 15 11:26:06.087765 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:06.087534    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zpbfk"
Sep 15 11:26:06.087765 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:26:06.087646    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k79mk" podUID="8f55f467-8c61-4930-b097-6636d194db5d"
Sep 15 11:26:06.087765 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:26:06.087744    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zpbfk" podUID="80feec19-977b-483e-a7a2-f9badf61b984"
Sep 15 11:26:06.253996 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:06.253960    2575 generic.go:356] "Generic (PLEG): container finished" podID="35547786-abe3-420c-b9d8-036558749849" containerID="608ab67b876ce55da51b1cfd0af573865eb24d382169b8676d15678c25834467" exitCode=0
Sep 15 11:26:06.253996 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:06.254005    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q6x2d" event={"ID":"35547786-abe3-420c-b9d8-036558749849","Type":"ContainerDied","Data":"608ab67b876ce55da51b1cfd0af573865eb24d382169b8676d15678c25834467"}
Sep 15 11:26:07.087505 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:07.087463    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q96s9"
Sep 15 11:26:07.087811 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:26:07.087609    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q96s9" podUID="c0bac93c-2a52-439c-a4a6-d4d31424d653"
Sep 15 11:26:07.260025 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:07.259987    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q6x2d" event={"ID":"35547786-abe3-420c-b9d8-036558749849","Type":"ContainerStarted","Data":"6ba915f94f690c8405d7e6c2fbb64751213a7eb7514a375adaf145c26ca058c2"}
Sep 15 11:26:07.281903 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:07.281849    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-q6x2d" podStartSLOduration=15.881720521 podStartE2EDuration="37.281830815s" totalImagesPullingTime="21.400110294s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:25:30 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:07.28092921 +0000 UTC m=+37.707259805" watchObservedRunningTime="2026-09-15 11:26:07.281830815 +0000 UTC m=+37.708161411"
Sep 15 11:26:08.034532 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:08.034498    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q96s9"]
Sep 15 11:26:08.034743 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:08.034622    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q96s9"
Sep 15 11:26:08.034830 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:26:08.034751    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q96s9" podUID="c0bac93c-2a52-439c-a4a6-d4d31424d653"
Sep 15 11:26:08.036707 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:08.036673    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k79mk"]
Sep 15 11:26:08.036863 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:08.036835    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k79mk"
Sep 15 11:26:08.036982 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:26:08.036960    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k79mk" podUID="8f55f467-8c61-4930-b097-6636d194db5d"
Sep 15 11:26:08.037379 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:08.037357    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zpbfk"]
Sep 15 11:26:08.037474 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:08.037435    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zpbfk"
Sep 15 11:26:08.037577 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:26:08.037535    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zpbfk" podUID="80feec19-977b-483e-a7a2-f9badf61b984"
Sep 15 11:26:10.090933 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:10.090903    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k79mk"
Sep 15 11:26:10.091368 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:10.091002    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zpbfk"
Sep 15 11:26:10.091368 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:26:10.091009    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k79mk" podUID="8f55f467-8c61-4930-b097-6636d194db5d"
Sep 15 11:26:10.091368 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:10.091027    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q96s9"
Sep 15 11:26:10.091368 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:26:10.091093    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zpbfk" podUID="80feec19-977b-483e-a7a2-f9badf61b984"
Sep 15 11:26:10.091368 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:26:10.091163    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q96s9" podUID="c0bac93c-2a52-439c-a4a6-d4d31424d653"
Sep 15 11:26:11.803624 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:11.803440    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-240.ec2.internal" event="NodeReady"
Sep 15 11:26:11.804033 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:11.803740    2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 15 11:26:11.850099 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:11.850062    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-m847l"]
Sep 15 11:26:11.872595 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:11.872560    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-26xwb"]
Sep 15 11:26:11.872785 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:11.872722    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m847l"
Sep 15 11:26:11.877171 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:11.877139    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-55wz6\""
Sep 15 11:26:11.877329 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:11.877232    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 15 11:26:11.878180 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:11.878155    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 15 11:26:11.888672 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:11.888627    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-m847l"]
Sep 15 11:26:11.888779 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:11.888761    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-26xwb"
Sep 15 11:26:11.888779 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:11.888776    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-26xwb"]
Sep 15 11:26:11.891690 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:11.891644    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fh4vk\""
Sep 15 11:26:11.891873 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:11.891721    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 15 11:26:11.891873 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:11.891726    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 15 11:26:11.891873 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:11.891715    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 15 11:26:11.957041 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:11.956959    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mzz6r"]
Sep 15 11:26:11.980763 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:11.980724    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mzz6r"]
Sep 15 11:26:11.980939 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:11.980826    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mzz6r"
Sep 15 11:26:11.983312 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:11.983282    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c39f60d8-e16b-4c73-bacf-a5702c57c76e-config-volume\") pod \"dns-default-m847l\" (UID: \"c39f60d8-e16b-4c73-bacf-a5702c57c76e\") " pod="openshift-dns/dns-default-m847l"
Sep 15 11:26:11.983312 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:11.983269    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 15 11:26:11.983312 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:11.983324    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c39f60d8-e16b-4c73-bacf-a5702c57c76e-tmp-dir\") pod \"dns-default-m847l\" (UID: \"c39f60d8-e16b-4c73-bacf-a5702c57c76e\") " pod="openshift-dns/dns-default-m847l"
Sep 15 11:26:11.983588 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:11.983357    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 15 11:26:11.983588 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:11.983418    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/329235b6-5a87-40ce-a572-98c3f16101d5-cert\") pod \"ingress-canary-26xwb\" (UID: \"329235b6-5a87-40ce-a572-98c3f16101d5\") " pod="openshift-ingress-canary/ingress-canary-26xwb"
Sep 15 11:26:11.983588 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:11.983445    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c39f60d8-e16b-4c73-bacf-a5702c57c76e-metrics-tls\") pod \"dns-default-m847l\" (UID: \"c39f60d8-e16b-4c73-bacf-a5702c57c76e\") " pod="openshift-dns/dns-default-m847l"
Sep 15 11:26:11.983588 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:11.983447    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8vhk8\""
Sep 15 11:26:11.983588 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:11.983485    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8glj6\" (UniqueName: \"kubernetes.io/projected/329235b6-5a87-40ce-a572-98c3f16101d5-kube-api-access-8glj6\") pod \"ingress-canary-26xwb\" (UID: \"329235b6-5a87-40ce-a572-98c3f16101d5\") " pod="openshift-ingress-canary/ingress-canary-26xwb"
Sep 15 11:26:11.983588 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:11.983506    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ggz2\" (UniqueName: \"kubernetes.io/projected/c39f60d8-e16b-4c73-bacf-a5702c57c76e-kube-api-access-8ggz2\") pod \"dns-default-m847l\" (UID: \"c39f60d8-e16b-4c73-bacf-a5702c57c76e\") " pod="openshift-dns/dns-default-m847l"
Sep 15 11:26:11.983588 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:11.983549    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 15 11:26:11.983931 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:11.983796    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 15 11:26:12.084630 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.084588    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8glj6\" (UniqueName: \"kubernetes.io/projected/329235b6-5a87-40ce-a572-98c3f16101d5-kube-api-access-8glj6\") pod \"ingress-canary-26xwb\" (UID: \"329235b6-5a87-40ce-a572-98c3f16101d5\") " pod="openshift-ingress-canary/ingress-canary-26xwb"
Sep 15 11:26:12.084630 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.084628    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ggz2\" (UniqueName: \"kubernetes.io/projected/c39f60d8-e16b-4c73-bacf-a5702c57c76e-kube-api-access-8ggz2\") pod \"dns-default-m847l\" (UID: \"c39f60d8-e16b-4c73-bacf-a5702c57c76e\") " pod="openshift-dns/dns-default-m847l"
Sep 15 11:26:12.084926 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.084671    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/098e3803-ccda-43ed-9c4b-27b03842d8bd-data-volume\") pod \"insights-runtime-extractor-mzz6r\" (UID: \"098e3803-ccda-43ed-9c4b-27b03842d8bd\") " pod="openshift-insights/insights-runtime-extractor-mzz6r"
Sep 15 11:26:12.084926 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.084700    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/098e3803-ccda-43ed-9c4b-27b03842d8bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mzz6r\" (UID: \"098e3803-ccda-43ed-9c4b-27b03842d8bd\") " pod="openshift-insights/insights-runtime-extractor-mzz6r"
Sep 15 11:26:12.084926 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.084834    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c39f60d8-e16b-4c73-bacf-a5702c57c76e-config-volume\") pod \"dns-default-m847l\" (UID: \"c39f60d8-e16b-4c73-bacf-a5702c57c76e\") " pod="openshift-dns/dns-default-m847l"
Sep 15 11:26:12.084926 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.084858    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c39f60d8-e16b-4c73-bacf-a5702c57c76e-tmp-dir\") pod \"dns-default-m847l\" (UID: \"c39f60d8-e16b-4c73-bacf-a5702c57c76e\") " pod="openshift-dns/dns-default-m847l"
Sep 15 11:26:12.084926 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.084890    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/098e3803-ccda-43ed-9c4b-27b03842d8bd-crio-socket\") pod \"insights-runtime-extractor-mzz6r\" (UID: \"098e3803-ccda-43ed-9c4b-27b03842d8bd\") " pod="openshift-insights/insights-runtime-extractor-mzz6r"
Sep 15 11:26:12.084926 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.084916    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snq9q\" (UniqueName: \"kubernetes.io/projected/098e3803-ccda-43ed-9c4b-27b03842d8bd-kube-api-access-snq9q\") pod \"insights-runtime-extractor-mzz6r\" (UID: \"098e3803-ccda-43ed-9c4b-27b03842d8bd\") " pod="openshift-insights/insights-runtime-extractor-mzz6r"
Sep 15 11:26:12.085194 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.084940    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/098e3803-ccda-43ed-9c4b-27b03842d8bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mzz6r\" (UID: \"098e3803-ccda-43ed-9c4b-27b03842d8bd\") " pod="openshift-insights/insights-runtime-extractor-mzz6r"
Sep 15 11:26:12.085194 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.084982    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/329235b6-5a87-40ce-a572-98c3f16101d5-cert\") pod \"ingress-canary-26xwb\" (UID: \"329235b6-5a87-40ce-a572-98c3f16101d5\") " pod="openshift-ingress-canary/ingress-canary-26xwb"
Sep 15 11:26:12.085194 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.085128    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c39f60d8-e16b-4c73-bacf-a5702c57c76e-metrics-tls\") pod \"dns-default-m847l\" (UID: \"c39f60d8-e16b-4c73-bacf-a5702c57c76e\") " pod="openshift-dns/dns-default-m847l"
Sep 15 11:26:12.085330 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.085228    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c39f60d8-e16b-4c73-bacf-a5702c57c76e-tmp-dir\") pod \"dns-default-m847l\" (UID: \"c39f60d8-e16b-4c73-bacf-a5702c57c76e\") " pod="openshift-dns/dns-default-m847l"
Sep 15 11:26:12.085461 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.085443    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c39f60d8-e16b-4c73-bacf-a5702c57c76e-config-volume\") pod \"dns-default-m847l\" (UID: \"c39f60d8-e16b-4c73-bacf-a5702c57c76e\") " pod="openshift-dns/dns-default-m847l"
Sep 15 11:26:12.086965 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.086940    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q96s9"
Sep 15 11:26:12.087109 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.086968    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k79mk"
Sep 15 11:26:12.087194 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.087136    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zpbfk"
Sep 15 11:26:12.089411 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.089384    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 11:26:12.089564 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.089433    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 15 11:26:12.089564 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.089384    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-n59hg\""
Sep 15 11:26:12.089564 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.089458    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 15 11:26:12.089749 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.089649    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c39f60d8-e16b-4c73-bacf-a5702c57c76e-metrics-tls\") pod \"dns-default-m847l\" (UID: \"c39f60d8-e16b-4c73-bacf-a5702c57c76e\") " pod="openshift-dns/dns-default-m847l"
Sep 15 11:26:12.089799 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.089786    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 11:26:12.089845 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.089804    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/329235b6-5a87-40ce-a572-98c3f16101d5-cert\") pod \"ingress-canary-26xwb\" (UID: \"329235b6-5a87-40ce-a572-98c3f16101d5\") " pod="openshift-ingress-canary/ingress-canary-26xwb"
Sep 15 11:26:12.089896 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.089861    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4fvsz\""
Sep 15 11:26:12.092741 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.092716    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ggz2\" (UniqueName: \"kubernetes.io/projected/c39f60d8-e16b-4c73-bacf-a5702c57c76e-kube-api-access-8ggz2\") pod \"dns-default-m847l\" (UID: \"c39f60d8-e16b-4c73-bacf-a5702c57c76e\") " pod="openshift-dns/dns-default-m847l"
Sep 15 11:26:12.092890 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.092868    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8glj6\" (UniqueName: \"kubernetes.io/projected/329235b6-5a87-40ce-a572-98c3f16101d5-kube-api-access-8glj6\") pod \"ingress-canary-26xwb\" (UID: \"329235b6-5a87-40ce-a572-98c3f16101d5\") " pod="openshift-ingress-canary/ingress-canary-26xwb"
Sep 15 11:26:12.185765 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.185726    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m847l"
Sep 15 11:26:12.185904 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.185837    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/098e3803-ccda-43ed-9c4b-27b03842d8bd-data-volume\") pod \"insights-runtime-extractor-mzz6r\" (UID: \"098e3803-ccda-43ed-9c4b-27b03842d8bd\") " pod="openshift-insights/insights-runtime-extractor-mzz6r"
Sep 15 11:26:12.185904 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.185868    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/098e3803-ccda-43ed-9c4b-27b03842d8bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mzz6r\" (UID: \"098e3803-ccda-43ed-9c4b-27b03842d8bd\") " pod="openshift-insights/insights-runtime-extractor-mzz6r"
Sep 15 11:26:12.185968 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.185923    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/098e3803-ccda-43ed-9c4b-27b03842d8bd-crio-socket\") pod \"insights-runtime-extractor-mzz6r\" (UID: \"098e3803-ccda-43ed-9c4b-27b03842d8bd\") " pod="openshift-insights/insights-runtime-extractor-mzz6r"
Sep 15 11:26:12.185968 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.185949    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snq9q\" (UniqueName: \"kubernetes.io/projected/098e3803-ccda-43ed-9c4b-27b03842d8bd-kube-api-access-snq9q\") pod \"insights-runtime-extractor-mzz6r\" (UID: \"098e3803-ccda-43ed-9c4b-27b03842d8bd\") " pod="openshift-insights/insights-runtime-extractor-mzz6r"
Sep 15 11:26:12.186038 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.186022    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/098e3803-ccda-43ed-9c4b-27b03842d8bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mzz6r\" (UID: \"098e3803-ccda-43ed-9c4b-27b03842d8bd\") " pod="openshift-insights/insights-runtime-extractor-mzz6r"
Sep 15 11:26:12.186164 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.186147    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/098e3803-ccda-43ed-9c4b-27b03842d8bd-crio-socket\") pod \"insights-runtime-extractor-mzz6r\" (UID: \"098e3803-ccda-43ed-9c4b-27b03842d8bd\") " pod="openshift-insights/insights-runtime-extractor-mzz6r"
Sep 15 11:26:12.186207 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.186179    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/098e3803-ccda-43ed-9c4b-27b03842d8bd-data-volume\") pod \"insights-runtime-extractor-mzz6r\" (UID: \"098e3803-ccda-43ed-9c4b-27b03842d8bd\") " pod="openshift-insights/insights-runtime-extractor-mzz6r"
Sep 15 11:26:12.186603 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.186580    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/098e3803-ccda-43ed-9c4b-27b03842d8bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mzz6r\" (UID: \"098e3803-ccda-43ed-9c4b-27b03842d8bd\") " pod="openshift-insights/insights-runtime-extractor-mzz6r"
Sep 15 11:26:12.188452 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.188427    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/098e3803-ccda-43ed-9c4b-27b03842d8bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mzz6r\" (UID: \"098e3803-ccda-43ed-9c4b-27b03842d8bd\") " pod="openshift-insights/insights-runtime-extractor-mzz6r"
Sep 15 11:26:12.195514 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.195480    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snq9q\" (UniqueName: \"kubernetes.io/projected/098e3803-ccda-43ed-9c4b-27b03842d8bd-kube-api-access-snq9q\") pod \"insights-runtime-extractor-mzz6r\" (UID: \"098e3803-ccda-43ed-9c4b-27b03842d8bd\") " pod="openshift-insights/insights-runtime-extractor-mzz6r"
Sep 15 11:26:12.198296 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.198257    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-26xwb"
Sep 15 11:26:12.289546 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.289501    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mzz6r"
Sep 15 11:26:12.523284 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.523198    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-26xwb"]
Sep 15 11:26:12.525465 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.525438    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-m847l"]
Sep 15 11:26:12.527525 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:26:12.527496    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod329235b6_5a87_40ce_a572_98c3f16101d5.slice/crio-72aef76d1cc0497117abd81b5b1de72a8d1cdce034c7b11489e95b24f79b35a2 WatchSource:0}: Error finding container 72aef76d1cc0497117abd81b5b1de72a8d1cdce034c7b11489e95b24f79b35a2: Status 404 returned error can't find the container with id 72aef76d1cc0497117abd81b5b1de72a8d1cdce034c7b11489e95b24f79b35a2
Sep 15 11:26:12.529228 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:26:12.529198    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc39f60d8_e16b_4c73_bacf_a5702c57c76e.slice/crio-0fe538ae0d7e73b262e92f3ee01b8a2fecb8aadb91d36f6e9513b0a141afa8c6 WatchSource:0}: Error finding container 0fe538ae0d7e73b262e92f3ee01b8a2fecb8aadb91d36f6e9513b0a141afa8c6: Status 404 returned error can't find the container with id 0fe538ae0d7e73b262e92f3ee01b8a2fecb8aadb91d36f6e9513b0a141afa8c6
Sep 15 11:26:12.596212 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.596101    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mzz6r"]
Sep 15 11:26:12.600860 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:26:12.600831    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod098e3803_ccda_43ed_9c4b_27b03842d8bd.slice/crio-91c299f37ed5b022aa8dc8a1627591341fe281bffb2430b4cf4e4e49a35c64a4 WatchSource:0}: Error finding container 91c299f37ed5b022aa8dc8a1627591341fe281bffb2430b4cf4e4e49a35c64a4: Status 404 returned error can't find the container with id 91c299f37ed5b022aa8dc8a1627591341fe281bffb2430b4cf4e4e49a35c64a4
Sep 15 11:26:12.935854 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.935638    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hgfjw"]
Sep 15 11:26:12.953569 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.953530    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hgfjw"]
Sep 15 11:26:12.953838 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.953765    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hgfjw"
Sep 15 11:26:12.956506 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.956477    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 15 11:26:12.956506 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:12.956493    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-mw9wp\""
Sep 15 11:26:13.094584 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:13.094533    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/194579af-cc78-46c8-9cd0-1a99d60bdb63-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-hgfjw\" (UID: \"194579af-cc78-46c8-9cd0-1a99d60bdb63\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hgfjw"
Sep 15 11:26:13.195204 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:13.195089    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/194579af-cc78-46c8-9cd0-1a99d60bdb63-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-hgfjw\" (UID: \"194579af-cc78-46c8-9cd0-1a99d60bdb63\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hgfjw"
Sep 15 11:26:13.199933 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:13.199873    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/194579af-cc78-46c8-9cd0-1a99d60bdb63-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-hgfjw\" (UID: \"194579af-cc78-46c8-9cd0-1a99d60bdb63\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hgfjw"
Sep 15 11:26:13.267852 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:13.267710    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hgfjw"
Sep 15 11:26:13.277773 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:13.277726    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-26xwb" event={"ID":"329235b6-5a87-40ce-a572-98c3f16101d5","Type":"ContainerStarted","Data":"72aef76d1cc0497117abd81b5b1de72a8d1cdce034c7b11489e95b24f79b35a2"}
Sep 15 11:26:13.280611 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:13.280561    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mzz6r" event={"ID":"098e3803-ccda-43ed-9c4b-27b03842d8bd","Type":"ContainerStarted","Data":"e87b5cc147a8546db0f84812033414ec21a1155b86bae32f3b1a8c100085d111"}
Sep 15 11:26:13.280837 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:13.280641    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mzz6r" event={"ID":"098e3803-ccda-43ed-9c4b-27b03842d8bd","Type":"ContainerStarted","Data":"91c299f37ed5b022aa8dc8a1627591341fe281bffb2430b4cf4e4e49a35c64a4"}
Sep 15 11:26:13.282359 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:13.282318    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m847l" event={"ID":"c39f60d8-e16b-4c73-bacf-a5702c57c76e","Type":"ContainerStarted","Data":"0fe538ae0d7e73b262e92f3ee01b8a2fecb8aadb91d36f6e9513b0a141afa8c6"}
Sep 15 11:26:13.581740 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:13.581635    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hgfjw"]
Sep 15 11:26:13.586391 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:26:13.586352    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod194579af_cc78_46c8_9cd0_1a99d60bdb63.slice/crio-2be8fc7a641d872ac7c6a26569eb4f0a4f8d7cf05a78ba293628bbf649f2e0dd WatchSource:0}: Error finding container 2be8fc7a641d872ac7c6a26569eb4f0a4f8d7cf05a78ba293628bbf649f2e0dd: Status 404 returned error can't find the container with id 2be8fc7a641d872ac7c6a26569eb4f0a4f8d7cf05a78ba293628bbf649f2e0dd
Sep 15 11:26:14.287130 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:14.287090    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hgfjw" event={"ID":"194579af-cc78-46c8-9cd0-1a99d60bdb63","Type":"ContainerStarted","Data":"2be8fc7a641d872ac7c6a26569eb4f0a4f8d7cf05a78ba293628bbf649f2e0dd"}
Sep 15 11:26:14.596883 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:14.596843    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bd6b7bfb4-hd6bh"]
Sep 15 11:26:14.613575 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:14.613538    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bd6b7bfb4-hd6bh"]
Sep 15 11:26:14.613785 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:14.613673    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bd6b7bfb4-hd6bh"
Sep 15 11:26:14.616407 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:14.616374    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4gqnf\""
Sep 15 11:26:14.616563 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:14.616374    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 15 11:26:14.617344 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:14.617087    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 15 11:26:14.617344 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:14.617191    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 15 11:26:14.617344 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:14.617191    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 15 11:26:14.617617 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:14.617485    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 15 11:26:14.617617 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:14.617588    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 15 11:26:14.617741 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:14.617706    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 15 11:26:14.706489 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:14.706450    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blshv\" (UniqueName: \"kubernetes.io/projected/9f61610b-f474-421c-b419-b53055b169f8-kube-api-access-blshv\") pod \"console-bd6b7bfb4-hd6bh\" (UID: \"9f61610b-f474-421c-b419-b53055b169f8\") " pod="openshift-console/console-bd6b7bfb4-hd6bh"
Sep 15 11:26:14.706721 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:14.706534    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f61610b-f474-421c-b419-b53055b169f8-oauth-serving-cert\") pod \"console-bd6b7bfb4-hd6bh\" (UID: \"9f61610b-f474-421c-b419-b53055b169f8\") " pod="openshift-console/console-bd6b7bfb4-hd6bh"
Sep 15 11:26:14.706721 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:14.706616    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f61610b-f474-421c-b419-b53055b169f8-service-ca\") pod \"console-bd6b7bfb4-hd6bh\" (UID: \"9f61610b-f474-421c-b419-b53055b169f8\") " pod="openshift-console/console-bd6b7bfb4-hd6bh"
Sep 15 11:26:14.706846 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:14.706748    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f61610b-f474-421c-b419-b53055b169f8-console-serving-cert\") pod \"console-bd6b7bfb4-hd6bh\" (UID: \"9f61610b-f474-421c-b419-b53055b169f8\") " pod="openshift-console/console-bd6b7bfb4-hd6bh"
Sep 15 11:26:14.706846 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:14.706778    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f61610b-f474-421c-b419-b53055b169f8-console-config\") pod \"console-bd6b7bfb4-hd6bh\" (UID: \"9f61610b-f474-421c-b419-b53055b169f8\") " pod="openshift-console/console-bd6b7bfb4-hd6bh"
Sep 15 11:26:14.706846 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:14.706825    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f61610b-f474-421c-b419-b53055b169f8-console-oauth-config\") pod \"console-bd6b7bfb4-hd6bh\" (UID: \"9f61610b-f474-421c-b419-b53055b169f8\") " pod="openshift-console/console-bd6b7bfb4-hd6bh"
Sep 15 11:26:14.807909 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:14.807785    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f61610b-f474-421c-b419-b53055b169f8-console-oauth-config\") pod \"console-bd6b7bfb4-hd6bh\" (UID: \"9f61610b-f474-421c-b419-b53055b169f8\") " pod="openshift-console/console-bd6b7bfb4-hd6bh"
Sep 15 11:26:14.807909 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:14.807852    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blshv\" (UniqueName: \"kubernetes.io/projected/9f61610b-f474-421c-b419-b53055b169f8-kube-api-access-blshv\") pod \"console-bd6b7bfb4-hd6bh\" (UID: \"9f61610b-f474-421c-b419-b53055b169f8\") " pod="openshift-console/console-bd6b7bfb4-hd6bh"
Sep 15 11:26:14.807909 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:14.807887    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f61610b-f474-421c-b419-b53055b169f8-oauth-serving-cert\") pod \"console-bd6b7bfb4-hd6bh\" (UID: \"9f61610b-f474-421c-b419-b53055b169f8\") " pod="openshift-console/console-bd6b7bfb4-hd6bh"
Sep 15 11:26:14.807909 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:14.807916    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f61610b-f474-421c-b419-b53055b169f8-service-ca\") pod \"console-bd6b7bfb4-hd6bh\" (UID: \"9f61610b-f474-421c-b419-b53055b169f8\") " pod="openshift-console/console-bd6b7bfb4-hd6bh"
Sep 15 11:26:14.808255 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:14.807993    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f61610b-f474-421c-b419-b53055b169f8-console-serving-cert\") pod \"console-bd6b7bfb4-hd6bh\" (UID: \"9f61610b-f474-421c-b419-b53055b169f8\") " pod="openshift-console/console-bd6b7bfb4-hd6bh"
Sep 15 11:26:14.808255 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:14.808013    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f61610b-f474-421c-b419-b53055b169f8-console-config\") pod \"console-bd6b7bfb4-hd6bh\" (UID: \"9f61610b-f474-421c-b419-b53055b169f8\") " pod="openshift-console/console-bd6b7bfb4-hd6bh"
Sep 15 11:26:14.808939 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:14.808914    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f61610b-f474-421c-b419-b53055b169f8-console-config\") pod \"console-bd6b7bfb4-hd6bh\" (UID: \"9f61610b-f474-421c-b419-b53055b169f8\") " pod="openshift-console/console-bd6b7bfb4-hd6bh"
Sep 15 11:26:14.809060 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:14.808945    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f61610b-f474-421c-b419-b53055b169f8-service-ca\") pod \"console-bd6b7bfb4-hd6bh\" (UID: \"9f61610b-f474-421c-b419-b53055b169f8\") " pod="openshift-console/console-bd6b7bfb4-hd6bh"
Sep 15 11:26:14.809060 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:14.808973    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f61610b-f474-421c-b419-b53055b169f8-oauth-serving-cert\") pod \"console-bd6b7bfb4-hd6bh\" (UID: \"9f61610b-f474-421c-b419-b53055b169f8\") " pod="openshift-console/console-bd6b7bfb4-hd6bh"
Sep 15 11:26:14.812237 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:14.812213    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f61610b-f474-421c-b419-b53055b169f8-console-oauth-config\") pod \"console-bd6b7bfb4-hd6bh\" (UID: \"9f61610b-f474-421c-b419-b53055b169f8\") " pod="openshift-console/console-bd6b7bfb4-hd6bh"
Sep 15 11:26:14.812334 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:14.812224    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f61610b-f474-421c-b419-b53055b169f8-console-serving-cert\") pod \"console-bd6b7bfb4-hd6bh\" (UID: \"9f61610b-f474-421c-b419-b53055b169f8\") " pod="openshift-console/console-bd6b7bfb4-hd6bh"
Sep 15 11:26:14.817062 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:14.817038    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blshv\" (UniqueName: \"kubernetes.io/projected/9f61610b-f474-421c-b419-b53055b169f8-kube-api-access-blshv\") pod \"console-bd6b7bfb4-hd6bh\" (UID: \"9f61610b-f474-421c-b419-b53055b169f8\") " pod="openshift-console/console-bd6b7bfb4-hd6bh"
Sep 15 11:26:14.927359 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:14.927272    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bd6b7bfb4-hd6bh"
Sep 15 11:26:16.211305 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:16.211036    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bd6b7bfb4-hd6bh"]
Sep 15 11:26:16.294336 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:26:16.294306    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f61610b_f474_421c_b419_b53055b169f8.slice/crio-69a0aef75ab7ef65e4b81d1afae468c205088df6b057c9c88e785c060c2eb1e2 WatchSource:0}: Error finding container 69a0aef75ab7ef65e4b81d1afae468c205088df6b057c9c88e785c060c2eb1e2: Status 404 returned error can't find the container with id 69a0aef75ab7ef65e4b81d1afae468c205088df6b057c9c88e785c060c2eb1e2
Sep 15 11:26:16.294863 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:16.294837    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mzz6r" event={"ID":"098e3803-ccda-43ed-9c4b-27b03842d8bd","Type":"ContainerStarted","Data":"5908dc4c0b05616d275a7c79fa17eae1df86380ec8075c5aa2cd013d1ad80813"}
Sep 15 11:26:16.296336 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:16.296312    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-26xwb" event={"ID":"329235b6-5a87-40ce-a572-98c3f16101d5","Type":"ContainerStarted","Data":"720c85a75ee108b7883f29aab26a0aa4b70c124a4dbff3da7f44a64468829880"}
Sep 15 11:26:16.297887 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:16.297853    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m847l" event={"ID":"c39f60d8-e16b-4c73-bacf-a5702c57c76e","Type":"ContainerStarted","Data":"7b2032c364165760fc87c2cb9ebda219f17165eab5e5920b84305d5ad8dcc21e"}
Sep 15 11:26:16.320934 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:16.320883    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-26xwb" podStartSLOduration=1.906897912 podStartE2EDuration="5.320861641s" totalImagesPullingTime="3.413963729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:26:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:16.320152552 +0000 UTC m=+46.746483149" watchObservedRunningTime="2026-09-15 11:26:16.320861641 +0000 UTC m=+46.747192239"
Sep 15 11:26:17.305166 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:17.305124    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m847l" event={"ID":"c39f60d8-e16b-4c73-bacf-a5702c57c76e","Type":"ContainerStarted","Data":"5046ffc6bb0374e1ed85ba0eecf704c20deaacf24e52b77a3e74af0d12980b7c"}
Sep 15 11:26:17.306182 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:17.305257    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-m847l"
Sep 15 11:26:17.308383 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:17.308143    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hgfjw" event={"ID":"194579af-cc78-46c8-9cd0-1a99d60bdb63","Type":"ContainerStarted","Data":"3dab0e4cb01b7e285bd017dc2edfa45e81e10d0ac80167dcb201a5db50226079"}
Sep 15 11:26:17.308383 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:17.308293    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hgfjw"
Sep 15 11:26:17.309875 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:17.309843    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bd6b7bfb4-hd6bh" event={"ID":"9f61610b-f474-421c-b419-b53055b169f8","Type":"ContainerStarted","Data":"69a0aef75ab7ef65e4b81d1afae468c205088df6b057c9c88e785c060c2eb1e2"}
Sep 15 11:26:17.314713 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:17.314683    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hgfjw"
Sep 15 11:26:17.323463 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:17.323398    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-m847l" podStartSLOduration=2.911873289 podStartE2EDuration="6.323373702s" totalImagesPullingTime="3.411500413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:26:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:17.322050337 +0000 UTC m=+47.748380935" watchObservedRunningTime="2026-09-15 11:26:17.323373702 +0000 UTC m=+47.749704299"
Sep 15 11:26:17.338414 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:17.338179    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hgfjw" podStartSLOduration=2.611842841 podStartE2EDuration="5.338157635s" totalImagesPullingTime="2.726314794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:26:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:17.338049725 +0000 UTC m=+47.764380321" watchObservedRunningTime="2026-09-15 11:26:17.338157635 +0000 UTC m=+47.764488231"
Sep 15 11:26:17.999490 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:17.999463    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-qsnvj"]
Sep 15 11:26:18.032631 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:18.032560    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-qsnvj"]
Sep 15 11:26:18.032836 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:18.032678    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-qsnvj"
Sep 15 11:26:18.036708 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:18.036478    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 15 11:26:18.036708 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:18.036501    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 15 11:26:18.036708 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:18.036528    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 15 11:26:18.036708 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:18.036501    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-lh2wd\""
Sep 15 11:26:18.037067 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:18.036777    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 15 11:26:18.037067 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:18.036835    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 15 11:26:18.136866 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:18.136829    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bfe43c5a-29be-4e66-967c-0ffccbca8f41-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-qsnvj\" (UID: \"bfe43c5a-29be-4e66-967c-0ffccbca8f41\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-qsnvj"
Sep 15 11:26:18.136866 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:18.136876    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg6tm\" (UniqueName: \"kubernetes.io/projected/bfe43c5a-29be-4e66-967c-0ffccbca8f41-kube-api-access-sg6tm\") pod \"prometheus-operator-68bcd7f987-qsnvj\" (UID: \"bfe43c5a-29be-4e66-967c-0ffccbca8f41\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-qsnvj"
Sep 15 11:26:18.137147 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:18.136934    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bfe43c5a-29be-4e66-967c-0ffccbca8f41-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-qsnvj\" (UID: \"bfe43c5a-29be-4e66-967c-0ffccbca8f41\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-qsnvj"
Sep 15 11:26:18.137147 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:18.137027    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bfe43c5a-29be-4e66-967c-0ffccbca8f41-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-qsnvj\" (UID: \"bfe43c5a-29be-4e66-967c-0ffccbca8f41\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-qsnvj"
Sep 15 11:26:18.237963 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:18.237839    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bfe43c5a-29be-4e66-967c-0ffccbca8f41-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-qsnvj\" (UID: \"bfe43c5a-29be-4e66-967c-0ffccbca8f41\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-qsnvj"
Sep 15 11:26:18.237963 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:18.237889    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bfe43c5a-29be-4e66-967c-0ffccbca8f41-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-qsnvj\" (UID: \"bfe43c5a-29be-4e66-967c-0ffccbca8f41\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-qsnvj"
Sep 15 11:26:18.237963 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:18.237923    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg6tm\" (UniqueName: \"kubernetes.io/projected/bfe43c5a-29be-4e66-967c-0ffccbca8f41-kube-api-access-sg6tm\") pod \"prometheus-operator-68bcd7f987-qsnvj\" (UID: \"bfe43c5a-29be-4e66-967c-0ffccbca8f41\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-qsnvj"
Sep 15 11:26:18.237963 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:18.237949    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bfe43c5a-29be-4e66-967c-0ffccbca8f41-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-qsnvj\" (UID: \"bfe43c5a-29be-4e66-967c-0ffccbca8f41\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-qsnvj"
Sep 15 11:26:18.238343 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:26:18.238009    2575 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 15 11:26:18.238343 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:26:18.238065    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfe43c5a-29be-4e66-967c-0ffccbca8f41-prometheus-operator-tls podName:bfe43c5a-29be-4e66-967c-0ffccbca8f41 nodeName:}" failed. No retries permitted until 2026-09-15 11:26:18.738050028 +0000 UTC m=+49.164380606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/bfe43c5a-29be-4e66-967c-0ffccbca8f41-prometheus-operator-tls") pod "prometheus-operator-68bcd7f987-qsnvj" (UID: "bfe43c5a-29be-4e66-967c-0ffccbca8f41") : secret "prometheus-operator-tls" not found
Sep 15 11:26:18.238841 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:18.238808    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bfe43c5a-29be-4e66-967c-0ffccbca8f41-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-qsnvj\" (UID: \"bfe43c5a-29be-4e66-967c-0ffccbca8f41\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-qsnvj"
Sep 15 11:26:18.242868 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:18.242836    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bfe43c5a-29be-4e66-967c-0ffccbca8f41-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-qsnvj\" (UID: \"bfe43c5a-29be-4e66-967c-0ffccbca8f41\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-qsnvj"
Sep 15 11:26:18.246154 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:18.246112    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg6tm\" (UniqueName: \"kubernetes.io/projected/bfe43c5a-29be-4e66-967c-0ffccbca8f41-kube-api-access-sg6tm\") pod \"prometheus-operator-68bcd7f987-qsnvj\" (UID: \"bfe43c5a-29be-4e66-967c-0ffccbca8f41\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-qsnvj"
Sep 15 11:26:18.317646 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:18.317603    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mzz6r" event={"ID":"098e3803-ccda-43ed-9c4b-27b03842d8bd","Type":"ContainerStarted","Data":"6fcd2ec228fed877f5526dde6a648fa0faaabd13fd2634f541b77a931cf69d96"}
Sep 15 11:26:18.336495 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:18.336245    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mzz6r" podStartSLOduration=2.594450585 podStartE2EDuration="7.336225598s" totalImagesPullingTime="4.741775013s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:26:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:18.336018839 +0000 UTC m=+48.762349436" watchObservedRunningTime="2026-09-15 11:26:18.336225598 +0000 UTC m=+48.762556193"
Sep 15 11:26:18.743121 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:18.743076    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bfe43c5a-29be-4e66-967c-0ffccbca8f41-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-qsnvj\" (UID: \"bfe43c5a-29be-4e66-967c-0ffccbca8f41\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-qsnvj"
Sep 15 11:26:18.746011 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:18.745971    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bfe43c5a-29be-4e66-967c-0ffccbca8f41-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-qsnvj\" (UID: \"bfe43c5a-29be-4e66-967c-0ffccbca8f41\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-qsnvj"
Sep 15 11:26:18.958791 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:18.958754    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-qsnvj"
Sep 15 11:26:19.646757 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:19.646671    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-qsnvj"]
Sep 15 11:26:19.711276 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:26:19.711238    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfe43c5a_29be_4e66_967c_0ffccbca8f41.slice/crio-ae46833ab4a4f49be0d4e8ab2287c66869da9482974fe60e5dfde5f7e131ab5e WatchSource:0}: Error finding container ae46833ab4a4f49be0d4e8ab2287c66869da9482974fe60e5dfde5f7e131ab5e: Status 404 returned error can't find the container with id ae46833ab4a4f49be0d4e8ab2287c66869da9482974fe60e5dfde5f7e131ab5e
Sep 15 11:26:20.325609 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:20.325359    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-qsnvj" event={"ID":"bfe43c5a-29be-4e66-967c-0ffccbca8f41","Type":"ContainerStarted","Data":"ae46833ab4a4f49be0d4e8ab2287c66869da9482974fe60e5dfde5f7e131ab5e"}
Sep 15 11:26:20.327500 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:20.327451    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bd6b7bfb4-hd6bh" event={"ID":"9f61610b-f474-421c-b419-b53055b169f8","Type":"ContainerStarted","Data":"5fa8b3180f8d90ee54ebea9d99f481b1ead417a7ca4763032065d7bd0dbdcc39"}
Sep 15 11:26:20.346811 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:20.346755    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bd6b7bfb4-hd6bh" podStartSLOduration=2.9174776590000002 podStartE2EDuration="6.346732169s" totalImagesPullingTime="3.42925451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:26:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:20.345833785 +0000 UTC m=+50.772164381" watchObservedRunningTime="2026-09-15 11:26:20.346732169 +0000 UTC m=+50.773062765"
Sep 15 11:26:20.379470 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:20.379330    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b587576b5-5vnqv"]
Sep 15 11:26:20.392340 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:20.392303    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b587576b5-5vnqv"]
Sep 15 11:26:20.392495 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:20.392445    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b587576b5-5vnqv"
Sep 15 11:26:20.400224 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:20.400192    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 15 11:26:20.457142 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:20.457100    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f867a8e7-5a0d-491b-92ab-9376532a812d-service-ca\") pod \"console-6b587576b5-5vnqv\" (UID: \"f867a8e7-5a0d-491b-92ab-9376532a812d\") " pod="openshift-console/console-6b587576b5-5vnqv"
Sep 15 11:26:20.457310 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:20.457156    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f867a8e7-5a0d-491b-92ab-9376532a812d-console-serving-cert\") pod \"console-6b587576b5-5vnqv\" (UID: \"f867a8e7-5a0d-491b-92ab-9376532a812d\") " pod="openshift-console/console-6b587576b5-5vnqv"
Sep 15 11:26:20.457310 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:20.457241    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f867a8e7-5a0d-491b-92ab-9376532a812d-trusted-ca-bundle\") pod \"console-6b587576b5-5vnqv\" (UID: \"f867a8e7-5a0d-491b-92ab-9376532a812d\") " pod="openshift-console/console-6b587576b5-5vnqv"
Sep 15 11:26:20.457310 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:20.457274    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f867a8e7-5a0d-491b-92ab-9376532a812d-console-oauth-config\") pod \"console-6b587576b5-5vnqv\" (UID: \"f867a8e7-5a0d-491b-92ab-9376532a812d\") " pod="openshift-console/console-6b587576b5-5vnqv"
Sep 15 11:26:20.457502 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:20.457308    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f867a8e7-5a0d-491b-92ab-9376532a812d-console-config\") pod \"console-6b587576b5-5vnqv\" (UID: \"f867a8e7-5a0d-491b-92ab-9376532a812d\") " pod="openshift-console/console-6b587576b5-5vnqv"
Sep 15 11:26:20.457502 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:20.457360    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f867a8e7-5a0d-491b-92ab-9376532a812d-oauth-serving-cert\") pod \"console-6b587576b5-5vnqv\" (UID: \"f867a8e7-5a0d-491b-92ab-9376532a812d\") " pod="openshift-console/console-6b587576b5-5vnqv"
Sep 15 11:26:20.457502 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:20.457478    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8xkk\" (UniqueName: \"kubernetes.io/projected/f867a8e7-5a0d-491b-92ab-9376532a812d-kube-api-access-f8xkk\") pod \"console-6b587576b5-5vnqv\" (UID: \"f867a8e7-5a0d-491b-92ab-9376532a812d\") " pod="openshift-console/console-6b587576b5-5vnqv"
Sep 15 11:26:20.557962 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:20.557912    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f867a8e7-5a0d-491b-92ab-9376532a812d-console-serving-cert\") pod \"console-6b587576b5-5vnqv\" (UID: \"f867a8e7-5a0d-491b-92ab-9376532a812d\") " pod="openshift-console/console-6b587576b5-5vnqv"
Sep 15 11:26:20.558210 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:20.558024    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f867a8e7-5a0d-491b-92ab-9376532a812d-trusted-ca-bundle\") pod \"console-6b587576b5-5vnqv\" (UID: \"f867a8e7-5a0d-491b-92ab-9376532a812d\") " pod="openshift-console/console-6b587576b5-5vnqv"
Sep 15 11:26:20.558210 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:20.558057    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f867a8e7-5a0d-491b-92ab-9376532a812d-console-oauth-config\") pod \"console-6b587576b5-5vnqv\" (UID: \"f867a8e7-5a0d-491b-92ab-9376532a812d\") " pod="openshift-console/console-6b587576b5-5vnqv"
Sep 15 11:26:20.558210 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:20.558087    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f867a8e7-5a0d-491b-92ab-9376532a812d-console-config\") pod \"console-6b587576b5-5vnqv\" (UID: \"f867a8e7-5a0d-491b-92ab-9376532a812d\") " pod="openshift-console/console-6b587576b5-5vnqv"
Sep 15 11:26:20.558210 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:20.558105    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f867a8e7-5a0d-491b-92ab-9376532a812d-oauth-serving-cert\") pod \"console-6b587576b5-5vnqv\" (UID: \"f867a8e7-5a0d-491b-92ab-9376532a812d\") " pod="openshift-console/console-6b587576b5-5vnqv"
Sep 15 11:26:20.558210 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:20.558147    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8xkk\" (UniqueName: \"kubernetes.io/projected/f867a8e7-5a0d-491b-92ab-9376532a812d-kube-api-access-f8xkk\") pod \"console-6b587576b5-5vnqv\" (UID: \"f867a8e7-5a0d-491b-92ab-9376532a812d\") " pod="openshift-console/console-6b587576b5-5vnqv"
Sep 15 11:26:20.558210 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:20.558182    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f867a8e7-5a0d-491b-92ab-9376532a812d-service-ca\") pod \"console-6b587576b5-5vnqv\" (UID: \"f867a8e7-5a0d-491b-92ab-9376532a812d\") " pod="openshift-console/console-6b587576b5-5vnqv"
Sep 15 11:26:20.558971 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:20.558914    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f867a8e7-5a0d-491b-92ab-9376532a812d-console-config\") pod \"console-6b587576b5-5vnqv\" (UID: \"f867a8e7-5a0d-491b-92ab-9376532a812d\") " pod="openshift-console/console-6b587576b5-5vnqv"
Sep 15 11:26:20.559130 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:20.559106    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f867a8e7-5a0d-491b-92ab-9376532a812d-oauth-serving-cert\") pod \"console-6b587576b5-5vnqv\" (UID: \"f867a8e7-5a0d-491b-92ab-9376532a812d\") " pod="openshift-console/console-6b587576b5-5vnqv"
Sep 15 11:26:20.559203 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:20.559153    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f867a8e7-5a0d-491b-92ab-9376532a812d-trusted-ca-bundle\") pod \"console-6b587576b5-5vnqv\" (UID: \"f867a8e7-5a0d-491b-92ab-9376532a812d\") " pod="openshift-console/console-6b587576b5-5vnqv"
Sep 15 11:26:20.559322 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:20.559295    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f867a8e7-5a0d-491b-92ab-9376532a812d-service-ca\") pod \"console-6b587576b5-5vnqv\" (UID: \"f867a8e7-5a0d-491b-92ab-9376532a812d\") " pod="openshift-console/console-6b587576b5-5vnqv"
Sep 15 11:26:20.562499 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:20.562467    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f867a8e7-5a0d-491b-92ab-9376532a812d-console-oauth-config\") pod \"console-6b587576b5-5vnqv\" (UID: \"f867a8e7-5a0d-491b-92ab-9376532a812d\") " pod="openshift-console/console-6b587576b5-5vnqv"
Sep 15 11:26:20.562608 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:20.562531    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f867a8e7-5a0d-491b-92ab-9376532a812d-console-serving-cert\") pod \"console-6b587576b5-5vnqv\" (UID: \"f867a8e7-5a0d-491b-92ab-9376532a812d\") " pod="openshift-console/console-6b587576b5-5vnqv"
Sep 15 11:26:20.569949 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:20.569923    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8xkk\" (UniqueName: \"kubernetes.io/projected/f867a8e7-5a0d-491b-92ab-9376532a812d-kube-api-access-f8xkk\") pod \"console-6b587576b5-5vnqv\" (UID: \"f867a8e7-5a0d-491b-92ab-9376532a812d\") " pod="openshift-console/console-6b587576b5-5vnqv"
Sep 15 11:26:20.703558 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:20.703456    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b587576b5-5vnqv"
Sep 15 11:26:21.234692 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:21.234328    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b587576b5-5vnqv"]
Sep 15 11:26:21.239768 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:26:21.239736    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf867a8e7_5a0d_491b_92ab_9376532a812d.slice/crio-f31f3cb230ef1b6a53ed80b603d9b345a461cdac247327fb6dbe5d400d052924 WatchSource:0}: Error finding container f31f3cb230ef1b6a53ed80b603d9b345a461cdac247327fb6dbe5d400d052924: Status 404 returned error can't find the container with id f31f3cb230ef1b6a53ed80b603d9b345a461cdac247327fb6dbe5d400d052924
Sep 15 11:26:21.332959 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:21.332914    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b587576b5-5vnqv" event={"ID":"f867a8e7-5a0d-491b-92ab-9376532a812d","Type":"ContainerStarted","Data":"c71f93ab05e13e431a418ad8c7c7d694107f6b3128c1711cf271bebbd79b9ef0"}
Sep 15 11:26:21.333205 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:21.332988    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b587576b5-5vnqv" event={"ID":"f867a8e7-5a0d-491b-92ab-9376532a812d","Type":"ContainerStarted","Data":"f31f3cb230ef1b6a53ed80b603d9b345a461cdac247327fb6dbe5d400d052924"}
Sep 15 11:26:21.335185 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:21.335144    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-qsnvj" event={"ID":"bfe43c5a-29be-4e66-967c-0ffccbca8f41","Type":"ContainerStarted","Data":"553806ff6c34acca1fceab108a4b173ae8dbc890293ff2d37a91d3433705d1e0"}
Sep 15 11:26:21.335365 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:21.335213    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-qsnvj" event={"ID":"bfe43c5a-29be-4e66-967c-0ffccbca8f41","Type":"ContainerStarted","Data":"59daed45cabb2f7ab2f6dcf3ff74632647475459774628c3d6abf920000d6c61"}
Sep 15 11:26:21.377286 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:21.377209    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-qsnvj" podStartSLOduration=3.128000082 podStartE2EDuration="4.377187151s" totalImagesPullingTime="1.249187069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:26:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:21.3771573 +0000 UTC m=+51.803487894" watchObservedRunningTime="2026-09-15 11:26:21.377187151 +0000 UTC m=+51.803517748"
Sep 15 11:26:21.377909 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:21.377863    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b587576b5-5vnqv" podStartSLOduration=1.377852213 podStartE2EDuration="1.377852213s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:26:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:21.355008958 +0000 UTC m=+51.781339565" watchObservedRunningTime="2026-09-15 11:26:21.377852213 +0000 UTC m=+51.804182815"
Sep 15 11:26:23.341095 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.341061    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-krbrg"]
Sep 15 11:26:23.343483 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.343464    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-krbrg"
Sep 15 11:26:23.345718 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.345698    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 15 11:26:23.345812 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.345736    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 15 11:26:23.345812 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.345789    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-5cnc6\""
Sep 15 11:26:23.365339 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.365303    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-krbrg"]
Sep 15 11:26:23.366111 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.366092    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-8jsbl"]
Sep 15 11:26:23.368267 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.368243    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jsbl"
Sep 15 11:26:23.370713 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.370684    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 15 11:26:23.370713 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.370703    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-km8jb\""
Sep 15 11:26:23.370910 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.370772    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 15 11:26:23.370992 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.370977    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 15 11:26:23.382421 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.382386    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-8jsbl"]
Sep 15 11:26:23.385365 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.385332    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8dfe2975-53d4-497f-84a8-73769c317649-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-krbrg\" (UID: \"8dfe2975-53d4-497f-84a8-73769c317649\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-krbrg"
Sep 15 11:26:23.385559 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.385374    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/15947759-97ca-45fa-ba35-9775f005932e-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-8jsbl\" (UID: \"15947759-97ca-45fa-ba35-9775f005932e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jsbl"
Sep 15 11:26:23.385559 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.385397    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8dfe2975-53d4-497f-84a8-73769c317649-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-krbrg\" (UID: \"8dfe2975-53d4-497f-84a8-73769c317649\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-krbrg"
Sep 15 11:26:23.385559 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.385420    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8tdj\" (UniqueName: \"kubernetes.io/projected/15947759-97ca-45fa-ba35-9775f005932e-kube-api-access-h8tdj\") pod \"kube-state-metrics-59fbdd77d-8jsbl\" (UID: \"15947759-97ca-45fa-ba35-9775f005932e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jsbl"
Sep 15 11:26:23.385559 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.385471    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8dfe2975-53d4-497f-84a8-73769c317649-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-krbrg\" (UID: \"8dfe2975-53d4-497f-84a8-73769c317649\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-krbrg"
Sep 15 11:26:23.385559 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.385525    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wnbz\" (UniqueName: \"kubernetes.io/projected/8dfe2975-53d4-497f-84a8-73769c317649-kube-api-access-5wnbz\") pod \"openshift-state-metrics-67dcf8c979-krbrg\" (UID: \"8dfe2975-53d4-497f-84a8-73769c317649\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-krbrg"
Sep 15 11:26:23.385885 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.385569    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/15947759-97ca-45fa-ba35-9775f005932e-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-8jsbl\" (UID: \"15947759-97ca-45fa-ba35-9775f005932e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jsbl"
Sep 15 11:26:23.385885 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.385587    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/15947759-97ca-45fa-ba35-9775f005932e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-8jsbl\" (UID: \"15947759-97ca-45fa-ba35-9775f005932e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jsbl"
Sep 15 11:26:23.385885 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.385623    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/15947759-97ca-45fa-ba35-9775f005932e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-8jsbl\" (UID: \"15947759-97ca-45fa-ba35-9775f005932e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jsbl"
Sep 15 11:26:23.385885 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.385640    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15947759-97ca-45fa-ba35-9775f005932e-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-8jsbl\" (UID: \"15947759-97ca-45fa-ba35-9775f005932e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jsbl"
Sep 15 11:26:23.393596 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.393562    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fcx44"]
Sep 15 11:26:23.395782 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.395745    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fcx44"
Sep 15 11:26:23.398080 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.398058    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 15 11:26:23.398230 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.398101    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 15 11:26:23.398230 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.398161    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 15 11:26:23.398565 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.398548    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-k5ffd\""
Sep 15 11:26:23.487037 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.487004    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/15947759-97ca-45fa-ba35-9775f005932e-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-8jsbl\" (UID: \"15947759-97ca-45fa-ba35-9775f005932e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jsbl"
Sep 15 11:26:23.487037 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.487039    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/15947759-97ca-45fa-ba35-9775f005932e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-8jsbl\" (UID: \"15947759-97ca-45fa-ba35-9775f005932e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jsbl"
Sep 15 11:26:23.487224 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.487066    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/decbe6a6-fff2-4036-a878-9ca3938aed97-node-exporter-accelerators-collector-config\") pod \"node-exporter-fcx44\" (UID: \"decbe6a6-fff2-4036-a878-9ca3938aed97\") " pod="openshift-monitoring/node-exporter-fcx44"
Sep 15 11:26:23.487224 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.487084    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/decbe6a6-fff2-4036-a878-9ca3938aed97-metrics-client-ca\") pod \"node-exporter-fcx44\" (UID: \"decbe6a6-fff2-4036-a878-9ca3938aed97\") " pod="openshift-monitoring/node-exporter-fcx44"
Sep 15 11:26:23.487224 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.487112    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/15947759-97ca-45fa-ba35-9775f005932e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-8jsbl\" (UID: \"15947759-97ca-45fa-ba35-9775f005932e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jsbl"
Sep 15 11:26:23.487224 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.487139    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/decbe6a6-fff2-4036-a878-9ca3938aed97-node-exporter-textfile\") pod \"node-exporter-fcx44\" (UID: \"decbe6a6-fff2-4036-a878-9ca3938aed97\") " pod="openshift-monitoring/node-exporter-fcx44"
Sep 15 11:26:23.487224 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.487159    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15947759-97ca-45fa-ba35-9775f005932e-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-8jsbl\" (UID: \"15947759-97ca-45fa-ba35-9775f005932e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jsbl"
Sep 15 11:26:23.487224 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.487175    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/decbe6a6-fff2-4036-a878-9ca3938aed97-node-exporter-wtmp\") pod \"node-exporter-fcx44\" (UID: \"decbe6a6-fff2-4036-a878-9ca3938aed97\") " pod="openshift-monitoring/node-exporter-fcx44"
Sep 15 11:26:23.487224 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.487212    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/decbe6a6-fff2-4036-a878-9ca3938aed97-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fcx44\" (UID: \"decbe6a6-fff2-4036-a878-9ca3938aed97\") " pod="openshift-monitoring/node-exporter-fcx44"
Sep 15 11:26:23.487529 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.487252    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/decbe6a6-fff2-4036-a878-9ca3938aed97-sys\") pod \"node-exporter-fcx44\" (UID: \"decbe6a6-fff2-4036-a878-9ca3938aed97\") " pod="openshift-monitoring/node-exporter-fcx44"
Sep 15 11:26:23.487529 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.487289    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/decbe6a6-fff2-4036-a878-9ca3938aed97-node-exporter-tls\") pod \"node-exporter-fcx44\" (UID: \"decbe6a6-fff2-4036-a878-9ca3938aed97\") " pod="openshift-monitoring/node-exporter-fcx44"
Sep 15 11:26:23.487529 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.487386    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8dfe2975-53d4-497f-84a8-73769c317649-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-krbrg\" (UID: \"8dfe2975-53d4-497f-84a8-73769c317649\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-krbrg"
Sep 15 11:26:23.487529 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.487429    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/15947759-97ca-45fa-ba35-9775f005932e-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-8jsbl\" (UID: \"15947759-97ca-45fa-ba35-9775f005932e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jsbl"
Sep 15 11:26:23.487529 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.487455    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8dfe2975-53d4-497f-84a8-73769c317649-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-krbrg\" (UID: \"8dfe2975-53d4-497f-84a8-73769c317649\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-krbrg"
Sep 15 11:26:23.487529 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.487480    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8tdj\" (UniqueName: \"kubernetes.io/projected/15947759-97ca-45fa-ba35-9775f005932e-kube-api-access-h8tdj\") pod \"kube-state-metrics-59fbdd77d-8jsbl\" (UID: \"15947759-97ca-45fa-ba35-9775f005932e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jsbl"
Sep 15 11:26:23.487529 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.487482    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/15947759-97ca-45fa-ba35-9775f005932e-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-8jsbl\" (UID: \"15947759-97ca-45fa-ba35-9775f005932e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jsbl"
Sep 15 11:26:23.487529 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.487507    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/decbe6a6-fff2-4036-a878-9ca3938aed97-root\") pod \"node-exporter-fcx44\" (UID: \"decbe6a6-fff2-4036-a878-9ca3938aed97\") " pod="openshift-monitoring/node-exporter-fcx44"
Sep 15 11:26:23.487529 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:26:23.487518    2575 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 15 11:26:23.487914 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:26:23.487594    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dfe2975-53d4-497f-84a8-73769c317649-openshift-state-metrics-tls podName:8dfe2975-53d4-497f-84a8-73769c317649 nodeName:}" failed. No retries permitted until 2026-09-15 11:26:23.987573361 +0000 UTC m=+54.413903945 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/8dfe2975-53d4-497f-84a8-73769c317649-openshift-state-metrics-tls") pod "openshift-state-metrics-67dcf8c979-krbrg" (UID: "8dfe2975-53d4-497f-84a8-73769c317649") : secret "openshift-state-metrics-tls" not found
Sep 15 11:26:23.487914 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.487790    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8dfe2975-53d4-497f-84a8-73769c317649-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-krbrg\" (UID: \"8dfe2975-53d4-497f-84a8-73769c317649\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-krbrg"
Sep 15 11:26:23.487914 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.487846    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wnbz\" (UniqueName: \"kubernetes.io/projected/8dfe2975-53d4-497f-84a8-73769c317649-kube-api-access-5wnbz\") pod \"openshift-state-metrics-67dcf8c979-krbrg\" (UID: \"8dfe2975-53d4-497f-84a8-73769c317649\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-krbrg"
Sep 15 11:26:23.487914 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.487900    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9bfk\" (UniqueName: \"kubernetes.io/projected/decbe6a6-fff2-4036-a878-9ca3938aed97-kube-api-access-x9bfk\") pod \"node-exporter-fcx44\" (UID: \"decbe6a6-fff2-4036-a878-9ca3938aed97\") " pod="openshift-monitoring/node-exporter-fcx44"
Sep 15 11:26:23.488114 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.487975    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/15947759-97ca-45fa-ba35-9775f005932e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-8jsbl\" (UID: \"15947759-97ca-45fa-ba35-9775f005932e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jsbl"
Sep 15 11:26:23.488114 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.488012    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15947759-97ca-45fa-ba35-9775f005932e-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-8jsbl\" (UID: \"15947759-97ca-45fa-ba35-9775f005932e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jsbl"
Sep 15 11:26:23.488416 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.488394    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8dfe2975-53d4-497f-84a8-73769c317649-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-krbrg\" (UID: \"8dfe2975-53d4-497f-84a8-73769c317649\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-krbrg"
Sep 15 11:26:23.490723 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.490701    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/15947759-97ca-45fa-ba35-9775f005932e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-8jsbl\" (UID: \"15947759-97ca-45fa-ba35-9775f005932e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jsbl"
Sep 15 11:26:23.490817 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.490718    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8dfe2975-53d4-497f-84a8-73769c317649-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-krbrg\" (UID: \"8dfe2975-53d4-497f-84a8-73769c317649\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-krbrg"
Sep 15 11:26:23.490817 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.490704    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/15947759-97ca-45fa-ba35-9775f005932e-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-8jsbl\" (UID: \"15947759-97ca-45fa-ba35-9775f005932e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jsbl"
Sep 15 11:26:23.499105 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.499077    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8tdj\" (UniqueName: \"kubernetes.io/projected/15947759-97ca-45fa-ba35-9775f005932e-kube-api-access-h8tdj\") pod \"kube-state-metrics-59fbdd77d-8jsbl\" (UID: \"15947759-97ca-45fa-ba35-9775f005932e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jsbl"
Sep 15 11:26:23.499253 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.499214    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wnbz\" (UniqueName: \"kubernetes.io/projected/8dfe2975-53d4-497f-84a8-73769c317649-kube-api-access-5wnbz\") pod \"openshift-state-metrics-67dcf8c979-krbrg\" (UID: \"8dfe2975-53d4-497f-84a8-73769c317649\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-krbrg"
Sep 15 11:26:23.588682 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.588607    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/decbe6a6-fff2-4036-a878-9ca3938aed97-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fcx44\" (UID: \"decbe6a6-fff2-4036-a878-9ca3938aed97\") " pod="openshift-monitoring/node-exporter-fcx44"
Sep 15 11:26:23.588682 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.588686    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/decbe6a6-fff2-4036-a878-9ca3938aed97-sys\") pod \"node-exporter-fcx44\" (UID: \"decbe6a6-fff2-4036-a878-9ca3938aed97\") " pod="openshift-monitoring/node-exporter-fcx44"
Sep 15 11:26:23.588951 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.588727    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/decbe6a6-fff2-4036-a878-9ca3938aed97-node-exporter-tls\") pod \"node-exporter-fcx44\" (UID: \"decbe6a6-fff2-4036-a878-9ca3938aed97\") " pod="openshift-monitoring/node-exporter-fcx44"
Sep 15 11:26:23.588951 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.588745    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/decbe6a6-fff2-4036-a878-9ca3938aed97-sys\") pod \"node-exporter-fcx44\" (UID: \"decbe6a6-fff2-4036-a878-9ca3938aed97\") " pod="openshift-monitoring/node-exporter-fcx44"
Sep 15 11:26:23.588951 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.588781    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/decbe6a6-fff2-4036-a878-9ca3938aed97-root\") pod \"node-exporter-fcx44\" (UID: \"decbe6a6-fff2-4036-a878-9ca3938aed97\") " pod="openshift-monitoring/node-exporter-fcx44"
Sep 15 11:26:23.588951 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.588837    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/decbe6a6-fff2-4036-a878-9ca3938aed97-root\") pod \"node-exporter-fcx44\" (UID: \"decbe6a6-fff2-4036-a878-9ca3938aed97\") " pod="openshift-monitoring/node-exporter-fcx44"
Sep 15 11:26:23.588951 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:26:23.588849    2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 15 11:26:23.588951 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.588842    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9bfk\" (UniqueName: \"kubernetes.io/projected/decbe6a6-fff2-4036-a878-9ca3938aed97-kube-api-access-x9bfk\") pod \"node-exporter-fcx44\" (UID: \"decbe6a6-fff2-4036-a878-9ca3938aed97\") " pod="openshift-monitoring/node-exporter-fcx44"
Sep 15 11:26:23.588951 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.588903    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/decbe6a6-fff2-4036-a878-9ca3938aed97-node-exporter-accelerators-collector-config\") pod \"node-exporter-fcx44\" (UID: \"decbe6a6-fff2-4036-a878-9ca3938aed97\") " pod="openshift-monitoring/node-exporter-fcx44"
Sep 15 11:26:23.588951 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:26:23.588925    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/decbe6a6-fff2-4036-a878-9ca3938aed97-node-exporter-tls podName:decbe6a6-fff2-4036-a878-9ca3938aed97 nodeName:}" failed. No retries permitted until 2026-09-15 11:26:24.088908283 +0000 UTC m=+54.515238861 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/decbe6a6-fff2-4036-a878-9ca3938aed97-node-exporter-tls") pod "node-exporter-fcx44" (UID: "decbe6a6-fff2-4036-a878-9ca3938aed97") : secret "node-exporter-tls" not found
Sep 15 11:26:23.588951 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.588952    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/decbe6a6-fff2-4036-a878-9ca3938aed97-metrics-client-ca\") pod \"node-exporter-fcx44\" (UID: \"decbe6a6-fff2-4036-a878-9ca3938aed97\") " pod="openshift-monitoring/node-exporter-fcx44"
Sep 15 11:26:23.589328 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.588976    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/decbe6a6-fff2-4036-a878-9ca3938aed97-node-exporter-textfile\") pod \"node-exporter-fcx44\" (UID: \"decbe6a6-fff2-4036-a878-9ca3938aed97\") " pod="openshift-monitoring/node-exporter-fcx44"
Sep 15 11:26:23.589328 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.588996    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/decbe6a6-fff2-4036-a878-9ca3938aed97-node-exporter-wtmp\") pod \"node-exporter-fcx44\" (UID: \"decbe6a6-fff2-4036-a878-9ca3938aed97\") " pod="openshift-monitoring/node-exporter-fcx44"
Sep 15 11:26:23.589328 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.589158    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/decbe6a6-fff2-4036-a878-9ca3938aed97-node-exporter-wtmp\") pod \"node-exporter-fcx44\" (UID: \"decbe6a6-fff2-4036-a878-9ca3938aed97\") " pod="openshift-monitoring/node-exporter-fcx44"
Sep 15 11:26:23.589328 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.589312    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/decbe6a6-fff2-4036-a878-9ca3938aed97-node-exporter-textfile\") pod \"node-exporter-fcx44\" (UID: \"decbe6a6-fff2-4036-a878-9ca3938aed97\") " pod="openshift-monitoring/node-exporter-fcx44"
Sep 15 11:26:23.589472 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.589454    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/decbe6a6-fff2-4036-a878-9ca3938aed97-node-exporter-accelerators-collector-config\") pod \"node-exporter-fcx44\" (UID: \"decbe6a6-fff2-4036-a878-9ca3938aed97\") " pod="openshift-monitoring/node-exporter-fcx44"
Sep 15 11:26:23.589559 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.589528    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/decbe6a6-fff2-4036-a878-9ca3938aed97-metrics-client-ca\") pod \"node-exporter-fcx44\" (UID: \"decbe6a6-fff2-4036-a878-9ca3938aed97\") " pod="openshift-monitoring/node-exporter-fcx44"
Sep 15 11:26:23.591158 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.591099    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/decbe6a6-fff2-4036-a878-9ca3938aed97-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fcx44\" (UID: \"decbe6a6-fff2-4036-a878-9ca3938aed97\") " pod="openshift-monitoring/node-exporter-fcx44"
Sep 15 11:26:23.599944 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.599917    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9bfk\" (UniqueName: \"kubernetes.io/projected/decbe6a6-fff2-4036-a878-9ca3938aed97-kube-api-access-x9bfk\") pod \"node-exporter-fcx44\" (UID: \"decbe6a6-fff2-4036-a878-9ca3938aed97\") " pod="openshift-monitoring/node-exporter-fcx44"
Sep 15 11:26:23.678024 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.677980    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jsbl"
Sep 15 11:26:23.959106 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.959030    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-8jsbl"]
Sep 15 11:26:23.961531 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:26:23.961494    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15947759_97ca_45fa_ba35_9775f005932e.slice/crio-24218dcfbe4bb236644b716629ff3f7570eab41b473c23b6f6a27c14dab2ff80 WatchSource:0}: Error finding container 24218dcfbe4bb236644b716629ff3f7570eab41b473c23b6f6a27c14dab2ff80: Status 404 returned error can't find the container with id 24218dcfbe4bb236644b716629ff3f7570eab41b473c23b6f6a27c14dab2ff80
Sep 15 11:26:23.992996 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.992946    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8dfe2975-53d4-497f-84a8-73769c317649-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-krbrg\" (UID: \"8dfe2975-53d4-497f-84a8-73769c317649\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-krbrg"
Sep 15 11:26:23.995348 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:23.995328    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8dfe2975-53d4-497f-84a8-73769c317649-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-krbrg\" (UID: \"8dfe2975-53d4-497f-84a8-73769c317649\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-krbrg"
Sep 15 11:26:24.094328 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.094290    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/decbe6a6-fff2-4036-a878-9ca3938aed97-node-exporter-tls\") pod \"node-exporter-fcx44\" (UID: \"decbe6a6-fff2-4036-a878-9ca3938aed97\") " pod="openshift-monitoring/node-exporter-fcx44"
Sep 15 11:26:24.096780 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.096753    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/decbe6a6-fff2-4036-a878-9ca3938aed97-node-exporter-tls\") pod \"node-exporter-fcx44\" (UID: \"decbe6a6-fff2-4036-a878-9ca3938aed97\") " pod="openshift-monitoring/node-exporter-fcx44"
Sep 15 11:26:24.253061 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.252971    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-krbrg"
Sep 15 11:26:24.305684 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.305635    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fcx44"
Sep 15 11:26:24.325141 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:26:24.325110    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddecbe6a6_fff2_4036_a878_9ca3938aed97.slice/crio-b8e1a332d1854a5f7579c5f3d2c766bcac7767e88284e37cb0b7f1cc0b5ae4c8 WatchSource:0}: Error finding container b8e1a332d1854a5f7579c5f3d2c766bcac7767e88284e37cb0b7f1cc0b5ae4c8: Status 404 returned error can't find the container with id b8e1a332d1854a5f7579c5f3d2c766bcac7767e88284e37cb0b7f1cc0b5ae4c8
Sep 15 11:26:24.355402 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.355364    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fcx44" event={"ID":"decbe6a6-fff2-4036-a878-9ca3938aed97","Type":"ContainerStarted","Data":"b8e1a332d1854a5f7579c5f3d2c766bcac7767e88284e37cb0b7f1cc0b5ae4c8"}
Sep 15 11:26:24.356572 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.356545    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jsbl" event={"ID":"15947759-97ca-45fa-ba35-9775f005932e","Type":"ContainerStarted","Data":"24218dcfbe4bb236644b716629ff3f7570eab41b473c23b6f6a27c14dab2ff80"}
Sep 15 11:26:24.426505 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.426472    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 11:26:24.429737 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.429710    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:24.433851 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.433819    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 15 11:26:24.434200 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.434081    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 15 11:26:24.434200 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.434139    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 15 11:26:24.434200 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.434150    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 15 11:26:24.434423 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.434223    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 15 11:26:24.434423 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.433847    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 15 11:26:24.434686 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.434635    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 15 11:26:24.434886 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.434687    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 15 11:26:24.434886 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.434636    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 15 11:26:24.434886 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.434750    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9qzn8\""
Sep 15 11:26:24.445298 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.445268    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 11:26:24.498732 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.498692    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:24.498906 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.498744    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:24.498906 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.498845    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-web-config\") pod \"alertmanager-main-0\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:24.499030 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.498933    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-config-volume\") pod \"alertmanager-main-0\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:24.499030 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.498981    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:24.499110 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.499044    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:24.499110 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.499079    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:24.499110 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.499104    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:24.499226 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.499128    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:24.499226 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.499150    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:24.499226 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.499207    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:24.499337 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.499229    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg5vt\" (UniqueName: \"kubernetes.io/projected/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-kube-api-access-vg5vt\") pod \"alertmanager-main-0\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:24.499337 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.499278    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-config-out\") pod \"alertmanager-main-0\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:24.532241 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.532148    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-krbrg"]
Sep 15 11:26:24.535351 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:26:24.535319    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dfe2975_53d4_497f_84a8_73769c317649.slice/crio-09e4161ec4afac4d114c75ca316097fa012bc1a7fe1a7b236348d757f6d9299d WatchSource:0}: Error finding container 09e4161ec4afac4d114c75ca316097fa012bc1a7fe1a7b236348d757f6d9299d: Status 404 returned error can't find the container with id 09e4161ec4afac4d114c75ca316097fa012bc1a7fe1a7b236348d757f6d9299d
Sep 15 11:26:24.599916 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.599875    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:24.600043 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.599922    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:24.600043 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.599943    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:24.600043 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.600006    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:24.600209 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:26:24.600062    2575 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Sep 15 11:26:24.600209 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.600066    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:24.600209 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.600092    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vg5vt\" (UniqueName: \"kubernetes.io/projected/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-kube-api-access-vg5vt\") pod \"alertmanager-main-0\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:24.600209 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:26:24.600147    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-secret-alertmanager-main-tls podName:351a8f44-b900-4b0b-9d3b-8b1e24267d1b nodeName:}" failed. No retries permitted until 2026-09-15 11:26:25.100122623 +0000 UTC m=+55.526453198 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "351a8f44-b900-4b0b-9d3b-8b1e24267d1b") : secret "alertmanager-main-tls" not found
Sep 15 11:26:24.600209 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.600168    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-config-out\") pod \"alertmanager-main-0\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:24.600478 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.600224    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:24.600478 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.600256    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:24.600478 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.600311    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-web-config\") pod \"alertmanager-main-0\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:24.600478 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.600373    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-config-volume\") pod \"alertmanager-main-0\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:24.600478 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.600418    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:24.600478 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.600466    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:24.601112 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.601083    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:24.601387 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.601364    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:24.603818 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.603441    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:24.603818 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.603767    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:24.604024 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.604004    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-config-out\") pod \"alertmanager-main-0\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:24.604169 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.604122    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-config-volume\") pod \"alertmanager-main-0\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:24.604169 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.604088    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:24.604936 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.604909    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:24.605056 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.604945    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:24.606051 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.606031    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-web-config\") pod \"alertmanager-main-0\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:24.606155 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.606123    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:24.609474 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.609446    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg5vt\" (UniqueName: \"kubernetes.io/projected/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-kube-api-access-vg5vt\") pod \"alertmanager-main-0\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:24.928473 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.928430    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bd6b7bfb4-hd6bh"
Sep 15 11:26:24.928727 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.928500    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bd6b7bfb4-hd6bh"
Sep 15 11:26:24.933758 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:24.933730    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bd6b7bfb4-hd6bh"
Sep 15 11:26:25.105998 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:25.105956    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:25.108617 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:25.108593    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:25.341312 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:25.341275    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:26:25.362934 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:25.362897    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-krbrg" event={"ID":"8dfe2975-53d4-497f-84a8-73769c317649","Type":"ContainerStarted","Data":"4090e11859b878247a2439df8f371294f30d84f18d84d84e3838cec299d7e844"}
Sep 15 11:26:25.363357 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:25.362975    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-krbrg" event={"ID":"8dfe2975-53d4-497f-84a8-73769c317649","Type":"ContainerStarted","Data":"0237e26402d239282cef8031d2875c907ea297855675cc01ad16c6113b432d53"}
Sep 15 11:26:25.363357 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:25.363003    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-krbrg" event={"ID":"8dfe2975-53d4-497f-84a8-73769c317649","Type":"ContainerStarted","Data":"09e4161ec4afac4d114c75ca316097fa012bc1a7fe1a7b236348d757f6d9299d"}
Sep 15 11:26:25.367424 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:25.367394    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bd6b7bfb4-hd6bh"
Sep 15 11:26:25.825373 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:25.825347    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 11:26:25.827863 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:26:25.827833    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod351a8f44_b900_4b0b_9d3b_8b1e24267d1b.slice/crio-ad1ab30ae74b1f98406bc16542d777f5502c417ebd067aa5ca64cfd0f5d60386 WatchSource:0}: Error finding container ad1ab30ae74b1f98406bc16542d777f5502c417ebd067aa5ca64cfd0f5d60386: Status 404 returned error can't find the container with id ad1ab30ae74b1f98406bc16542d777f5502c417ebd067aa5ca64cfd0f5d60386
Sep 15 11:26:26.351573 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:26.351533    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-747c85f84b-7btht"]
Sep 15 11:26:26.358205 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:26.358178    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-747c85f84b-7btht"
Sep 15 11:26:26.360353 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:26.360321    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 15 11:26:26.360526 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:26.360379    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-zvcdw\""
Sep 15 11:26:26.360526 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:26.360389    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 15 11:26:26.360526 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:26.360424    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-ck58hfl3r1d6n\""
Sep 15 11:26:26.360526 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:26.360376    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 15 11:26:26.360741 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:26.360711    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 15 11:26:26.360822 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:26.360806    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 15 11:26:26.367169 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:26.367145    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-747c85f84b-7btht"]
Sep 15 11:26:26.368805 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:26.368761    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"351a8f44-b900-4b0b-9d3b-8b1e24267d1b","Type":"ContainerStarted","Data":"ad1ab30ae74b1f98406bc16542d777f5502c417ebd067aa5ca64cfd0f5d60386"}
Sep 15 11:26:26.371577 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:26.371541    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-krbrg" event={"ID":"8dfe2975-53d4-497f-84a8-73769c317649","Type":"ContainerStarted","Data":"d2214544d1f36f5433d6ff35680c1efa252d710d48429a3790aea3e1f968d877"}
Sep 15 11:26:26.410007 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:26.409941    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-krbrg" podStartSLOduration=2.51062156 podStartE2EDuration="3.409859395s" totalImagesPullingTime="899.237835ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:26:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:26.408613468 +0000 UTC m=+56.834944063" watchObservedRunningTime="2026-09-15 11:26:26.409859395 +0000 UTC m=+56.836189994"
Sep 15 11:26:26.418930 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:26.418878    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3f865a88-05c6-49da-a8e4-fe70726ce77a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-747c85f84b-7btht\" (UID: \"3f865a88-05c6-49da-a8e4-fe70726ce77a\") " pod="openshift-monitoring/thanos-querier-747c85f84b-7btht"
Sep 15 11:26:26.418930 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:26.418936    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3f865a88-05c6-49da-a8e4-fe70726ce77a-secret-grpc-tls\") pod \"thanos-querier-747c85f84b-7btht\" (UID: \"3f865a88-05c6-49da-a8e4-fe70726ce77a\") " pod="openshift-monitoring/thanos-querier-747c85f84b-7btht"
Sep 15 11:26:26.419186 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:26.419079    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f865a88-05c6-49da-a8e4-fe70726ce77a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-747c85f84b-7btht\" (UID: \"3f865a88-05c6-49da-a8e4-fe70726ce77a\") " pod="openshift-monitoring/thanos-querier-747c85f84b-7btht"
Sep 15 11:26:26.419242 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:26.419184    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f865a88-05c6-49da-a8e4-fe70726ce77a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-747c85f84b-7btht\" (UID: \"3f865a88-05c6-49da-a8e4-fe70726ce77a\") " pod="openshift-monitoring/thanos-querier-747c85f84b-7btht"
Sep 15 11:26:26.419290 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:26.419270    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f865a88-05c6-49da-a8e4-fe70726ce77a-metrics-client-ca\") pod \"thanos-querier-747c85f84b-7btht\" (UID: \"3f865a88-05c6-49da-a8e4-fe70726ce77a\") " pod="openshift-monitoring/thanos-querier-747c85f84b-7btht"
Sep 15 11:26:26.419340 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:26.419294    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slpzz\" (UniqueName: \"kubernetes.io/projected/3f865a88-05c6-49da-a8e4-fe70726ce77a-kube-api-access-slpzz\") pod \"thanos-querier-747c85f84b-7btht\" (UID: \"3f865a88-05c6-49da-a8e4-fe70726ce77a\") " pod="openshift-monitoring/thanos-querier-747c85f84b-7btht"
Sep 15 11:26:26.419458 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:26.419432    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3f865a88-05c6-49da-a8e4-fe70726ce77a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-747c85f84b-7btht\" (UID: \"3f865a88-05c6-49da-a8e4-fe70726ce77a\") " pod="openshift-monitoring/thanos-querier-747c85f84b-7btht"
Sep 15 11:26:26.419539 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:26.419493    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3f865a88-05c6-49da-a8e4-fe70726ce77a-secret-thanos-querier-tls\") pod \"thanos-querier-747c85f84b-7btht\" (UID: \"3f865a88-05c6-49da-a8e4-fe70726ce77a\") " pod="openshift-monitoring/thanos-querier-747c85f84b-7btht"
Sep 15 11:26:26.521071 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:26.521025    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f865a88-05c6-49da-a8e4-fe70726ce77a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-747c85f84b-7btht\" (UID: \"3f865a88-05c6-49da-a8e4-fe70726ce77a\") " pod="openshift-monitoring/thanos-querier-747c85f84b-7btht"
Sep 15 11:26:26.521298 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:26.521108    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f865a88-05c6-49da-a8e4-fe70726ce77a-metrics-client-ca\") pod \"thanos-querier-747c85f84b-7btht\" (UID: \"3f865a88-05c6-49da-a8e4-fe70726ce77a\") " pod="openshift-monitoring/thanos-querier-747c85f84b-7btht"
Sep 15 11:26:26.521298 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:26.521142    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slpzz\" (UniqueName: \"kubernetes.io/projected/3f865a88-05c6-49da-a8e4-fe70726ce77a-kube-api-access-slpzz\") pod \"thanos-querier-747c85f84b-7btht\" (UID: \"3f865a88-05c6-49da-a8e4-fe70726ce77a\") " pod="openshift-monitoring/thanos-querier-747c85f84b-7btht"
Sep 15 11:26:26.521298 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:26.521229    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3f865a88-05c6-49da-a8e4-fe70726ce77a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-747c85f84b-7btht\" (UID: \"3f865a88-05c6-49da-a8e4-fe70726ce77a\") " pod="openshift-monitoring/thanos-querier-747c85f84b-7btht"
Sep 15 11:26:26.521298 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:26.521264    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3f865a88-05c6-49da-a8e4-fe70726ce77a-secret-thanos-querier-tls\") pod \"thanos-querier-747c85f84b-7btht\" (UID: \"3f865a88-05c6-49da-a8e4-fe70726ce77a\") " pod="openshift-monitoring/thanos-querier-747c85f84b-7btht"
Sep 15 11:26:26.521529 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:26.521335    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3f865a88-05c6-49da-a8e4-fe70726ce77a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-747c85f84b-7btht\" (UID: \"3f865a88-05c6-49da-a8e4-fe70726ce77a\") " pod="openshift-monitoring/thanos-querier-747c85f84b-7btht"
Sep 15 11:26:26.521529 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:26.521361    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3f865a88-05c6-49da-a8e4-fe70726ce77a-secret-grpc-tls\") pod \"thanos-querier-747c85f84b-7btht\" (UID: \"3f865a88-05c6-49da-a8e4-fe70726ce77a\") " pod="openshift-monitoring/thanos-querier-747c85f84b-7btht"
Sep 15 11:26:26.521529 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:26.521394    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f865a88-05c6-49da-a8e4-fe70726ce77a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-747c85f84b-7btht\" (UID: \"3f865a88-05c6-49da-a8e4-fe70726ce77a\") " pod="openshift-monitoring/thanos-querier-747c85f84b-7btht"
Sep 15 11:26:26.523768 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:26.523733    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f865a88-05c6-49da-a8e4-fe70726ce77a-metrics-client-ca\") pod \"thanos-querier-747c85f84b-7btht\" (UID: \"3f865a88-05c6-49da-a8e4-fe70726ce77a\") " pod="openshift-monitoring/thanos-querier-747c85f84b-7btht"
Sep 15 11:26:26.526377 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:26.526311    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3f865a88-05c6-49da-a8e4-fe70726ce77a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-747c85f84b-7btht\" (UID: \"3f865a88-05c6-49da-a8e4-fe70726ce77a\") " pod="openshift-monitoring/thanos-querier-747c85f84b-7btht"
Sep 15 11:26:26.527277 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:26.527244    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3f865a88-05c6-49da-a8e4-fe70726ce77a-secret-thanos-querier-tls\") pod \"thanos-querier-747c85f84b-7btht\" (UID: \"3f865a88-05c6-49da-a8e4-fe70726ce77a\") " pod="openshift-monitoring/thanos-querier-747c85f84b-7btht"
Sep 15 11:26:26.529733 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:26.529247    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3f865a88-05c6-49da-a8e4-fe70726ce77a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-747c85f84b-7btht\" (UID: \"3f865a88-05c6-49da-a8e4-fe70726ce77a\") " pod="openshift-monitoring/thanos-querier-747c85f84b-7btht"
Sep 15 11:26:26.529733 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:26.529586    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f865a88-05c6-49da-a8e4-fe70726ce77a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-747c85f84b-7btht\" (UID: \"3f865a88-05c6-49da-a8e4-fe70726ce77a\") " pod="openshift-monitoring/thanos-querier-747c85f84b-7btht"
Sep 15 11:26:26.530125 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:26.530088    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f865a88-05c6-49da-a8e4-fe70726ce77a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-747c85f84b-7btht\" (UID: \"3f865a88-05c6-49da-a8e4-fe70726ce77a\") " pod="openshift-monitoring/thanos-querier-747c85f84b-7btht"
Sep 15 11:26:26.532050 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:26.532029    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3f865a88-05c6-49da-a8e4-fe70726ce77a-secret-grpc-tls\") pod \"thanos-querier-747c85f84b-7btht\" (UID: \"3f865a88-05c6-49da-a8e4-fe70726ce77a\") " pod="openshift-monitoring/thanos-querier-747c85f84b-7btht"
Sep 15 11:26:26.532170 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:26.532139    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slpzz\" (UniqueName: \"kubernetes.io/projected/3f865a88-05c6-49da-a8e4-fe70726ce77a-kube-api-access-slpzz\") pod \"thanos-querier-747c85f84b-7btht\" (UID: \"3f865a88-05c6-49da-a8e4-fe70726ce77a\") " pod="openshift-monitoring/thanos-querier-747c85f84b-7btht"
Sep 15 11:26:26.669940 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:26.669616    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-747c85f84b-7btht"
Sep 15 11:26:27.320124 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:27.320093    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-m847l"
Sep 15 11:26:27.833501 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:27.833448    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-86c8f6885b-7sxth"]
Sep 15 11:26:27.841347 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:26:27.841306    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f865a88_05c6_49da_a8e4_fe70726ce77a.slice/crio-181d65f4f90e32879d41a08c12b1cbebde0f596f9ac79e950f009f2dad84d552 WatchSource:0}: Error finding container 181d65f4f90e32879d41a08c12b1cbebde0f596f9ac79e950f009f2dad84d552: Status 404 returned error can't find the container with id 181d65f4f90e32879d41a08c12b1cbebde0f596f9ac79e950f009f2dad84d552
Sep 15 11:26:27.852366 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:27.852302    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-747c85f84b-7btht"]
Sep 15 11:26:27.852575 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:27.852380    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-86c8f6885b-7sxth"]
Sep 15 11:26:27.852575 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:27.852398    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-86c8f6885b-7sxth"
Sep 15 11:26:27.855198 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:27.855169    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 15 11:26:27.856138 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:27.855847    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 15 11:26:27.856138 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:27.855945    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 15 11:26:27.856138 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:27.855947    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-zqz5p\""
Sep 15 11:26:27.856138 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:27.856015    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3m8v7i02qeghv\""
Sep 15 11:26:27.856698 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:27.856216    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 15 11:26:27.935054 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:27.935012    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f29accc6-671c-4242-9f6e-2816b9719497-secret-metrics-server-client-certs\") pod \"metrics-server-86c8f6885b-7sxth\" (UID: \"f29accc6-671c-4242-9f6e-2816b9719497\") " pod="openshift-monitoring/metrics-server-86c8f6885b-7sxth"
Sep 15 11:26:27.935054 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:27.935053    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f29accc6-671c-4242-9f6e-2816b9719497-audit-log\") pod \"metrics-server-86c8f6885b-7sxth\" (UID: \"f29accc6-671c-4242-9f6e-2816b9719497\") " pod="openshift-monitoring/metrics-server-86c8f6885b-7sxth"
Sep 15 11:26:27.935314 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:27.935087    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f29accc6-671c-4242-9f6e-2816b9719497-secret-metrics-server-tls\") pod \"metrics-server-86c8f6885b-7sxth\" (UID: \"f29accc6-671c-4242-9f6e-2816b9719497\") " pod="openshift-monitoring/metrics-server-86c8f6885b-7sxth"
Sep 15 11:26:27.935314 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:27.935159    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f29accc6-671c-4242-9f6e-2816b9719497-metrics-server-audit-profiles\") pod \"metrics-server-86c8f6885b-7sxth\" (UID: \"f29accc6-671c-4242-9f6e-2816b9719497\") " pod="openshift-monitoring/metrics-server-86c8f6885b-7sxth"
Sep 15 11:26:27.935314 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:27.935187    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f29accc6-671c-4242-9f6e-2816b9719497-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-86c8f6885b-7sxth\" (UID: \"f29accc6-671c-4242-9f6e-2816b9719497\") " pod="openshift-monitoring/metrics-server-86c8f6885b-7sxth"
Sep 15 11:26:27.935314 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:27.935203    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k77s\" (UniqueName: \"kubernetes.io/projected/f29accc6-671c-4242-9f6e-2816b9719497-kube-api-access-7k77s\") pod \"metrics-server-86c8f6885b-7sxth\" (UID: \"f29accc6-671c-4242-9f6e-2816b9719497\") " pod="openshift-monitoring/metrics-server-86c8f6885b-7sxth"
Sep 15 11:26:27.935314 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:27.935268    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f29accc6-671c-4242-9f6e-2816b9719497-client-ca-bundle\") pod \"metrics-server-86c8f6885b-7sxth\" (UID: \"f29accc6-671c-4242-9f6e-2816b9719497\") " pod="openshift-monitoring/metrics-server-86c8f6885b-7sxth"
Sep 15 11:26:28.036723 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.036681    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f29accc6-671c-4242-9f6e-2816b9719497-secret-metrics-server-tls\") pod \"metrics-server-86c8f6885b-7sxth\" (UID: \"f29accc6-671c-4242-9f6e-2816b9719497\") " pod="openshift-monitoring/metrics-server-86c8f6885b-7sxth"
Sep 15 11:26:28.036723 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.036737    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f29accc6-671c-4242-9f6e-2816b9719497-metrics-server-audit-profiles\") pod \"metrics-server-86c8f6885b-7sxth\" (UID: \"f29accc6-671c-4242-9f6e-2816b9719497\") " pod="openshift-monitoring/metrics-server-86c8f6885b-7sxth"
Sep 15 11:26:28.036999 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.036768    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f29accc6-671c-4242-9f6e-2816b9719497-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-86c8f6885b-7sxth\" (UID: \"f29accc6-671c-4242-9f6e-2816b9719497\") " pod="openshift-monitoring/metrics-server-86c8f6885b-7sxth"
Sep 15 11:26:28.036999 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.036787    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k77s\" (UniqueName: \"kubernetes.io/projected/f29accc6-671c-4242-9f6e-2816b9719497-kube-api-access-7k77s\") pod \"metrics-server-86c8f6885b-7sxth\" (UID: \"f29accc6-671c-4242-9f6e-2816b9719497\") " pod="openshift-monitoring/metrics-server-86c8f6885b-7sxth"
Sep 15 11:26:28.036999 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.036870    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f29accc6-671c-4242-9f6e-2816b9719497-client-ca-bundle\") pod \"metrics-server-86c8f6885b-7sxth\" (UID: \"f29accc6-671c-4242-9f6e-2816b9719497\") " pod="openshift-monitoring/metrics-server-86c8f6885b-7sxth"
Sep 15 11:26:28.036999 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.036910    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f29accc6-671c-4242-9f6e-2816b9719497-secret-metrics-server-client-certs\") pod \"metrics-server-86c8f6885b-7sxth\" (UID: \"f29accc6-671c-4242-9f6e-2816b9719497\") " pod="openshift-monitoring/metrics-server-86c8f6885b-7sxth"
Sep 15 11:26:28.036999 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.036930    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f29accc6-671c-4242-9f6e-2816b9719497-audit-log\") pod \"metrics-server-86c8f6885b-7sxth\" (UID: \"f29accc6-671c-4242-9f6e-2816b9719497\") " pod="openshift-monitoring/metrics-server-86c8f6885b-7sxth"
Sep 15 11:26:28.037480 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.037431    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f29accc6-671c-4242-9f6e-2816b9719497-audit-log\") pod \"metrics-server-86c8f6885b-7sxth\" (UID: \"f29accc6-671c-4242-9f6e-2816b9719497\") " pod="openshift-monitoring/metrics-server-86c8f6885b-7sxth"
Sep 15 11:26:28.037722 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.037698    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f29accc6-671c-4242-9f6e-2816b9719497-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-86c8f6885b-7sxth\" (UID: \"f29accc6-671c-4242-9f6e-2816b9719497\") " pod="openshift-monitoring/metrics-server-86c8f6885b-7sxth"
Sep 15 11:26:28.037953 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.037931    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f29accc6-671c-4242-9f6e-2816b9719497-metrics-server-audit-profiles\") pod \"metrics-server-86c8f6885b-7sxth\" (UID: \"f29accc6-671c-4242-9f6e-2816b9719497\") " pod="openshift-monitoring/metrics-server-86c8f6885b-7sxth"
Sep 15 11:26:28.039703 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.039682    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f29accc6-671c-4242-9f6e-2816b9719497-secret-metrics-server-tls\") pod \"metrics-server-86c8f6885b-7sxth\" (UID: \"f29accc6-671c-4242-9f6e-2816b9719497\") " pod="openshift-monitoring/metrics-server-86c8f6885b-7sxth"
Sep 15 11:26:28.039703 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.039692    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f29accc6-671c-4242-9f6e-2816b9719497-secret-metrics-server-client-certs\") pod \"metrics-server-86c8f6885b-7sxth\" (UID: \"f29accc6-671c-4242-9f6e-2816b9719497\") " pod="openshift-monitoring/metrics-server-86c8f6885b-7sxth"
Sep 15 11:26:28.039834 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.039706    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f29accc6-671c-4242-9f6e-2816b9719497-client-ca-bundle\") pod \"metrics-server-86c8f6885b-7sxth\" (UID: \"f29accc6-671c-4242-9f6e-2816b9719497\") " pod="openshift-monitoring/metrics-server-86c8f6885b-7sxth"
Sep 15 11:26:28.050576 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.050541    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k77s\" (UniqueName: \"kubernetes.io/projected/f29accc6-671c-4242-9f6e-2816b9719497-kube-api-access-7k77s\") pod \"metrics-server-86c8f6885b-7sxth\" (UID: \"f29accc6-671c-4242-9f6e-2816b9719497\") " pod="openshift-monitoring/metrics-server-86c8f6885b-7sxth"
Sep 15 11:26:28.170374 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.170273    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-86c8f6885b-7sxth"
Sep 15 11:26:28.172142 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.172112    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-g45xg"]
Sep 15 11:26:28.205561 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.205532    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-g45xg"]
Sep 15 11:26:28.205703 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.205577    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b587576b5-5vnqv"]
Sep 15 11:26:28.205703 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.205677    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-g45xg"
Sep 15 11:26:28.209353 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.209323    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 15 11:26:28.209972 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.209945    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-mv49g\""
Sep 15 11:26:28.226197 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.225771    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b4d956f84-95wrt"]
Sep 15 11:26:28.241273 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.240520    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkwq4\" (UniqueName: \"kubernetes.io/projected/f0fea698-4dfb-4444-8f7d-400771895b0b-kube-api-access-hkwq4\") pod \"monitoring-plugin-5d85778b9d-g45xg\" (UID: \"f0fea698-4dfb-4444-8f7d-400771895b0b\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-g45xg"
Sep 15 11:26:28.241273 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.240600    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f0fea698-4dfb-4444-8f7d-400771895b0b-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-g45xg\" (UID: \"f0fea698-4dfb-4444-8f7d-400771895b0b\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-g45xg"
Sep 15 11:26:28.254804 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.254766    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b4d956f84-95wrt"]
Sep 15 11:26:28.254923 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.254895    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b4d956f84-95wrt"
Sep 15 11:26:28.341782 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.341745    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spfnj\" (UniqueName: \"kubernetes.io/projected/aec1d8e8-5b41-45b7-a02e-c32090c94a09-kube-api-access-spfnj\") pod \"console-6b4d956f84-95wrt\" (UID: \"aec1d8e8-5b41-45b7-a02e-c32090c94a09\") " pod="openshift-console/console-6b4d956f84-95wrt"
Sep 15 11:26:28.341961 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.341823    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aec1d8e8-5b41-45b7-a02e-c32090c94a09-console-serving-cert\") pod \"console-6b4d956f84-95wrt\" (UID: \"aec1d8e8-5b41-45b7-a02e-c32090c94a09\") " pod="openshift-console/console-6b4d956f84-95wrt"
Sep 15 11:26:28.341961 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.341852    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aec1d8e8-5b41-45b7-a02e-c32090c94a09-console-config\") pod \"console-6b4d956f84-95wrt\" (UID: \"aec1d8e8-5b41-45b7-a02e-c32090c94a09\") " pod="openshift-console/console-6b4d956f84-95wrt"
Sep 15 11:26:28.341961 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.341906    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aec1d8e8-5b41-45b7-a02e-c32090c94a09-oauth-serving-cert\") pod \"console-6b4d956f84-95wrt\" (UID: \"aec1d8e8-5b41-45b7-a02e-c32090c94a09\") " pod="openshift-console/console-6b4d956f84-95wrt"
Sep 15 11:26:28.341961 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.341939    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aec1d8e8-5b41-45b7-a02e-c32090c94a09-console-oauth-config\") pod \"console-6b4d956f84-95wrt\" (UID: \"aec1d8e8-5b41-45b7-a02e-c32090c94a09\") " pod="openshift-console/console-6b4d956f84-95wrt"
Sep 15 11:26:28.342086 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.341960    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aec1d8e8-5b41-45b7-a02e-c32090c94a09-service-ca\") pod \"console-6b4d956f84-95wrt\" (UID: \"aec1d8e8-5b41-45b7-a02e-c32090c94a09\") " pod="openshift-console/console-6b4d956f84-95wrt"
Sep 15 11:26:28.342086 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.342000    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkwq4\" (UniqueName: \"kubernetes.io/projected/f0fea698-4dfb-4444-8f7d-400771895b0b-kube-api-access-hkwq4\") pod \"monitoring-plugin-5d85778b9d-g45xg\" (UID: \"f0fea698-4dfb-4444-8f7d-400771895b0b\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-g45xg"
Sep 15 11:26:28.342086 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.342029    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f0fea698-4dfb-4444-8f7d-400771895b0b-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-g45xg\" (UID: \"f0fea698-4dfb-4444-8f7d-400771895b0b\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-g45xg"
Sep 15 11:26:28.342086 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.342049    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aec1d8e8-5b41-45b7-a02e-c32090c94a09-trusted-ca-bundle\") pod \"console-6b4d956f84-95wrt\" (UID: \"aec1d8e8-5b41-45b7-a02e-c32090c94a09\") " pod="openshift-console/console-6b4d956f84-95wrt"
Sep 15 11:26:28.342201 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:26:28.342143    2575 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 15 11:26:28.342201 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:26:28.342199    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0fea698-4dfb-4444-8f7d-400771895b0b-monitoring-plugin-cert podName:f0fea698-4dfb-4444-8f7d-400771895b0b nodeName:}" failed. No retries permitted until 2026-09-15 11:26:28.842184366 +0000 UTC m=+59.268514945 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/f0fea698-4dfb-4444-8f7d-400771895b0b-monitoring-plugin-cert") pod "monitoring-plugin-5d85778b9d-g45xg" (UID: "f0fea698-4dfb-4444-8f7d-400771895b0b") : secret "monitoring-plugin-cert" not found
Sep 15 11:26:28.351149 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.351119    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkwq4\" (UniqueName: \"kubernetes.io/projected/f0fea698-4dfb-4444-8f7d-400771895b0b-kube-api-access-hkwq4\") pod \"monitoring-plugin-5d85778b9d-g45xg\" (UID: \"f0fea698-4dfb-4444-8f7d-400771895b0b\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-g45xg"
Sep 15 11:26:28.381758 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.381725    2575 generic.go:356] "Generic (PLEG): container finished" podID="351a8f44-b900-4b0b-9d3b-8b1e24267d1b" containerID="d071e7a872fb31bef83c3ab0ad1330d3735cff49b188a018b4016925082c193c" exitCode=0
Sep 15 11:26:28.381959 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.381828    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"351a8f44-b900-4b0b-9d3b-8b1e24267d1b","Type":"ContainerDied","Data":"d071e7a872fb31bef83c3ab0ad1330d3735cff49b188a018b4016925082c193c"}
Sep 15 11:26:28.383252 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.383223    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-747c85f84b-7btht" event={"ID":"3f865a88-05c6-49da-a8e4-fe70726ce77a","Type":"ContainerStarted","Data":"181d65f4f90e32879d41a08c12b1cbebde0f596f9ac79e950f009f2dad84d552"}
Sep 15 11:26:28.385804 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.385775    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jsbl" event={"ID":"15947759-97ca-45fa-ba35-9775f005932e","Type":"ContainerStarted","Data":"c7dda70828e7e12a2478ea2ca9865cc41507581bdd3c822895be0f588e027f63"}
Sep 15 11:26:28.385892 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.385835    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jsbl" event={"ID":"15947759-97ca-45fa-ba35-9775f005932e","Type":"ContainerStarted","Data":"1742b99c79f20f256ba660b8f13ad20da6f5738a8b570a5c80382b084384e16a"}
Sep 15 11:26:28.385892 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.385864    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jsbl" event={"ID":"15947759-97ca-45fa-ba35-9775f005932e","Type":"ContainerStarted","Data":"ad9206caed8816afade8fb522036a68963d45ba636d0582c252a3b847771afc1"}
Sep 15 11:26:28.431312 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.431119    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jsbl" podStartSLOduration=1.8452918029999998 podStartE2EDuration="5.43109434s" totalImagesPullingTime="3.585802537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:26:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:28.430686231 +0000 UTC m=+58.857016825" watchObservedRunningTime="2026-09-15 11:26:28.43109434 +0000 UTC m=+58.857424938"
Sep 15 11:26:28.443518 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.443475    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aec1d8e8-5b41-45b7-a02e-c32090c94a09-console-serving-cert\") pod \"console-6b4d956f84-95wrt\" (UID: \"aec1d8e8-5b41-45b7-a02e-c32090c94a09\") " pod="openshift-console/console-6b4d956f84-95wrt"
Sep 15 11:26:28.443730 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.443544    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aec1d8e8-5b41-45b7-a02e-c32090c94a09-console-config\") pod \"console-6b4d956f84-95wrt\" (UID: \"aec1d8e8-5b41-45b7-a02e-c32090c94a09\") " pod="openshift-console/console-6b4d956f84-95wrt"
Sep 15 11:26:28.443730 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.443694    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aec1d8e8-5b41-45b7-a02e-c32090c94a09-oauth-serving-cert\") pod \"console-6b4d956f84-95wrt\" (UID: \"aec1d8e8-5b41-45b7-a02e-c32090c94a09\") " pod="openshift-console/console-6b4d956f84-95wrt"
Sep 15 11:26:28.443874 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.443752    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aec1d8e8-5b41-45b7-a02e-c32090c94a09-console-oauth-config\") pod \"console-6b4d956f84-95wrt\" (UID: \"aec1d8e8-5b41-45b7-a02e-c32090c94a09\") " pod="openshift-console/console-6b4d956f84-95wrt"
Sep 15 11:26:28.443874 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.443785    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aec1d8e8-5b41-45b7-a02e-c32090c94a09-service-ca\") pod \"console-6b4d956f84-95wrt\" (UID: \"aec1d8e8-5b41-45b7-a02e-c32090c94a09\") " pod="openshift-console/console-6b4d956f84-95wrt"
Sep 15 11:26:28.444706 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.444285    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aec1d8e8-5b41-45b7-a02e-c32090c94a09-trusted-ca-bundle\") pod \"console-6b4d956f84-95wrt\" (UID: \"aec1d8e8-5b41-45b7-a02e-c32090c94a09\") " pod="openshift-console/console-6b4d956f84-95wrt"
Sep 15 11:26:28.444706 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.444380    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spfnj\" (UniqueName: \"kubernetes.io/projected/aec1d8e8-5b41-45b7-a02e-c32090c94a09-kube-api-access-spfnj\") pod \"console-6b4d956f84-95wrt\" (UID: \"aec1d8e8-5b41-45b7-a02e-c32090c94a09\") " pod="openshift-console/console-6b4d956f84-95wrt"
Sep 15 11:26:28.444706 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.444475    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aec1d8e8-5b41-45b7-a02e-c32090c94a09-console-config\") pod \"console-6b4d956f84-95wrt\" (UID: \"aec1d8e8-5b41-45b7-a02e-c32090c94a09\") " pod="openshift-console/console-6b4d956f84-95wrt"
Sep 15 11:26:28.444706 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.444547    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aec1d8e8-5b41-45b7-a02e-c32090c94a09-service-ca\") pod \"console-6b4d956f84-95wrt\" (UID: \"aec1d8e8-5b41-45b7-a02e-c32090c94a09\") " pod="openshift-console/console-6b4d956f84-95wrt"
Sep 15 11:26:28.444706 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.444547    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aec1d8e8-5b41-45b7-a02e-c32090c94a09-oauth-serving-cert\") pod \"console-6b4d956f84-95wrt\" (UID: \"aec1d8e8-5b41-45b7-a02e-c32090c94a09\") " pod="openshift-console/console-6b4d956f84-95wrt"
Sep 15 11:26:28.445470 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.445442    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aec1d8e8-5b41-45b7-a02e-c32090c94a09-trusted-ca-bundle\") pod \"console-6b4d956f84-95wrt\" (UID: \"aec1d8e8-5b41-45b7-a02e-c32090c94a09\") " pod="openshift-console/console-6b4d956f84-95wrt"
Sep 15 11:26:28.446331 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.446301    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aec1d8e8-5b41-45b7-a02e-c32090c94a09-console-serving-cert\") pod \"console-6b4d956f84-95wrt\" (UID: \"aec1d8e8-5b41-45b7-a02e-c32090c94a09\") " pod="openshift-console/console-6b4d956f84-95wrt"
Sep 15 11:26:28.446491 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.446474    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aec1d8e8-5b41-45b7-a02e-c32090c94a09-console-oauth-config\") pod \"console-6b4d956f84-95wrt\" (UID: \"aec1d8e8-5b41-45b7-a02e-c32090c94a09\") " pod="openshift-console/console-6b4d956f84-95wrt"
Sep 15 11:26:28.452785 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.452755    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spfnj\" (UniqueName: \"kubernetes.io/projected/aec1d8e8-5b41-45b7-a02e-c32090c94a09-kube-api-access-spfnj\") pod \"console-6b4d956f84-95wrt\" (UID: \"aec1d8e8-5b41-45b7-a02e-c32090c94a09\") " pod="openshift-console/console-6b4d956f84-95wrt"
Sep 15 11:26:28.479890 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.479845    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-86c8f6885b-7sxth"]
Sep 15 11:26:28.482999 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:26:28.482971    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf29accc6_671c_4242_9f6e_2816b9719497.slice/crio-5de7783ccaf9a1d9019faea2edb8ba656ad42a62e36c6db01bd342446454daa6 WatchSource:0}: Error finding container 5de7783ccaf9a1d9019faea2edb8ba656ad42a62e36c6db01bd342446454daa6: Status 404 returned error can't find the container with id 5de7783ccaf9a1d9019faea2edb8ba656ad42a62e36c6db01bd342446454daa6
Sep 15 11:26:28.570611 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.570574    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b4d956f84-95wrt"
Sep 15 11:26:28.610142 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.610059    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-545d74596c-csvhm"]
Sep 15 11:26:28.627743 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.626393    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-545d74596c-csvhm"
Sep 15 11:26:28.631857 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.629430    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 15 11:26:28.631857 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.629451    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 15 11:26:28.631857 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.629874    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 15 11:26:28.631857 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.629970    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 15 11:26:28.631857 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.630502    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-vl2n2\""
Sep 15 11:26:28.632705 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.632563    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 15 11:26:28.633684 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.632829    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-545d74596c-csvhm"]
Sep 15 11:26:28.639843 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.638246    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 15 11:26:28.748059 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.747960    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea56a0f5-bcfc-488f-83b5-ea00001546ad-serving-certs-ca-bundle\") pod \"telemeter-client-545d74596c-csvhm\" (UID: \"ea56a0f5-bcfc-488f-83b5-ea00001546ad\") " pod="openshift-monitoring/telemeter-client-545d74596c-csvhm"
Sep 15 11:26:28.748059 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.748014    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea56a0f5-bcfc-488f-83b5-ea00001546ad-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-545d74596c-csvhm\" (UID: \"ea56a0f5-bcfc-488f-83b5-ea00001546ad\") " pod="openshift-monitoring/telemeter-client-545d74596c-csvhm"
Sep 15 11:26:28.748277 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.748069    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea56a0f5-bcfc-488f-83b5-ea00001546ad-telemeter-trusted-ca-bundle\") pod \"telemeter-client-545d74596c-csvhm\" (UID: \"ea56a0f5-bcfc-488f-83b5-ea00001546ad\") " pod="openshift-monitoring/telemeter-client-545d74596c-csvhm"
Sep 15 11:26:28.748277 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.748101    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ea56a0f5-bcfc-488f-83b5-ea00001546ad-secret-telemeter-client\") pod \"telemeter-client-545d74596c-csvhm\" (UID: \"ea56a0f5-bcfc-488f-83b5-ea00001546ad\") " pod="openshift-monitoring/telemeter-client-545d74596c-csvhm"
Sep 15 11:26:28.748277 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.748130    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea56a0f5-bcfc-488f-83b5-ea00001546ad-metrics-client-ca\") pod \"telemeter-client-545d74596c-csvhm\" (UID: \"ea56a0f5-bcfc-488f-83b5-ea00001546ad\") " pod="openshift-monitoring/telemeter-client-545d74596c-csvhm"
Sep 15 11:26:28.748277 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.748161    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5765\" (UniqueName: \"kubernetes.io/projected/ea56a0f5-bcfc-488f-83b5-ea00001546ad-kube-api-access-v5765\") pod \"telemeter-client-545d74596c-csvhm\" (UID: \"ea56a0f5-bcfc-488f-83b5-ea00001546ad\") " pod="openshift-monitoring/telemeter-client-545d74596c-csvhm"
Sep 15 11:26:28.748277 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.748261    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ea56a0f5-bcfc-488f-83b5-ea00001546ad-telemeter-client-tls\") pod \"telemeter-client-545d74596c-csvhm\" (UID: \"ea56a0f5-bcfc-488f-83b5-ea00001546ad\") " pod="openshift-monitoring/telemeter-client-545d74596c-csvhm"
Sep 15 11:26:28.748523 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.748310    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ea56a0f5-bcfc-488f-83b5-ea00001546ad-federate-client-tls\") pod \"telemeter-client-545d74596c-csvhm\" (UID: \"ea56a0f5-bcfc-488f-83b5-ea00001546ad\") " pod="openshift-monitoring/telemeter-client-545d74596c-csvhm"
Sep 15 11:26:28.849236 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.849194    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5765\" (UniqueName: \"kubernetes.io/projected/ea56a0f5-bcfc-488f-83b5-ea00001546ad-kube-api-access-v5765\") pod \"telemeter-client-545d74596c-csvhm\" (UID: \"ea56a0f5-bcfc-488f-83b5-ea00001546ad\") " pod="openshift-monitoring/telemeter-client-545d74596c-csvhm"
Sep 15 11:26:28.849825 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.849257    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f0fea698-4dfb-4444-8f7d-400771895b0b-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-g45xg\" (UID: \"f0fea698-4dfb-4444-8f7d-400771895b0b\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-g45xg"
Sep 15 11:26:28.849825 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.849343    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ea56a0f5-bcfc-488f-83b5-ea00001546ad-telemeter-client-tls\") pod \"telemeter-client-545d74596c-csvhm\" (UID: \"ea56a0f5-bcfc-488f-83b5-ea00001546ad\") " pod="openshift-monitoring/telemeter-client-545d74596c-csvhm"
Sep 15 11:26:28.849825 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.849370    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ea56a0f5-bcfc-488f-83b5-ea00001546ad-federate-client-tls\") pod \"telemeter-client-545d74596c-csvhm\" (UID: \"ea56a0f5-bcfc-488f-83b5-ea00001546ad\") " pod="openshift-monitoring/telemeter-client-545d74596c-csvhm"
Sep 15 11:26:28.849825 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.849501    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea56a0f5-bcfc-488f-83b5-ea00001546ad-serving-certs-ca-bundle\") pod \"telemeter-client-545d74596c-csvhm\" (UID: \"ea56a0f5-bcfc-488f-83b5-ea00001546ad\") " pod="openshift-monitoring/telemeter-client-545d74596c-csvhm"
Sep 15 11:26:28.849825 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.849539    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea56a0f5-bcfc-488f-83b5-ea00001546ad-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-545d74596c-csvhm\" (UID: \"ea56a0f5-bcfc-488f-83b5-ea00001546ad\") " pod="openshift-monitoring/telemeter-client-545d74596c-csvhm"
Sep 15 11:26:28.849825 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.849575    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea56a0f5-bcfc-488f-83b5-ea00001546ad-telemeter-trusted-ca-bundle\") pod \"telemeter-client-545d74596c-csvhm\" (UID: \"ea56a0f5-bcfc-488f-83b5-ea00001546ad\") " pod="openshift-monitoring/telemeter-client-545d74596c-csvhm"
Sep 15 11:26:28.849825 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.849612    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ea56a0f5-bcfc-488f-83b5-ea00001546ad-secret-telemeter-client\") pod \"telemeter-client-545d74596c-csvhm\" (UID: \"ea56a0f5-bcfc-488f-83b5-ea00001546ad\") " pod="openshift-monitoring/telemeter-client-545d74596c-csvhm"
Sep 15 11:26:28.849825 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.849640    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea56a0f5-bcfc-488f-83b5-ea00001546ad-metrics-client-ca\") pod \"telemeter-client-545d74596c-csvhm\" (UID: \"ea56a0f5-bcfc-488f-83b5-ea00001546ad\") " pod="openshift-monitoring/telemeter-client-545d74596c-csvhm"
Sep 15 11:26:28.851331 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.850962    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea56a0f5-bcfc-488f-83b5-ea00001546ad-serving-certs-ca-bundle\") pod \"telemeter-client-545d74596c-csvhm\" (UID: \"ea56a0f5-bcfc-488f-83b5-ea00001546ad\") " pod="openshift-monitoring/telemeter-client-545d74596c-csvhm"
Sep 15 11:26:28.851331 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.850984    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea56a0f5-bcfc-488f-83b5-ea00001546ad-metrics-client-ca\") pod \"telemeter-client-545d74596c-csvhm\" (UID: \"ea56a0f5-bcfc-488f-83b5-ea00001546ad\") " pod="openshift-monitoring/telemeter-client-545d74596c-csvhm"
Sep 15 11:26:28.851331 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.851093    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea56a0f5-bcfc-488f-83b5-ea00001546ad-telemeter-trusted-ca-bundle\") pod \"telemeter-client-545d74596c-csvhm\" (UID: \"ea56a0f5-bcfc-488f-83b5-ea00001546ad\") " pod="openshift-monitoring/telemeter-client-545d74596c-csvhm"
Sep 15 11:26:28.853967 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.853900    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ea56a0f5-bcfc-488f-83b5-ea00001546ad-telemeter-client-tls\") pod \"telemeter-client-545d74596c-csvhm\" (UID: \"ea56a0f5-bcfc-488f-83b5-ea00001546ad\") " pod="openshift-monitoring/telemeter-client-545d74596c-csvhm"
Sep 15 11:26:28.854423 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.854392    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ea56a0f5-bcfc-488f-83b5-ea00001546ad-secret-telemeter-client\") pod \"telemeter-client-545d74596c-csvhm\" (UID: \"ea56a0f5-bcfc-488f-83b5-ea00001546ad\") " pod="openshift-monitoring/telemeter-client-545d74596c-csvhm"
Sep 15 11:26:28.856084 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.856044    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ea56a0f5-bcfc-488f-83b5-ea00001546ad-federate-client-tls\") pod \"telemeter-client-545d74596c-csvhm\" (UID: \"ea56a0f5-bcfc-488f-83b5-ea00001546ad\") " pod="openshift-monitoring/telemeter-client-545d74596c-csvhm"
Sep 15 11:26:28.857023 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.856996    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea56a0f5-bcfc-488f-83b5-ea00001546ad-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-545d74596c-csvhm\" (UID: \"ea56a0f5-bcfc-488f-83b5-ea00001546ad\") " pod="openshift-monitoring/telemeter-client-545d74596c-csvhm"
Sep 15 11:26:28.857128 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.857069    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f0fea698-4dfb-4444-8f7d-400771895b0b-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-g45xg\" (UID: \"f0fea698-4dfb-4444-8f7d-400771895b0b\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-g45xg"
Sep 15 11:26:28.860911 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.860845    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5765\" (UniqueName: \"kubernetes.io/projected/ea56a0f5-bcfc-488f-83b5-ea00001546ad-kube-api-access-v5765\") pod \"telemeter-client-545d74596c-csvhm\" (UID: \"ea56a0f5-bcfc-488f-83b5-ea00001546ad\") " pod="openshift-monitoring/telemeter-client-545d74596c-csvhm"
Sep 15 11:26:28.883337 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.883248    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b4d956f84-95wrt"]
Sep 15 11:26:28.886930 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:26:28.886851    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaec1d8e8_5b41_45b7_a02e_c32090c94a09.slice/crio-39e887f671d9b7bef39ab9aadf687128e95c9256ebb3e80f0762676d84e10970 WatchSource:0}: Error finding container 39e887f671d9b7bef39ab9aadf687128e95c9256ebb3e80f0762676d84e10970: Status 404 returned error can't find the container with id 39e887f671d9b7bef39ab9aadf687128e95c9256ebb3e80f0762676d84e10970
Sep 15 11:26:28.945394 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:28.945305    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-545d74596c-csvhm"
Sep 15 11:26:29.117011 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:29.116970    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-g45xg"
Sep 15 11:26:29.272472 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:29.272376    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-545d74596c-csvhm"]
Sep 15 11:26:29.303494 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:26:29.303443    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea56a0f5_bcfc_488f_83b5_ea00001546ad.slice/crio-c8666c0d932df172e32f350b86662c8e7500b1a082344afbb7856dc6ccf62600 WatchSource:0}: Error finding container c8666c0d932df172e32f350b86662c8e7500b1a082344afbb7856dc6ccf62600: Status 404 returned error can't find the container with id c8666c0d932df172e32f350b86662c8e7500b1a082344afbb7856dc6ccf62600
Sep 15 11:26:29.401841 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:29.401798    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b4d956f84-95wrt" event={"ID":"aec1d8e8-5b41-45b7-a02e-c32090c94a09","Type":"ContainerStarted","Data":"3b73289a5fc2155446c8731fe5e7385731cbdaf8b73d5b21e29b3b2228dbc9e6"}
Sep 15 11:26:29.402057 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:29.401864    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b4d956f84-95wrt" event={"ID":"aec1d8e8-5b41-45b7-a02e-c32090c94a09","Type":"ContainerStarted","Data":"39e887f671d9b7bef39ab9aadf687128e95c9256ebb3e80f0762676d84e10970"}
Sep 15 11:26:29.404868 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:29.404773    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-86c8f6885b-7sxth" event={"ID":"f29accc6-671c-4242-9f6e-2816b9719497","Type":"ContainerStarted","Data":"5de7783ccaf9a1d9019faea2edb8ba656ad42a62e36c6db01bd342446454daa6"}
Sep 15 11:26:29.411248 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:29.411135    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-545d74596c-csvhm" event={"ID":"ea56a0f5-bcfc-488f-83b5-ea00001546ad","Type":"ContainerStarted","Data":"c8666c0d932df172e32f350b86662c8e7500b1a082344afbb7856dc6ccf62600"}
Sep 15 11:26:29.427323 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:29.426374    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b4d956f84-95wrt" podStartSLOduration=1.426350948 podStartE2EDuration="1.426350948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:26:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:29.42511468 +0000 UTC m=+59.851445279" watchObservedRunningTime="2026-09-15 11:26:29.426350948 +0000 UTC m=+59.852681545"
Sep 15 11:26:29.601355 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:29.601262    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-g45xg"]
Sep 15 11:26:30.244629 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:30.244585    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nvpfc"
Sep 15 11:26:30.418330 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:30.418295    2575 generic.go:356] "Generic (PLEG): container finished" podID="decbe6a6-fff2-4036-a878-9ca3938aed97" containerID="e85f2c3bb8b924a7aa6df94ba8a95d983043ff1c4b0f8f2ddf6279a220876ff8" exitCode=0
Sep 15 11:26:30.418650 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:30.418616    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fcx44" event={"ID":"decbe6a6-fff2-4036-a878-9ca3938aed97","Type":"ContainerDied","Data":"e85f2c3bb8b924a7aa6df94ba8a95d983043ff1c4b0f8f2ddf6279a220876ff8"}
Sep 15 11:26:30.675158 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:26:30.675124    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0fea698_4dfb_4444_8f7d_400771895b0b.slice/crio-d52c49b06bbf604d5b97f9d736a3a5efb874328433bdfe1a1087345d06e843bb WatchSource:0}: Error finding container d52c49b06bbf604d5b97f9d736a3a5efb874328433bdfe1a1087345d06e843bb: Status 404 returned error can't find the container with id d52c49b06bbf604d5b97f9d736a3a5efb874328433bdfe1a1087345d06e843bb
Sep 15 11:26:30.703890 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:30.703848    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b587576b5-5vnqv"
Sep 15 11:26:31.425080 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:31.424981    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-g45xg" event={"ID":"f0fea698-4dfb-4444-8f7d-400771895b0b","Type":"ContainerStarted","Data":"d52c49b06bbf604d5b97f9d736a3a5efb874328433bdfe1a1087345d06e843bb"}
Sep 15 11:26:32.431668 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.431597    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-g45xg" event={"ID":"f0fea698-4dfb-4444-8f7d-400771895b0b","Type":"ContainerStarted","Data":"ab6ad8bc4ed1c7a3535d0bef3545537825a18766fd4c1bdcf86d5b5d0df45a8f"}
Sep 15 11:26:32.432161 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.431739    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-g45xg"
Sep 15 11:26:32.440366 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.440325    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"351a8f44-b900-4b0b-9d3b-8b1e24267d1b","Type":"ContainerStarted","Data":"03658fb3132cc3ca0c70f2b9ca5fb6a80b444a9a6813b544246bce92bca4d621"}
Sep 15 11:26:32.440577 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.440475    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-g45xg"
Sep 15 11:26:32.440577 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.440507    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"351a8f44-b900-4b0b-9d3b-8b1e24267d1b","Type":"ContainerStarted","Data":"8a8e3e6487d24d77ef9ed57e80655e85f033e3533e84bd75432f76e281ae2ba5"}
Sep 15 11:26:32.440577 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.440551    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"351a8f44-b900-4b0b-9d3b-8b1e24267d1b","Type":"ContainerStarted","Data":"5d9ca4d4d60339a74dd33d858363ecc867578283218ffe01a47a964240ec8e45"}
Sep 15 11:26:32.440787 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.440590    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"351a8f44-b900-4b0b-9d3b-8b1e24267d1b","Type":"ContainerStarted","Data":"22dd4cf524e1e93465e7a8c504140f5ad0dc2d0f0de6a9d1088c9dc2dafe5dd4"}
Sep 15 11:26:32.440787 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.440632    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"351a8f44-b900-4b0b-9d3b-8b1e24267d1b","Type":"ContainerStarted","Data":"2930e5ab390539a3d6de7dee6b130f36511404a98b0994b1363e7af455532ddf"}
Sep 15 11:26:32.443211 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.443180    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-747c85f84b-7btht" event={"ID":"3f865a88-05c6-49da-a8e4-fe70726ce77a","Type":"ContainerStarted","Data":"d3550282b5022fe3db884a41dc47d8621c7e3efac8e3cf76f1cc09d94ccface8"}
Sep 15 11:26:32.443367 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.443262    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-747c85f84b-7btht" event={"ID":"3f865a88-05c6-49da-a8e4-fe70726ce77a","Type":"ContainerStarted","Data":"16fbd6417acafb88b32ddf94dbc4ba7cdf2de1abe09bd8dda4f8aa7aae7daa4a"}
Sep 15 11:26:32.443367 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.443301    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-747c85f84b-7btht" event={"ID":"3f865a88-05c6-49da-a8e4-fe70726ce77a","Type":"ContainerStarted","Data":"8afc9b4045d80f08e2f53f96a57433f676a62fb3ca147a39fa0b2d0c16730014"}
Sep 15 11:26:32.445398 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.445368    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-545d74596c-csvhm" event={"ID":"ea56a0f5-bcfc-488f-83b5-ea00001546ad","Type":"ContainerStarted","Data":"4baf19e98059517033bb428274824ef53012fa0e4fc52cdc3bfa80cdce2d11d1"}
Sep 15 11:26:32.445571 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.445421    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-545d74596c-csvhm" event={"ID":"ea56a0f5-bcfc-488f-83b5-ea00001546ad","Type":"ContainerStarted","Data":"5602564181c0f9dcb689cd990f7f1acb895d8adcbe3977d202c39a157fc0d073"}
Sep 15 11:26:32.445571 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.445449    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-545d74596c-csvhm" event={"ID":"ea56a0f5-bcfc-488f-83b5-ea00001546ad","Type":"ContainerStarted","Data":"6889fe29df7127637c95e5e7d927ec1fa6aa2ced52d327bc37758496c4ae589a"}
Sep 15 11:26:32.448045 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.447907    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fcx44" event={"ID":"decbe6a6-fff2-4036-a878-9ca3938aed97","Type":"ContainerStarted","Data":"b53a87f0cd05a79b240da80a328657d0688fb9adc4a999f3732d243d81fa2e29"}
Sep 15 11:26:32.448262 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.448077    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fcx44" event={"ID":"decbe6a6-fff2-4036-a878-9ca3938aed97","Type":"ContainerStarted","Data":"34558d9ef24a474b0fb5b1fccfe73e5edefda663fd7eef9eb2c7ce9a56e28c6f"}
Sep 15 11:26:32.449879 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.449822    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-g45xg" podStartSLOduration=3.111255964 podStartE2EDuration="4.4498018s" totalImagesPullingTime="1.338545836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:26:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:32.448408963 +0000 UTC m=+62.874739560" watchObservedRunningTime="2026-09-15 11:26:32.4498018 +0000 UTC m=+62.876132396"
Sep 15 11:26:32.450125 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.450103    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-86c8f6885b-7sxth" event={"ID":"f29accc6-671c-4242-9f6e-2816b9719497","Type":"ContainerStarted","Data":"ec858fb26444edce290ff3de7e9bba79db8b80d2f45ddbb4cd6b406354aaf9fa"}
Sep 15 11:26:32.473082 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.473013    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-545d74596c-csvhm" podStartSLOduration=1.8030181060000001 podStartE2EDuration="4.472990245s" totalImagesPullingTime="2.669972139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:26:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:32.471919082 +0000 UTC m=+62.898249678" watchObservedRunningTime="2026-09-15 11:26:32.472990245 +0000 UTC m=+62.899320841"
Sep 15 11:26:32.491974 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.491849    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fcx44" podStartSLOduration=4.372114796 podStartE2EDuration="9.491811059s" totalImagesPullingTime="5.006210447s" totalInitContainerRuntime="113.485816ms" isStatefulPod=true podCreationTimestamp="2026-09-15 11:26:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:32.491139758 +0000 UTC m=+62.917470355" watchObservedRunningTime="2026-09-15 11:26:32.491811059 +0000 UTC m=+62.918141683"
Sep 15 11:26:32.524985 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.524684    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-86c8f6885b-7sxth" podStartSLOduration=2.395065751 podStartE2EDuration="5.52462843s" totalImagesPullingTime="3.129562679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:26:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:32.523417633 +0000 UTC m=+62.949748230" watchObservedRunningTime="2026-09-15 11:26:32.52462843 +0000 UTC m=+62.950959027"
Sep 15 11:26:32.591896 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.591851    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b4d956f84-95wrt"]
Sep 15 11:26:32.625677 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.625622    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5bb459678f-5npxx"]
Sep 15 11:26:32.628430 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.628404    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bb459678f-5npxx"
Sep 15 11:26:32.647885 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.647842    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bb459678f-5npxx"]
Sep 15 11:26:32.700675 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.700621    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba839785-bf22-4551-8290-5c9e847a7c27-console-serving-cert\") pod \"console-5bb459678f-5npxx\" (UID: \"ba839785-bf22-4551-8290-5c9e847a7c27\") " pod="openshift-console/console-5bb459678f-5npxx"
Sep 15 11:26:32.700675 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.700679    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba839785-bf22-4551-8290-5c9e847a7c27-service-ca\") pod \"console-5bb459678f-5npxx\" (UID: \"ba839785-bf22-4551-8290-5c9e847a7c27\") " pod="openshift-console/console-5bb459678f-5npxx"
Sep 15 11:26:32.700973 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.700702    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z7l8\" (UniqueName: \"kubernetes.io/projected/ba839785-bf22-4551-8290-5c9e847a7c27-kube-api-access-6z7l8\") pod \"console-5bb459678f-5npxx\" (UID: \"ba839785-bf22-4551-8290-5c9e847a7c27\") " pod="openshift-console/console-5bb459678f-5npxx"
Sep 15 11:26:32.700973 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.700797    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba839785-bf22-4551-8290-5c9e847a7c27-trusted-ca-bundle\") pod \"console-5bb459678f-5npxx\" (UID: \"ba839785-bf22-4551-8290-5c9e847a7c27\") " pod="openshift-console/console-5bb459678f-5npxx"
Sep 15 11:26:32.700973 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.700875    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba839785-bf22-4551-8290-5c9e847a7c27-oauth-serving-cert\") pod \"console-5bb459678f-5npxx\" (UID: \"ba839785-bf22-4551-8290-5c9e847a7c27\") " pod="openshift-console/console-5bb459678f-5npxx"
Sep 15 11:26:32.700973 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.700921    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba839785-bf22-4551-8290-5c9e847a7c27-console-oauth-config\") pod \"console-5bb459678f-5npxx\" (UID: \"ba839785-bf22-4551-8290-5c9e847a7c27\") " pod="openshift-console/console-5bb459678f-5npxx"
Sep 15 11:26:32.701199 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.701077    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba839785-bf22-4551-8290-5c9e847a7c27-console-config\") pod \"console-5bb459678f-5npxx\" (UID: \"ba839785-bf22-4551-8290-5c9e847a7c27\") " pod="openshift-console/console-5bb459678f-5npxx"
Sep 15 11:26:32.801986 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.801884    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba839785-bf22-4551-8290-5c9e847a7c27-console-config\") pod \"console-5bb459678f-5npxx\" (UID: \"ba839785-bf22-4551-8290-5c9e847a7c27\") " pod="openshift-console/console-5bb459678f-5npxx"
Sep 15 11:26:32.801986 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.801959    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba839785-bf22-4551-8290-5c9e847a7c27-console-serving-cert\") pod \"console-5bb459678f-5npxx\" (UID: \"ba839785-bf22-4551-8290-5c9e847a7c27\") " pod="openshift-console/console-5bb459678f-5npxx"
Sep 15 11:26:32.802208 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.801992    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba839785-bf22-4551-8290-5c9e847a7c27-service-ca\") pod \"console-5bb459678f-5npxx\" (UID: \"ba839785-bf22-4551-8290-5c9e847a7c27\") " pod="openshift-console/console-5bb459678f-5npxx"
Sep 15 11:26:32.802208 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.802023    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z7l8\" (UniqueName: \"kubernetes.io/projected/ba839785-bf22-4551-8290-5c9e847a7c27-kube-api-access-6z7l8\") pod \"console-5bb459678f-5npxx\" (UID: \"ba839785-bf22-4551-8290-5c9e847a7c27\") " pod="openshift-console/console-5bb459678f-5npxx"
Sep 15 11:26:32.802208 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.802145    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba839785-bf22-4551-8290-5c9e847a7c27-trusted-ca-bundle\") pod \"console-5bb459678f-5npxx\" (UID: \"ba839785-bf22-4551-8290-5c9e847a7c27\") " pod="openshift-console/console-5bb459678f-5npxx"
Sep 15 11:26:32.802364 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.802227    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba839785-bf22-4551-8290-5c9e847a7c27-oauth-serving-cert\") pod \"console-5bb459678f-5npxx\" (UID: \"ba839785-bf22-4551-8290-5c9e847a7c27\") " pod="openshift-console/console-5bb459678f-5npxx"
Sep 15 11:26:32.802364 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.802272    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba839785-bf22-4551-8290-5c9e847a7c27-console-oauth-config\") pod \"console-5bb459678f-5npxx\" (UID: \"ba839785-bf22-4551-8290-5c9e847a7c27\") " pod="openshift-console/console-5bb459678f-5npxx"
Sep 15 11:26:32.802839 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.802802    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba839785-bf22-4551-8290-5c9e847a7c27-service-ca\") pod \"console-5bb459678f-5npxx\" (UID: \"ba839785-bf22-4551-8290-5c9e847a7c27\") " pod="openshift-console/console-5bb459678f-5npxx"
Sep 15 11:26:32.803013 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.802990    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba839785-bf22-4551-8290-5c9e847a7c27-console-config\") pod \"console-5bb459678f-5npxx\" (UID: \"ba839785-bf22-4551-8290-5c9e847a7c27\") " pod="openshift-console/console-5bb459678f-5npxx"
Sep 15 11:26:32.803099 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.802989    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba839785-bf22-4551-8290-5c9e847a7c27-oauth-serving-cert\") pod \"console-5bb459678f-5npxx\" (UID: \"ba839785-bf22-4551-8290-5c9e847a7c27\") " pod="openshift-console/console-5bb459678f-5npxx"
Sep 15 11:26:32.803099 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.803091    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba839785-bf22-4551-8290-5c9e847a7c27-trusted-ca-bundle\") pod \"console-5bb459678f-5npxx\" (UID: \"ba839785-bf22-4551-8290-5c9e847a7c27\") " pod="openshift-console/console-5bb459678f-5npxx"
Sep 15 11:26:32.804632 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.804612    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba839785-bf22-4551-8290-5c9e847a7c27-console-serving-cert\") pod \"console-5bb459678f-5npxx\" (UID: \"ba839785-bf22-4551-8290-5c9e847a7c27\") " pod="openshift-console/console-5bb459678f-5npxx"
Sep 15 11:26:32.804728 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.804644    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba839785-bf22-4551-8290-5c9e847a7c27-console-oauth-config\") pod \"console-5bb459678f-5npxx\" (UID: \"ba839785-bf22-4551-8290-5c9e847a7c27\") " pod="openshift-console/console-5bb459678f-5npxx"
Sep 15 11:26:32.810365 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.810336    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z7l8\" (UniqueName: \"kubernetes.io/projected/ba839785-bf22-4551-8290-5c9e847a7c27-kube-api-access-6z7l8\") pod \"console-5bb459678f-5npxx\" (UID: \"ba839785-bf22-4551-8290-5c9e847a7c27\") " pod="openshift-console/console-5bb459678f-5npxx"
Sep 15 11:26:32.941187 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:32.940859    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bb459678f-5npxx"
Sep 15 11:26:33.242116 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:33.241823    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bb459678f-5npxx"]
Sep 15 11:26:33.246147 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:26:33.246105    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba839785_bf22_4551_8290_5c9e847a7c27.slice/crio-04ff5c4443d8650c8faecda7d9f00c2983c7f4b7f1dd7698af1c13e4011b2bdd WatchSource:0}: Error finding container 04ff5c4443d8650c8faecda7d9f00c2983c7f4b7f1dd7698af1c13e4011b2bdd: Status 404 returned error can't find the container with id 04ff5c4443d8650c8faecda7d9f00c2983c7f4b7f1dd7698af1c13e4011b2bdd
Sep 15 11:26:33.458930 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:33.458885    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-747c85f84b-7btht" event={"ID":"3f865a88-05c6-49da-a8e4-fe70726ce77a","Type":"ContainerStarted","Data":"aa3cbb07b477c4d22be7c30cb067d495fd9873d058f43b680316ffdf933f93ee"}
Sep 15 11:26:33.459482 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:33.459448    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-747c85f84b-7btht" event={"ID":"3f865a88-05c6-49da-a8e4-fe70726ce77a","Type":"ContainerStarted","Data":"22d6a3a810197a0ca5b546e191a6fa850c2c6ea5f3659792d08f71e588558df8"}
Sep 15 11:26:33.460907 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:33.460872    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bb459678f-5npxx" event={"ID":"ba839785-bf22-4551-8290-5c9e847a7c27","Type":"ContainerStarted","Data":"3c3f0272cf1ce4aa2901c97fce7cbd85a930587eb07ede2d0cdff8b7425f226f"}
Sep 15 11:26:33.461035 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:33.460931    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bb459678f-5npxx" event={"ID":"ba839785-bf22-4551-8290-5c9e847a7c27","Type":"ContainerStarted","Data":"04ff5c4443d8650c8faecda7d9f00c2983c7f4b7f1dd7698af1c13e4011b2bdd"}
Sep 15 11:26:33.464986 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:33.464949    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"351a8f44-b900-4b0b-9d3b-8b1e24267d1b","Type":"ContainerStarted","Data":"439674c7c501e88ae551905e20d0d7b83bc594da7b14a47349816142a67b543b"}
Sep 15 11:26:33.479108 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:33.479049    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5bb459678f-5npxx" podStartSLOduration=1.479029065 podStartE2EDuration="1.479029065s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:26:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:33.477193819 +0000 UTC m=+63.903524416" watchObservedRunningTime="2026-09-15 11:26:33.479029065 +0000 UTC m=+63.905359662"
Sep 15 11:26:33.508885 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:33.507811    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.723631222 podStartE2EDuration="9.507786349s" totalImagesPullingTime="5.764944404s" totalInitContainerRuntime="19.210723ms" isStatefulPod=false podCreationTimestamp="2026-09-15 11:26:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:33.505889603 +0000 UTC m=+63.932220237" watchObservedRunningTime="2026-09-15 11:26:33.507786349 +0000 UTC m=+63.934116946"
Sep 15 11:26:34.474185 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:34.474144    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-747c85f84b-7btht" event={"ID":"3f865a88-05c6-49da-a8e4-fe70726ce77a","Type":"ContainerStarted","Data":"ad7b39cff389cdcaaa2b72a5e7c7a81c171e305aacd0cef9b528cd2eb4a462fd"}
Sep 15 11:26:34.475201 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:34.475173    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-747c85f84b-7btht"
Sep 15 11:26:34.505772 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:34.505709    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-747c85f84b-7btht" podStartSLOduration=3.769069464 podStartE2EDuration="8.505684749s" totalImagesPullingTime="4.736615285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:26:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:34.503636213 +0000 UTC m=+64.929966809" watchObservedRunningTime="2026-09-15 11:26:34.505684749 +0000 UTC m=+64.932015346"
Sep 15 11:26:35.740392 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:35.740347    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f55f467-8c61-4930-b097-6636d194db5d-metrics-certs\") pod \"network-metrics-daemon-k79mk\" (UID: \"8f55f467-8c61-4930-b097-6636d194db5d\") " pod="openshift-multus/network-metrics-daemon-k79mk"
Sep 15 11:26:35.743055 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:35.743031    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 11:26:35.753377 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:35.753341    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f55f467-8c61-4930-b097-6636d194db5d-metrics-certs\") pod \"network-metrics-daemon-k79mk\" (UID: \"8f55f467-8c61-4930-b097-6636d194db5d\") " pod="openshift-multus/network-metrics-daemon-k79mk"
Sep 15 11:26:35.816209 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:35.816175    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4fvsz\""
Sep 15 11:26:35.824330 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:35.824291    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k79mk"
Sep 15 11:26:35.841455 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:35.841421    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c0bac93c-2a52-439c-a4a6-d4d31424d653-original-pull-secret\") pod \"global-pull-secret-syncer-q96s9\" (UID: \"c0bac93c-2a52-439c-a4a6-d4d31424d653\") " pod="kube-system/global-pull-secret-syncer-q96s9"
Sep 15 11:26:35.841679 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:35.841477    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnpxj\" (UniqueName: \"kubernetes.io/projected/80feec19-977b-483e-a7a2-f9badf61b984-kube-api-access-vnpxj\") pod \"network-check-target-zpbfk\" (UID: \"80feec19-977b-483e-a7a2-f9badf61b984\") " pod="openshift-network-diagnostics/network-check-target-zpbfk"
Sep 15 11:26:35.844095 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:35.844076    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 11:26:35.844179 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:35.844076    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 15 11:26:35.854474 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:35.854448    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c0bac93c-2a52-439c-a4a6-d4d31424d653-original-pull-secret\") pod \"global-pull-secret-syncer-q96s9\" (UID: \"c0bac93c-2a52-439c-a4a6-d4d31424d653\") " pod="kube-system/global-pull-secret-syncer-q96s9"
Sep 15 11:26:35.854700 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:35.854684    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 15 11:26:35.865628 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:35.865590    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnpxj\" (UniqueName: \"kubernetes.io/projected/80feec19-977b-483e-a7a2-f9badf61b984-kube-api-access-vnpxj\") pod \"network-check-target-zpbfk\" (UID: \"80feec19-977b-483e-a7a2-f9badf61b984\") " pod="openshift-network-diagnostics/network-check-target-zpbfk"
Sep 15 11:26:36.107872 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:36.107834    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q96s9"
Sep 15 11:26:36.120742 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:36.120717    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k79mk"]
Sep 15 11:26:36.121772 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:36.121748    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-n59hg\""
Sep 15 11:26:36.123539 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:26:36.123499    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f55f467_8c61_4930_b097_6636d194db5d.slice/crio-a60a312b0563f26ed67569f49fbc8d5172d225e7535ce4a3ad324f974680d4e0 WatchSource:0}: Error finding container a60a312b0563f26ed67569f49fbc8d5172d225e7535ce4a3ad324f974680d4e0: Status 404 returned error can't find the container with id a60a312b0563f26ed67569f49fbc8d5172d225e7535ce4a3ad324f974680d4e0
Sep 15 11:26:36.129691 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:36.129624    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zpbfk"
Sep 15 11:26:36.415483 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:36.415397    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q96s9"]
Sep 15 11:26:36.418687 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:26:36.418638    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0bac93c_2a52_439c_a4a6_d4d31424d653.slice/crio-c874e45e9f100eb996cbe382f53c1776c7f42733d99af3ad766ceff01f2e2732 WatchSource:0}: Error finding container c874e45e9f100eb996cbe382f53c1776c7f42733d99af3ad766ceff01f2e2732: Status 404 returned error can't find the container with id c874e45e9f100eb996cbe382f53c1776c7f42733d99af3ad766ceff01f2e2732
Sep 15 11:26:36.440283 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:36.440247    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zpbfk"]
Sep 15 11:26:36.442967 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:26:36.442939    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80feec19_977b_483e_a7a2_f9badf61b984.slice/crio-f9894e86f23630066489e475317c8d79f15e843a2db9fc6de49d6b57076c6765 WatchSource:0}: Error finding container f9894e86f23630066489e475317c8d79f15e843a2db9fc6de49d6b57076c6765: Status 404 returned error can't find the container with id f9894e86f23630066489e475317c8d79f15e843a2db9fc6de49d6b57076c6765
Sep 15 11:26:36.483789 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:36.483747    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k79mk" event={"ID":"8f55f467-8c61-4930-b097-6636d194db5d","Type":"ContainerStarted","Data":"a60a312b0563f26ed67569f49fbc8d5172d225e7535ce4a3ad324f974680d4e0"}
Sep 15 11:26:36.485017 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:36.484988    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zpbfk" event={"ID":"80feec19-977b-483e-a7a2-f9badf61b984","Type":"ContainerStarted","Data":"f9894e86f23630066489e475317c8d79f15e843a2db9fc6de49d6b57076c6765"}
Sep 15 11:26:36.486269 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:36.486242    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q96s9" event={"ID":"c0bac93c-2a52-439c-a4a6-d4d31424d653","Type":"ContainerStarted","Data":"c874e45e9f100eb996cbe382f53c1776c7f42733d99af3ad766ceff01f2e2732"}
Sep 15 11:26:37.495704 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:37.495598    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k79mk" event={"ID":"8f55f467-8c61-4930-b097-6636d194db5d","Type":"ContainerStarted","Data":"3b190908ae317cb4085dc8fb3b5426c8e85d0cff8db63d1540ccd212abb5b179"}
Sep 15 11:26:37.495704 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:37.495693    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k79mk" event={"ID":"8f55f467-8c61-4930-b097-6636d194db5d","Type":"ContainerStarted","Data":"5d96d805399855a458cd8dde613fb2618724a16cc7d2dcd798d1f67d762ae7d8"}
Sep 15 11:26:37.515185 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:37.515108    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-k79mk" podStartSLOduration=66.608190939 podStartE2EDuration="1m7.515078963s" totalImagesPullingTime="906.888024ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:25:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:37.514397925 +0000 UTC m=+67.940728522" watchObservedRunningTime="2026-09-15 11:26:37.515078963 +0000 UTC m=+67.941409559"
Sep 15 11:26:38.570824 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:38.570755    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b4d956f84-95wrt"
Sep 15 11:26:40.487593 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:40.487556    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-747c85f84b-7btht"
Sep 15 11:26:41.517707 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:41.517640    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zpbfk" event={"ID":"80feec19-977b-483e-a7a2-f9badf61b984","Type":"ContainerStarted","Data":"a37dacceb12fcfee596d5527143aa91beb128ad1ce54d286076db07de9b6ac1f"}
Sep 15 11:26:41.518202 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:41.517836    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zpbfk"
Sep 15 11:26:41.519557 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:41.519524    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q96s9" event={"ID":"c0bac93c-2a52-439c-a4a6-d4d31424d653","Type":"ContainerStarted","Data":"8912a754fc6d19da46c33ad788b6b93fd036f6c254b68ff84b744b06348b4565"}
Sep 15 11:26:41.538235 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:41.538167    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zpbfk" podStartSLOduration=66.655043629 podStartE2EDuration="1m11.538146573s" totalImagesPullingTime="4.883102944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:25:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:41.537050746 +0000 UTC m=+71.963381354" watchObservedRunningTime="2026-09-15 11:26:41.538146573 +0000 UTC m=+71.964477170"
Sep 15 11:26:42.941572 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:42.941535    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5bb459678f-5npxx"
Sep 15 11:26:42.941990 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:42.941590    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5bb459678f-5npxx"
Sep 15 11:26:42.946669 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:42.946631    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5bb459678f-5npxx"
Sep 15 11:26:42.965250 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:42.965191    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-q96s9" podStartSLOduration=68.058660851 podStartE2EDuration="1m12.965171695s" totalImagesPullingTime="4.906510844s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:25:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:26:41.555872145 +0000 UTC m=+71.982202743" watchObservedRunningTime="2026-09-15 11:26:42.965171695 +0000 UTC m=+73.391502290"
Sep 15 11:26:43.538217 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:43.538185    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5bb459678f-5npxx"
Sep 15 11:26:43.589117 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:43.589070    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bd6b7bfb4-hd6bh"]
Sep 15 11:26:48.170414 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:48.170371    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-86c8f6885b-7sxth"
Sep 15 11:26:48.170833 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:48.170439    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-86c8f6885b-7sxth"
Sep 15 11:26:53.229365 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:53.229209    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6b587576b5-5vnqv" podUID="f867a8e7-5a0d-491b-92ab-9376532a812d" containerName="console" containerID="cri-o://c71f93ab05e13e431a418ad8c7c7d694107f6b3128c1711cf271bebbd79b9ef0" gracePeriod=15
Sep 15 11:26:53.478604 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:53.478572    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b587576b5-5vnqv"
Sep 15 11:26:53.504358 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:53.504257    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f867a8e7-5a0d-491b-92ab-9376532a812d-service-ca\") pod \"f867a8e7-5a0d-491b-92ab-9376532a812d\" (UID: \"f867a8e7-5a0d-491b-92ab-9376532a812d\") "
Sep 15 11:26:53.504358 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:53.504315    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f867a8e7-5a0d-491b-92ab-9376532a812d-trusted-ca-bundle\") pod \"f867a8e7-5a0d-491b-92ab-9376532a812d\" (UID: \"f867a8e7-5a0d-491b-92ab-9376532a812d\") "
Sep 15 11:26:53.504358 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:53.504342    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f867a8e7-5a0d-491b-92ab-9376532a812d-console-oauth-config\") pod \"f867a8e7-5a0d-491b-92ab-9376532a812d\" (UID: \"f867a8e7-5a0d-491b-92ab-9376532a812d\") "
Sep 15 11:26:53.504633 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:53.504383    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f867a8e7-5a0d-491b-92ab-9376532a812d-oauth-serving-cert\") pod \"f867a8e7-5a0d-491b-92ab-9376532a812d\" (UID: \"f867a8e7-5a0d-491b-92ab-9376532a812d\") "
Sep 15 11:26:53.504633 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:53.504421    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8xkk\" (UniqueName: \"kubernetes.io/projected/f867a8e7-5a0d-491b-92ab-9376532a812d-kube-api-access-f8xkk\") pod \"f867a8e7-5a0d-491b-92ab-9376532a812d\" (UID: \"f867a8e7-5a0d-491b-92ab-9376532a812d\") "
Sep 15 11:26:53.504633 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:53.504444    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f867a8e7-5a0d-491b-92ab-9376532a812d-console-serving-cert\") pod \"f867a8e7-5a0d-491b-92ab-9376532a812d\" (UID: \"f867a8e7-5a0d-491b-92ab-9376532a812d\") "
Sep 15 11:26:53.504633 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:53.504479    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f867a8e7-5a0d-491b-92ab-9376532a812d-console-config\") pod \"f867a8e7-5a0d-491b-92ab-9376532a812d\" (UID: \"f867a8e7-5a0d-491b-92ab-9376532a812d\") "
Sep 15 11:26:53.505271 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:53.505207    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f867a8e7-5a0d-491b-92ab-9376532a812d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f867a8e7-5a0d-491b-92ab-9376532a812d" (UID: "f867a8e7-5a0d-491b-92ab-9376532a812d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:26:53.505271 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:53.505237    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f867a8e7-5a0d-491b-92ab-9376532a812d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f867a8e7-5a0d-491b-92ab-9376532a812d" (UID: "f867a8e7-5a0d-491b-92ab-9376532a812d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:26:53.505527 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:53.505321    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f867a8e7-5a0d-491b-92ab-9376532a812d-service-ca" (OuterVolumeSpecName: "service-ca") pod "f867a8e7-5a0d-491b-92ab-9376532a812d" (UID: "f867a8e7-5a0d-491b-92ab-9376532a812d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:26:53.505527 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:53.505421    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f867a8e7-5a0d-491b-92ab-9376532a812d-console-config" (OuterVolumeSpecName: "console-config") pod "f867a8e7-5a0d-491b-92ab-9376532a812d" (UID: "f867a8e7-5a0d-491b-92ab-9376532a812d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:26:53.507304 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:53.507261    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f867a8e7-5a0d-491b-92ab-9376532a812d-kube-api-access-f8xkk" (OuterVolumeSpecName: "kube-api-access-f8xkk") pod "f867a8e7-5a0d-491b-92ab-9376532a812d" (UID: "f867a8e7-5a0d-491b-92ab-9376532a812d"). InnerVolumeSpecName "kube-api-access-f8xkk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:26:53.507411 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:53.507269    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f867a8e7-5a0d-491b-92ab-9376532a812d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f867a8e7-5a0d-491b-92ab-9376532a812d" (UID: "f867a8e7-5a0d-491b-92ab-9376532a812d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:26:53.507411 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:53.507327    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f867a8e7-5a0d-491b-92ab-9376532a812d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f867a8e7-5a0d-491b-92ab-9376532a812d" (UID: "f867a8e7-5a0d-491b-92ab-9376532a812d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:26:53.579717 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:53.579679    2575 generic.go:356] "Generic (PLEG): container finished" podID="f867a8e7-5a0d-491b-92ab-9376532a812d" containerID="c71f93ab05e13e431a418ad8c7c7d694107f6b3128c1711cf271bebbd79b9ef0" exitCode=0
Sep 15 11:26:53.579919 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:53.579727    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b587576b5-5vnqv"
Sep 15 11:26:53.579919 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:53.579763    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b587576b5-5vnqv" event={"ID":"f867a8e7-5a0d-491b-92ab-9376532a812d","Type":"ContainerDied","Data":"c71f93ab05e13e431a418ad8c7c7d694107f6b3128c1711cf271bebbd79b9ef0"}
Sep 15 11:26:53.579919 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:53.579825    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b587576b5-5vnqv" event={"ID":"f867a8e7-5a0d-491b-92ab-9376532a812d","Type":"ContainerDied","Data":"f31f3cb230ef1b6a53ed80b603d9b345a461cdac247327fb6dbe5d400d052924"}
Sep 15 11:26:53.579919 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:53.579852    2575 scope.go:117] "RemoveContainer" containerID="c71f93ab05e13e431a418ad8c7c7d694107f6b3128c1711cf271bebbd79b9ef0"
Sep 15 11:26:53.590001 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:53.589975    2575 scope.go:117] "RemoveContainer" containerID="c71f93ab05e13e431a418ad8c7c7d694107f6b3128c1711cf271bebbd79b9ef0"
Sep 15 11:26:53.590339 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:26:53.590320    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c71f93ab05e13e431a418ad8c7c7d694107f6b3128c1711cf271bebbd79b9ef0\": container with ID starting with c71f93ab05e13e431a418ad8c7c7d694107f6b3128c1711cf271bebbd79b9ef0 not found: ID does not exist" containerID="c71f93ab05e13e431a418ad8c7c7d694107f6b3128c1711cf271bebbd79b9ef0"
Sep 15 11:26:53.590382 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:53.590349    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c71f93ab05e13e431a418ad8c7c7d694107f6b3128c1711cf271bebbd79b9ef0"} err="failed to get container status \"c71f93ab05e13e431a418ad8c7c7d694107f6b3128c1711cf271bebbd79b9ef0\": rpc error: code = NotFound desc = could not find container \"c71f93ab05e13e431a418ad8c7c7d694107f6b3128c1711cf271bebbd79b9ef0\": container with ID starting with c71f93ab05e13e431a418ad8c7c7d694107f6b3128c1711cf271bebbd79b9ef0 not found: ID does not exist"
Sep 15 11:26:53.601203 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:53.601162    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b587576b5-5vnqv"]
Sep 15 11:26:53.604699 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:53.604645    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b587576b5-5vnqv"]
Sep 15 11:26:53.605062 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:53.605043    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f867a8e7-5a0d-491b-92ab-9376532a812d-service-ca\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:26:53.605118 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:53.605066    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f867a8e7-5a0d-491b-92ab-9376532a812d-trusted-ca-bundle\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:26:53.605118 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:53.605076    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f867a8e7-5a0d-491b-92ab-9376532a812d-console-oauth-config\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:26:53.605118 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:53.605087    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f867a8e7-5a0d-491b-92ab-9376532a812d-oauth-serving-cert\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:26:53.605118 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:53.605097    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8xkk\" (UniqueName: \"kubernetes.io/projected/f867a8e7-5a0d-491b-92ab-9376532a812d-kube-api-access-f8xkk\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:26:53.605118 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:53.605107    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f867a8e7-5a0d-491b-92ab-9376532a812d-console-serving-cert\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:26:53.605118 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:53.605116    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f867a8e7-5a0d-491b-92ab-9376532a812d-console-config\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:26:54.093234 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:54.093204    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f867a8e7-5a0d-491b-92ab-9376532a812d" path="/var/lib/kubelet/pods/f867a8e7-5a0d-491b-92ab-9376532a812d/volumes"
Sep 15 11:26:57.617546 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:57.617480    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6b4d956f84-95wrt" podUID="aec1d8e8-5b41-45b7-a02e-c32090c94a09" containerName="console" containerID="cri-o://3b73289a5fc2155446c8731fe5e7385731cbdaf8b73d5b21e29b3b2228dbc9e6" gracePeriod=15
Sep 15 11:26:57.864981 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:57.864949    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b4d956f84-95wrt"
Sep 15 11:26:57.938962 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:57.938866    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aec1d8e8-5b41-45b7-a02e-c32090c94a09-trusted-ca-bundle\") pod \"aec1d8e8-5b41-45b7-a02e-c32090c94a09\" (UID: \"aec1d8e8-5b41-45b7-a02e-c32090c94a09\") "
Sep 15 11:26:57.938962 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:57.938908    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aec1d8e8-5b41-45b7-a02e-c32090c94a09-oauth-serving-cert\") pod \"aec1d8e8-5b41-45b7-a02e-c32090c94a09\" (UID: \"aec1d8e8-5b41-45b7-a02e-c32090c94a09\") "
Sep 15 11:26:57.938962 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:57.938927    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spfnj\" (UniqueName: \"kubernetes.io/projected/aec1d8e8-5b41-45b7-a02e-c32090c94a09-kube-api-access-spfnj\") pod \"aec1d8e8-5b41-45b7-a02e-c32090c94a09\" (UID: \"aec1d8e8-5b41-45b7-a02e-c32090c94a09\") "
Sep 15 11:26:57.938962 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:57.938965    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aec1d8e8-5b41-45b7-a02e-c32090c94a09-console-serving-cert\") pod \"aec1d8e8-5b41-45b7-a02e-c32090c94a09\" (UID: \"aec1d8e8-5b41-45b7-a02e-c32090c94a09\") "
Sep 15 11:26:57.939299 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:57.938992    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aec1d8e8-5b41-45b7-a02e-c32090c94a09-console-oauth-config\") pod \"aec1d8e8-5b41-45b7-a02e-c32090c94a09\" (UID: \"aec1d8e8-5b41-45b7-a02e-c32090c94a09\") "
Sep 15 11:26:57.939299 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:57.939076    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aec1d8e8-5b41-45b7-a02e-c32090c94a09-service-ca\") pod \"aec1d8e8-5b41-45b7-a02e-c32090c94a09\" (UID: \"aec1d8e8-5b41-45b7-a02e-c32090c94a09\") "
Sep 15 11:26:57.939299 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:57.939111    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aec1d8e8-5b41-45b7-a02e-c32090c94a09-console-config\") pod \"aec1d8e8-5b41-45b7-a02e-c32090c94a09\" (UID: \"aec1d8e8-5b41-45b7-a02e-c32090c94a09\") "
Sep 15 11:26:57.939450 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:57.939342    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aec1d8e8-5b41-45b7-a02e-c32090c94a09-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "aec1d8e8-5b41-45b7-a02e-c32090c94a09" (UID: "aec1d8e8-5b41-45b7-a02e-c32090c94a09"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:26:57.939589 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:57.939554    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aec1d8e8-5b41-45b7-a02e-c32090c94a09-console-config" (OuterVolumeSpecName: "console-config") pod "aec1d8e8-5b41-45b7-a02e-c32090c94a09" (UID: "aec1d8e8-5b41-45b7-a02e-c32090c94a09"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:26:57.939738 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:57.939592    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aec1d8e8-5b41-45b7-a02e-c32090c94a09-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "aec1d8e8-5b41-45b7-a02e-c32090c94a09" (UID: "aec1d8e8-5b41-45b7-a02e-c32090c94a09"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:26:57.939738 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:57.939721    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aec1d8e8-5b41-45b7-a02e-c32090c94a09-service-ca" (OuterVolumeSpecName: "service-ca") pod "aec1d8e8-5b41-45b7-a02e-c32090c94a09" (UID: "aec1d8e8-5b41-45b7-a02e-c32090c94a09"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:26:57.941294 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:57.941266    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aec1d8e8-5b41-45b7-a02e-c32090c94a09-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "aec1d8e8-5b41-45b7-a02e-c32090c94a09" (UID: "aec1d8e8-5b41-45b7-a02e-c32090c94a09"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:26:57.941384 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:57.941300    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aec1d8e8-5b41-45b7-a02e-c32090c94a09-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "aec1d8e8-5b41-45b7-a02e-c32090c94a09" (UID: "aec1d8e8-5b41-45b7-a02e-c32090c94a09"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:26:57.941580 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:57.941557    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aec1d8e8-5b41-45b7-a02e-c32090c94a09-kube-api-access-spfnj" (OuterVolumeSpecName: "kube-api-access-spfnj") pod "aec1d8e8-5b41-45b7-a02e-c32090c94a09" (UID: "aec1d8e8-5b41-45b7-a02e-c32090c94a09"). InnerVolumeSpecName "kube-api-access-spfnj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:26:58.039945 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:58.039902    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aec1d8e8-5b41-45b7-a02e-c32090c94a09-service-ca\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:26:58.039945 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:58.039933    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aec1d8e8-5b41-45b7-a02e-c32090c94a09-console-config\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:26:58.039945 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:58.039941    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aec1d8e8-5b41-45b7-a02e-c32090c94a09-trusted-ca-bundle\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:26:58.039945 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:58.039950    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aec1d8e8-5b41-45b7-a02e-c32090c94a09-oauth-serving-cert\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:26:58.039945 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:58.039959    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spfnj\" (UniqueName: \"kubernetes.io/projected/aec1d8e8-5b41-45b7-a02e-c32090c94a09-kube-api-access-spfnj\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:26:58.040255 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:58.039968    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aec1d8e8-5b41-45b7-a02e-c32090c94a09-console-serving-cert\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:26:58.040255 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:58.039976    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aec1d8e8-5b41-45b7-a02e-c32090c94a09-console-oauth-config\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:26:58.603988 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:58.603942    2575 generic.go:356] "Generic (PLEG): container finished" podID="aec1d8e8-5b41-45b7-a02e-c32090c94a09" containerID="3b73289a5fc2155446c8731fe5e7385731cbdaf8b73d5b21e29b3b2228dbc9e6" exitCode=0
Sep 15 11:26:58.603988 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:58.603987    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b4d956f84-95wrt"
Sep 15 11:26:58.604224 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:58.604024    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b4d956f84-95wrt" event={"ID":"aec1d8e8-5b41-45b7-a02e-c32090c94a09","Type":"ContainerDied","Data":"3b73289a5fc2155446c8731fe5e7385731cbdaf8b73d5b21e29b3b2228dbc9e6"}
Sep 15 11:26:58.604224 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:58.604089    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b4d956f84-95wrt" event={"ID":"aec1d8e8-5b41-45b7-a02e-c32090c94a09","Type":"ContainerDied","Data":"39e887f671d9b7bef39ab9aadf687128e95c9256ebb3e80f0762676d84e10970"}
Sep 15 11:26:58.604224 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:58.604111    2575 scope.go:117] "RemoveContainer" containerID="3b73289a5fc2155446c8731fe5e7385731cbdaf8b73d5b21e29b3b2228dbc9e6"
Sep 15 11:26:58.613909 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:58.613887    2575 scope.go:117] "RemoveContainer" containerID="3b73289a5fc2155446c8731fe5e7385731cbdaf8b73d5b21e29b3b2228dbc9e6"
Sep 15 11:26:58.614324 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:26:58.614299    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b73289a5fc2155446c8731fe5e7385731cbdaf8b73d5b21e29b3b2228dbc9e6\": container with ID starting with 3b73289a5fc2155446c8731fe5e7385731cbdaf8b73d5b21e29b3b2228dbc9e6 not found: ID does not exist" containerID="3b73289a5fc2155446c8731fe5e7385731cbdaf8b73d5b21e29b3b2228dbc9e6"
Sep 15 11:26:58.614412 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:58.614334    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b73289a5fc2155446c8731fe5e7385731cbdaf8b73d5b21e29b3b2228dbc9e6"} err="failed to get container status \"3b73289a5fc2155446c8731fe5e7385731cbdaf8b73d5b21e29b3b2228dbc9e6\": rpc error: code = NotFound desc = could not find container \"3b73289a5fc2155446c8731fe5e7385731cbdaf8b73d5b21e29b3b2228dbc9e6\": container with ID starting with 3b73289a5fc2155446c8731fe5e7385731cbdaf8b73d5b21e29b3b2228dbc9e6 not found: ID does not exist"
Sep 15 11:26:58.625508 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:58.625467    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b4d956f84-95wrt"]
Sep 15 11:26:58.629195 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:26:58.629164    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b4d956f84-95wrt"]
Sep 15 11:27:00.092313 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:00.092276    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aec1d8e8-5b41-45b7-a02e-c32090c94a09" path="/var/lib/kubelet/pods/aec1d8e8-5b41-45b7-a02e-c32090c94a09/volumes"
Sep 15 11:27:08.176882 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:08.176836    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-86c8f6885b-7sxth"
Sep 15 11:27:08.181127 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:08.181095    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-86c8f6885b-7sxth"
Sep 15 11:27:08.609711 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:08.609668    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-bd6b7bfb4-hd6bh" podUID="9f61610b-f474-421c-b419-b53055b169f8" containerName="console" containerID="cri-o://5fa8b3180f8d90ee54ebea9d99f481b1ead417a7ca4763032065d7bd0dbdcc39" gracePeriod=15
Sep 15 11:27:08.879594 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:08.879561    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bd6b7bfb4-hd6bh"
Sep 15 11:27:08.941341 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:08.940960    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f61610b-f474-421c-b419-b53055b169f8-console-serving-cert\") pod \"9f61610b-f474-421c-b419-b53055b169f8\" (UID: \"9f61610b-f474-421c-b419-b53055b169f8\") "
Sep 15 11:27:08.941341 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:08.941018    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-blshv\" (UniqueName: \"kubernetes.io/projected/9f61610b-f474-421c-b419-b53055b169f8-kube-api-access-blshv\") pod \"9f61610b-f474-421c-b419-b53055b169f8\" (UID: \"9f61610b-f474-421c-b419-b53055b169f8\") "
Sep 15 11:27:08.941341 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:08.941044    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f61610b-f474-421c-b419-b53055b169f8-service-ca\") pod \"9f61610b-f474-421c-b419-b53055b169f8\" (UID: \"9f61610b-f474-421c-b419-b53055b169f8\") "
Sep 15 11:27:08.941341 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:08.941144    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f61610b-f474-421c-b419-b53055b169f8-oauth-serving-cert\") pod \"9f61610b-f474-421c-b419-b53055b169f8\" (UID: \"9f61610b-f474-421c-b419-b53055b169f8\") "
Sep 15 11:27:08.941341 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:08.941165    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f61610b-f474-421c-b419-b53055b169f8-console-oauth-config\") pod \"9f61610b-f474-421c-b419-b53055b169f8\" (UID: \"9f61610b-f474-421c-b419-b53055b169f8\") "
Sep 15 11:27:08.941341 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:08.941208    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f61610b-f474-421c-b419-b53055b169f8-console-config\") pod \"9f61610b-f474-421c-b419-b53055b169f8\" (UID: \"9f61610b-f474-421c-b419-b53055b169f8\") "
Sep 15 11:27:08.942124 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:08.941815    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f61610b-f474-421c-b419-b53055b169f8-service-ca" (OuterVolumeSpecName: "service-ca") pod "9f61610b-f474-421c-b419-b53055b169f8" (UID: "9f61610b-f474-421c-b419-b53055b169f8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:27:08.942124 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:08.941982    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f61610b-f474-421c-b419-b53055b169f8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9f61610b-f474-421c-b419-b53055b169f8" (UID: "9f61610b-f474-421c-b419-b53055b169f8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:27:08.942293 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:08.942172    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f61610b-f474-421c-b419-b53055b169f8-console-config" (OuterVolumeSpecName: "console-config") pod "9f61610b-f474-421c-b419-b53055b169f8" (UID: "9f61610b-f474-421c-b419-b53055b169f8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:27:08.944254 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:08.944206    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f61610b-f474-421c-b419-b53055b169f8-kube-api-access-blshv" (OuterVolumeSpecName: "kube-api-access-blshv") pod "9f61610b-f474-421c-b419-b53055b169f8" (UID: "9f61610b-f474-421c-b419-b53055b169f8"). InnerVolumeSpecName "kube-api-access-blshv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:27:08.944396 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:08.944290    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f61610b-f474-421c-b419-b53055b169f8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9f61610b-f474-421c-b419-b53055b169f8" (UID: "9f61610b-f474-421c-b419-b53055b169f8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:27:08.944516 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:08.944491    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f61610b-f474-421c-b419-b53055b169f8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9f61610b-f474-421c-b419-b53055b169f8" (UID: "9f61610b-f474-421c-b419-b53055b169f8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:27:09.043022 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:09.042984    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f61610b-f474-421c-b419-b53055b169f8-oauth-serving-cert\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:27:09.043022 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:09.043023    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f61610b-f474-421c-b419-b53055b169f8-console-oauth-config\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:27:09.043227 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:09.043038    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f61610b-f474-421c-b419-b53055b169f8-console-config\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:27:09.043227 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:09.043051    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f61610b-f474-421c-b419-b53055b169f8-console-serving-cert\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:27:09.043227 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:09.043065    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-blshv\" (UniqueName: \"kubernetes.io/projected/9f61610b-f474-421c-b419-b53055b169f8-kube-api-access-blshv\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:27:09.043227 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:09.043078    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f61610b-f474-421c-b419-b53055b169f8-service-ca\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:27:09.657111 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:09.657079    2575 generic.go:356] "Generic (PLEG): container finished" podID="9f61610b-f474-421c-b419-b53055b169f8" containerID="5fa8b3180f8d90ee54ebea9d99f481b1ead417a7ca4763032065d7bd0dbdcc39" exitCode=0
Sep 15 11:27:09.657507 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:09.657121    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bd6b7bfb4-hd6bh"
Sep 15 11:27:09.657507 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:09.657165    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bd6b7bfb4-hd6bh" event={"ID":"9f61610b-f474-421c-b419-b53055b169f8","Type":"ContainerDied","Data":"5fa8b3180f8d90ee54ebea9d99f481b1ead417a7ca4763032065d7bd0dbdcc39"}
Sep 15 11:27:09.657507 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:09.657228    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bd6b7bfb4-hd6bh" event={"ID":"9f61610b-f474-421c-b419-b53055b169f8","Type":"ContainerDied","Data":"69a0aef75ab7ef65e4b81d1afae468c205088df6b057c9c88e785c060c2eb1e2"}
Sep 15 11:27:09.657507 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:09.657258    2575 scope.go:117] "RemoveContainer" containerID="5fa8b3180f8d90ee54ebea9d99f481b1ead417a7ca4763032065d7bd0dbdcc39"
Sep 15 11:27:09.667905 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:09.667878    2575 scope.go:117] "RemoveContainer" containerID="5fa8b3180f8d90ee54ebea9d99f481b1ead417a7ca4763032065d7bd0dbdcc39"
Sep 15 11:27:09.668288 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:27:09.668263    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fa8b3180f8d90ee54ebea9d99f481b1ead417a7ca4763032065d7bd0dbdcc39\": container with ID starting with 5fa8b3180f8d90ee54ebea9d99f481b1ead417a7ca4763032065d7bd0dbdcc39 not found: ID does not exist" containerID="5fa8b3180f8d90ee54ebea9d99f481b1ead417a7ca4763032065d7bd0dbdcc39"
Sep 15 11:27:09.668367 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:09.668298    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fa8b3180f8d90ee54ebea9d99f481b1ead417a7ca4763032065d7bd0dbdcc39"} err="failed to get container status \"5fa8b3180f8d90ee54ebea9d99f481b1ead417a7ca4763032065d7bd0dbdcc39\": rpc error: code = NotFound desc = could not find container \"5fa8b3180f8d90ee54ebea9d99f481b1ead417a7ca4763032065d7bd0dbdcc39\": container with ID starting with 5fa8b3180f8d90ee54ebea9d99f481b1ead417a7ca4763032065d7bd0dbdcc39 not found: ID does not exist"
Sep 15 11:27:09.677926 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:09.677893    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bd6b7bfb4-hd6bh"]
Sep 15 11:27:09.682204 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:09.682120    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bd6b7bfb4-hd6bh"]
Sep 15 11:27:10.094809 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:10.094768    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f61610b-f474-421c-b419-b53055b169f8" path="/var/lib/kubelet/pods/9f61610b-f474-421c-b419-b53055b169f8/volumes"
Sep 15 11:27:12.527337 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:12.527295    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zpbfk"
Sep 15 11:27:43.694096 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:43.694057    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 11:27:43.694561 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:43.694362    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="351a8f44-b900-4b0b-9d3b-8b1e24267d1b" containerName="alertmanager" containerID="cri-o://2930e5ab390539a3d6de7dee6b130f36511404a98b0994b1363e7af455532ddf" gracePeriod=120
Sep 15 11:27:43.694561 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:43.694442    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="351a8f44-b900-4b0b-9d3b-8b1e24267d1b" containerName="kube-rbac-proxy-web" containerID="cri-o://5d9ca4d4d60339a74dd33d858363ecc867578283218ffe01a47a964240ec8e45" gracePeriod=120
Sep 15 11:27:43.694561 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:43.694482    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="351a8f44-b900-4b0b-9d3b-8b1e24267d1b" containerName="prom-label-proxy" containerID="cri-o://439674c7c501e88ae551905e20d0d7b83bc594da7b14a47349816142a67b543b" gracePeriod=120
Sep 15 11:27:43.694561 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:43.694514    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="351a8f44-b900-4b0b-9d3b-8b1e24267d1b" containerName="kube-rbac-proxy" containerID="cri-o://8a8e3e6487d24d77ef9ed57e80655e85f033e3533e84bd75432f76e281ae2ba5" gracePeriod=120
Sep 15 11:27:43.694561 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:43.694429    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="351a8f44-b900-4b0b-9d3b-8b1e24267d1b" containerName="kube-rbac-proxy-metric" containerID="cri-o://03658fb3132cc3ca0c70f2b9ca5fb6a80b444a9a6813b544246bce92bca4d621" gracePeriod=120
Sep 15 11:27:43.694844 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:43.694524    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="351a8f44-b900-4b0b-9d3b-8b1e24267d1b" containerName="config-reloader" containerID="cri-o://22dd4cf524e1e93465e7a8c504140f5ad0dc2d0f0de6a9d1088c9dc2dafe5dd4" gracePeriod=120
Sep 15 11:27:43.821266 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:43.821231    2575 generic.go:356] "Generic (PLEG): container finished" podID="351a8f44-b900-4b0b-9d3b-8b1e24267d1b" containerID="439674c7c501e88ae551905e20d0d7b83bc594da7b14a47349816142a67b543b" exitCode=0
Sep 15 11:27:43.821266 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:43.821256    2575 generic.go:356] "Generic (PLEG): container finished" podID="351a8f44-b900-4b0b-9d3b-8b1e24267d1b" containerID="8a8e3e6487d24d77ef9ed57e80655e85f033e3533e84bd75432f76e281ae2ba5" exitCode=0
Sep 15 11:27:43.821266 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:43.821265    2575 generic.go:356] "Generic (PLEG): container finished" podID="351a8f44-b900-4b0b-9d3b-8b1e24267d1b" containerID="22dd4cf524e1e93465e7a8c504140f5ad0dc2d0f0de6a9d1088c9dc2dafe5dd4" exitCode=0
Sep 15 11:27:43.821266 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:43.821272    2575 generic.go:356] "Generic (PLEG): container finished" podID="351a8f44-b900-4b0b-9d3b-8b1e24267d1b" containerID="2930e5ab390539a3d6de7dee6b130f36511404a98b0994b1363e7af455532ddf" exitCode=0
Sep 15 11:27:43.821552 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:43.821309    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"351a8f44-b900-4b0b-9d3b-8b1e24267d1b","Type":"ContainerDied","Data":"439674c7c501e88ae551905e20d0d7b83bc594da7b14a47349816142a67b543b"}
Sep 15 11:27:43.821552 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:43.821379    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"351a8f44-b900-4b0b-9d3b-8b1e24267d1b","Type":"ContainerDied","Data":"8a8e3e6487d24d77ef9ed57e80655e85f033e3533e84bd75432f76e281ae2ba5"}
Sep 15 11:27:43.821552 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:43.821410    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"351a8f44-b900-4b0b-9d3b-8b1e24267d1b","Type":"ContainerDied","Data":"22dd4cf524e1e93465e7a8c504140f5ad0dc2d0f0de6a9d1088c9dc2dafe5dd4"}
Sep 15 11:27:43.821552 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:43.821434    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"351a8f44-b900-4b0b-9d3b-8b1e24267d1b","Type":"ContainerDied","Data":"2930e5ab390539a3d6de7dee6b130f36511404a98b0994b1363e7af455532ddf"}
Sep 15 11:27:44.830182 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:44.830151    2575 generic.go:356] "Generic (PLEG): container finished" podID="351a8f44-b900-4b0b-9d3b-8b1e24267d1b" containerID="03658fb3132cc3ca0c70f2b9ca5fb6a80b444a9a6813b544246bce92bca4d621" exitCode=0
Sep 15 11:27:44.830182 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:44.830176    2575 generic.go:356] "Generic (PLEG): container finished" podID="351a8f44-b900-4b0b-9d3b-8b1e24267d1b" containerID="5d9ca4d4d60339a74dd33d858363ecc867578283218ffe01a47a964240ec8e45" exitCode=0
Sep 15 11:27:44.830590 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:44.830219    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"351a8f44-b900-4b0b-9d3b-8b1e24267d1b","Type":"ContainerDied","Data":"03658fb3132cc3ca0c70f2b9ca5fb6a80b444a9a6813b544246bce92bca4d621"}
Sep 15 11:27:44.830590 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:44.830287    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"351a8f44-b900-4b0b-9d3b-8b1e24267d1b","Type":"ContainerDied","Data":"5d9ca4d4d60339a74dd33d858363ecc867578283218ffe01a47a964240ec8e45"}
Sep 15 11:27:44.946423 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:44.946390    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:44.958838 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:44.958807    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-cluster-tls-config\") pod \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") "
Sep 15 11:27:44.959028 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:44.958864    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-config-volume\") pod \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") "
Sep 15 11:27:44.959028 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:44.958899    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-config-out\") pod \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") "
Sep 15 11:27:44.959028 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:44.958923    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-alertmanager-main-db\") pod \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") "
Sep 15 11:27:44.959028 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:44.958941    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-tls-assets\") pod \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") "
Sep 15 11:27:44.959028 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:44.958966    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-secret-alertmanager-kube-rbac-proxy\") pod \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") "
Sep 15 11:27:44.959028 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:44.959019    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-metrics-client-ca\") pod \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") "
Sep 15 11:27:44.959353 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:44.959250    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-secret-alertmanager-kube-rbac-proxy-web\") pod \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") "
Sep 15 11:27:44.959353 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:44.959278    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "351a8f44-b900-4b0b-9d3b-8b1e24267d1b" (UID: "351a8f44-b900-4b0b-9d3b-8b1e24267d1b"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:27:44.959353 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:44.959303    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-secret-alertmanager-main-tls\") pod \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") "
Sep 15 11:27:44.959353 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:44.959337    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vg5vt\" (UniqueName: \"kubernetes.io/projected/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-kube-api-access-vg5vt\") pod \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") "
Sep 15 11:27:44.959552 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:44.959366    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") "
Sep 15 11:27:44.959552 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:44.959392    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-web-config\") pod \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") "
Sep 15 11:27:44.960170 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:44.960017    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "351a8f44-b900-4b0b-9d3b-8b1e24267d1b" (UID: "351a8f44-b900-4b0b-9d3b-8b1e24267d1b"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:27:44.961117 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:44.960340    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-alertmanager-trusted-ca-bundle\") pod \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\" (UID: \"351a8f44-b900-4b0b-9d3b-8b1e24267d1b\") "
Sep 15 11:27:44.961117 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:44.960642    2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-alertmanager-main-db\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:27:44.961117 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:44.960680    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-metrics-client-ca\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:27:44.961117 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:44.961069    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "351a8f44-b900-4b0b-9d3b-8b1e24267d1b" (UID: "351a8f44-b900-4b0b-9d3b-8b1e24267d1b"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:27:44.962608 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:44.962562    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "351a8f44-b900-4b0b-9d3b-8b1e24267d1b" (UID: "351a8f44-b900-4b0b-9d3b-8b1e24267d1b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:27:44.962783 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:44.962754    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "351a8f44-b900-4b0b-9d3b-8b1e24267d1b" (UID: "351a8f44-b900-4b0b-9d3b-8b1e24267d1b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:27:44.963090 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:44.963052    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-config-volume" (OuterVolumeSpecName: "config-volume") pod "351a8f44-b900-4b0b-9d3b-8b1e24267d1b" (UID: "351a8f44-b900-4b0b-9d3b-8b1e24267d1b"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:27:44.963179 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:44.963148    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-config-out" (OuterVolumeSpecName: "config-out") pod "351a8f44-b900-4b0b-9d3b-8b1e24267d1b" (UID: "351a8f44-b900-4b0b-9d3b-8b1e24267d1b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:27:44.963318 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:44.963289    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "351a8f44-b900-4b0b-9d3b-8b1e24267d1b" (UID: "351a8f44-b900-4b0b-9d3b-8b1e24267d1b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:27:44.963434 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:44.963349    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-kube-api-access-vg5vt" (OuterVolumeSpecName: "kube-api-access-vg5vt") pod "351a8f44-b900-4b0b-9d3b-8b1e24267d1b" (UID: "351a8f44-b900-4b0b-9d3b-8b1e24267d1b"). InnerVolumeSpecName "kube-api-access-vg5vt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:27:44.963692 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:44.963639    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "351a8f44-b900-4b0b-9d3b-8b1e24267d1b" (UID: "351a8f44-b900-4b0b-9d3b-8b1e24267d1b"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:27:44.964242 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:44.964219    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "351a8f44-b900-4b0b-9d3b-8b1e24267d1b" (UID: "351a8f44-b900-4b0b-9d3b-8b1e24267d1b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:27:44.967394 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:44.967341    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "351a8f44-b900-4b0b-9d3b-8b1e24267d1b" (UID: "351a8f44-b900-4b0b-9d3b-8b1e24267d1b"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:27:44.974845 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:44.974811    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-web-config" (OuterVolumeSpecName: "web-config") pod "351a8f44-b900-4b0b-9d3b-8b1e24267d1b" (UID: "351a8f44-b900-4b0b-9d3b-8b1e24267d1b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:27:45.061203 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.061081    2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:27:45.061203 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.061136    2575 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-cluster-tls-config\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:27:45.061203 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.061147    2575 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-config-volume\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:27:45.061203 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.061155    2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-config-out\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:27:45.061203 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.061164    2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-tls-assets\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:27:45.061203 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.061172    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:27:45.061203 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.061181    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:27:45.061203 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.061190    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-secret-alertmanager-main-tls\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:27:45.061203 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.061201    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vg5vt\" (UniqueName: \"kubernetes.io/projected/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-kube-api-access-vg5vt\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:27:45.061203 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.061211    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:27:45.061203 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.061220    2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/351a8f44-b900-4b0b-9d3b-8b1e24267d1b-web-config\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:27:45.838352 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.838313    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"351a8f44-b900-4b0b-9d3b-8b1e24267d1b","Type":"ContainerDied","Data":"ad1ab30ae74b1f98406bc16542d777f5502c417ebd067aa5ca64cfd0f5d60386"}
Sep 15 11:27:45.838774 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.838366    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:45.838774 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.838415    2575 scope.go:117] "RemoveContainer" containerID="439674c7c501e88ae551905e20d0d7b83bc594da7b14a47349816142a67b543b"
Sep 15 11:27:45.846116 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.846094    2575 scope.go:117] "RemoveContainer" containerID="03658fb3132cc3ca0c70f2b9ca5fb6a80b444a9a6813b544246bce92bca4d621"
Sep 15 11:27:45.853161 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.853141    2575 scope.go:117] "RemoveContainer" containerID="8a8e3e6487d24d77ef9ed57e80655e85f033e3533e84bd75432f76e281ae2ba5"
Sep 15 11:27:45.860369 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.860347    2575 scope.go:117] "RemoveContainer" containerID="5d9ca4d4d60339a74dd33d858363ecc867578283218ffe01a47a964240ec8e45"
Sep 15 11:27:45.862970 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.862940    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 11:27:45.867318 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.867289    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 11:27:45.869699 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.869682    2575 scope.go:117] "RemoveContainer" containerID="22dd4cf524e1e93465e7a8c504140f5ad0dc2d0f0de6a9d1088c9dc2dafe5dd4"
Sep 15 11:27:45.878408 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.878383    2575 scope.go:117] "RemoveContainer" containerID="2930e5ab390539a3d6de7dee6b130f36511404a98b0994b1363e7af455532ddf"
Sep 15 11:27:45.887460 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.887433    2575 scope.go:117] "RemoveContainer" containerID="d071e7a872fb31bef83c3ab0ad1330d3735cff49b188a018b4016925082c193c"
Sep 15 11:27:45.892941 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.892911    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 11:27:45.893277 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.893244    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="351a8f44-b900-4b0b-9d3b-8b1e24267d1b" containerName="init-config-reloader"
Sep 15 11:27:45.893277 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.893260    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="351a8f44-b900-4b0b-9d3b-8b1e24267d1b" containerName="init-config-reloader"
Sep 15 11:27:45.893277 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.893272    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f867a8e7-5a0d-491b-92ab-9376532a812d" containerName="console"
Sep 15 11:27:45.893277 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.893277    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f867a8e7-5a0d-491b-92ab-9376532a812d" containerName="console"
Sep 15 11:27:45.893413 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.893285    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="351a8f44-b900-4b0b-9d3b-8b1e24267d1b" containerName="kube-rbac-proxy-metric"
Sep 15 11:27:45.893413 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.893291    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="351a8f44-b900-4b0b-9d3b-8b1e24267d1b" containerName="kube-rbac-proxy-metric"
Sep 15 11:27:45.893413 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.893301    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f61610b-f474-421c-b419-b53055b169f8" containerName="console"
Sep 15 11:27:45.893413 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.893307    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f61610b-f474-421c-b419-b53055b169f8" containerName="console"
Sep 15 11:27:45.893413 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.893313    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="351a8f44-b900-4b0b-9d3b-8b1e24267d1b" containerName="config-reloader"
Sep 15 11:27:45.893413 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.893319    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="351a8f44-b900-4b0b-9d3b-8b1e24267d1b" containerName="config-reloader"
Sep 15 11:27:45.893413 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.893329    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="351a8f44-b900-4b0b-9d3b-8b1e24267d1b" containerName="kube-rbac-proxy"
Sep 15 11:27:45.893413 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.893335    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="351a8f44-b900-4b0b-9d3b-8b1e24267d1b" containerName="kube-rbac-proxy"
Sep 15 11:27:45.893413 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.893344    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="351a8f44-b900-4b0b-9d3b-8b1e24267d1b" containerName="kube-rbac-proxy-web"
Sep 15 11:27:45.893413 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.893350    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="351a8f44-b900-4b0b-9d3b-8b1e24267d1b" containerName="kube-rbac-proxy-web"
Sep 15 11:27:45.893413 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.893360    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="351a8f44-b900-4b0b-9d3b-8b1e24267d1b" containerName="alertmanager"
Sep 15 11:27:45.893413 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.893365    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="351a8f44-b900-4b0b-9d3b-8b1e24267d1b" containerName="alertmanager"
Sep 15 11:27:45.893413 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.893372    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="351a8f44-b900-4b0b-9d3b-8b1e24267d1b" containerName="prom-label-proxy"
Sep 15 11:27:45.893413 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.893378    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="351a8f44-b900-4b0b-9d3b-8b1e24267d1b" containerName="prom-label-proxy"
Sep 15 11:27:45.893413 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.893386    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aec1d8e8-5b41-45b7-a02e-c32090c94a09" containerName="console"
Sep 15 11:27:45.893413 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.893390    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="aec1d8e8-5b41-45b7-a02e-c32090c94a09" containerName="console"
Sep 15 11:27:45.893943 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.893431    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="351a8f44-b900-4b0b-9d3b-8b1e24267d1b" containerName="alertmanager"
Sep 15 11:27:45.893943 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.893440    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f61610b-f474-421c-b419-b53055b169f8" containerName="console"
Sep 15 11:27:45.893943 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.893447    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="aec1d8e8-5b41-45b7-a02e-c32090c94a09" containerName="console"
Sep 15 11:27:45.893943 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.893453    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="351a8f44-b900-4b0b-9d3b-8b1e24267d1b" containerName="kube-rbac-proxy-metric"
Sep 15 11:27:45.893943 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.893458    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="351a8f44-b900-4b0b-9d3b-8b1e24267d1b" containerName="config-reloader"
Sep 15 11:27:45.893943 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.893465    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="351a8f44-b900-4b0b-9d3b-8b1e24267d1b" containerName="prom-label-proxy"
Sep 15 11:27:45.893943 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.893471    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f867a8e7-5a0d-491b-92ab-9376532a812d" containerName="console"
Sep 15 11:27:45.893943 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.893477    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="351a8f44-b900-4b0b-9d3b-8b1e24267d1b" containerName="kube-rbac-proxy-web"
Sep 15 11:27:45.893943 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.893481    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="351a8f44-b900-4b0b-9d3b-8b1e24267d1b" containerName="kube-rbac-proxy"
Sep 15 11:27:45.900978 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.900951    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:45.905202 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.905165    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 15 11:27:45.905319 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.905231    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 15 11:27:45.905319 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.905262    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9qzn8\""
Sep 15 11:27:45.905432 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.905333    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 15 11:27:45.905509 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.905183    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 15 11:27:45.905707 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.905498    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 15 11:27:45.905707 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.905695    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 15 11:27:45.905898 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.905879    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 15 11:27:45.906276 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.906256    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 15 11:27:45.910075 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.910052    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 15 11:27:45.912910 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.912890    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 11:27:45.969865 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.969827    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7d221dc1-d60e-4929-bedb-38e7561ce21f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7d221dc1-d60e-4929-bedb-38e7561ce21f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:45.969865 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.969866    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8zhx\" (UniqueName: \"kubernetes.io/projected/7d221dc1-d60e-4929-bedb-38e7561ce21f-kube-api-access-n8zhx\") pod \"alertmanager-main-0\" (UID: \"7d221dc1-d60e-4929-bedb-38e7561ce21f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:45.970130 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.969892    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7d221dc1-d60e-4929-bedb-38e7561ce21f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7d221dc1-d60e-4929-bedb-38e7561ce21f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:45.970130 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.969995    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7d221dc1-d60e-4929-bedb-38e7561ce21f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7d221dc1-d60e-4929-bedb-38e7561ce21f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:45.970130 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.970033    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d221dc1-d60e-4929-bedb-38e7561ce21f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7d221dc1-d60e-4929-bedb-38e7561ce21f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:45.970130 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.970066    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7d221dc1-d60e-4929-bedb-38e7561ce21f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7d221dc1-d60e-4929-bedb-38e7561ce21f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:45.970130 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.970095    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7d221dc1-d60e-4929-bedb-38e7561ce21f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7d221dc1-d60e-4929-bedb-38e7561ce21f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:45.970130 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.970121    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7d221dc1-d60e-4929-bedb-38e7561ce21f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7d221dc1-d60e-4929-bedb-38e7561ce21f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:45.970404 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.970148    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7d221dc1-d60e-4929-bedb-38e7561ce21f-web-config\") pod \"alertmanager-main-0\" (UID: \"7d221dc1-d60e-4929-bedb-38e7561ce21f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:45.970404 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.970173    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d221dc1-d60e-4929-bedb-38e7561ce21f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7d221dc1-d60e-4929-bedb-38e7561ce21f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:45.970404 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.970214    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7d221dc1-d60e-4929-bedb-38e7561ce21f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7d221dc1-d60e-4929-bedb-38e7561ce21f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:45.970404 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.970267    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7d221dc1-d60e-4929-bedb-38e7561ce21f-config-volume\") pod \"alertmanager-main-0\" (UID: \"7d221dc1-d60e-4929-bedb-38e7561ce21f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:45.970404 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:45.970294    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7d221dc1-d60e-4929-bedb-38e7561ce21f-config-out\") pod \"alertmanager-main-0\" (UID: \"7d221dc1-d60e-4929-bedb-38e7561ce21f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:46.070946 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:46.070913    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7d221dc1-d60e-4929-bedb-38e7561ce21f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7d221dc1-d60e-4929-bedb-38e7561ce21f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:46.071123 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:46.070958    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7d221dc1-d60e-4929-bedb-38e7561ce21f-config-volume\") pod \"alertmanager-main-0\" (UID: \"7d221dc1-d60e-4929-bedb-38e7561ce21f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:46.071123 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:46.070993    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7d221dc1-d60e-4929-bedb-38e7561ce21f-config-out\") pod \"alertmanager-main-0\" (UID: \"7d221dc1-d60e-4929-bedb-38e7561ce21f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:46.071123 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:46.071043    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7d221dc1-d60e-4929-bedb-38e7561ce21f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7d221dc1-d60e-4929-bedb-38e7561ce21f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:46.071123 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:46.071080    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8zhx\" (UniqueName: \"kubernetes.io/projected/7d221dc1-d60e-4929-bedb-38e7561ce21f-kube-api-access-n8zhx\") pod \"alertmanager-main-0\" (UID: \"7d221dc1-d60e-4929-bedb-38e7561ce21f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:46.071123 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:46.071111    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7d221dc1-d60e-4929-bedb-38e7561ce21f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7d221dc1-d60e-4929-bedb-38e7561ce21f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:46.071433 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:46.071158    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7d221dc1-d60e-4929-bedb-38e7561ce21f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7d221dc1-d60e-4929-bedb-38e7561ce21f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:46.071433 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:46.071189    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d221dc1-d60e-4929-bedb-38e7561ce21f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7d221dc1-d60e-4929-bedb-38e7561ce21f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:46.071433 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:46.071224    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7d221dc1-d60e-4929-bedb-38e7561ce21f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7d221dc1-d60e-4929-bedb-38e7561ce21f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:46.071433 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:46.071255    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7d221dc1-d60e-4929-bedb-38e7561ce21f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7d221dc1-d60e-4929-bedb-38e7561ce21f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:46.071433 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:46.071279    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7d221dc1-d60e-4929-bedb-38e7561ce21f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7d221dc1-d60e-4929-bedb-38e7561ce21f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:46.071433 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:46.071309    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7d221dc1-d60e-4929-bedb-38e7561ce21f-web-config\") pod \"alertmanager-main-0\" (UID: \"7d221dc1-d60e-4929-bedb-38e7561ce21f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:46.071433 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:46.071333    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d221dc1-d60e-4929-bedb-38e7561ce21f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7d221dc1-d60e-4929-bedb-38e7561ce21f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:46.072208 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:46.072177    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d221dc1-d60e-4929-bedb-38e7561ce21f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7d221dc1-d60e-4929-bedb-38e7561ce21f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:46.072418 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:46.072389    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d221dc1-d60e-4929-bedb-38e7561ce21f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7d221dc1-d60e-4929-bedb-38e7561ce21f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:46.072692 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:46.072648    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7d221dc1-d60e-4929-bedb-38e7561ce21f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7d221dc1-d60e-4929-bedb-38e7561ce21f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:46.074091 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:46.074064    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7d221dc1-d60e-4929-bedb-38e7561ce21f-config-out\") pod \"alertmanager-main-0\" (UID: \"7d221dc1-d60e-4929-bedb-38e7561ce21f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:46.074189 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:46.074151    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7d221dc1-d60e-4929-bedb-38e7561ce21f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7d221dc1-d60e-4929-bedb-38e7561ce21f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:46.074248 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:46.074234    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7d221dc1-d60e-4929-bedb-38e7561ce21f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7d221dc1-d60e-4929-bedb-38e7561ce21f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:46.074297 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:46.074236    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7d221dc1-d60e-4929-bedb-38e7561ce21f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7d221dc1-d60e-4929-bedb-38e7561ce21f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:46.074385 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:46.074363    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7d221dc1-d60e-4929-bedb-38e7561ce21f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7d221dc1-d60e-4929-bedb-38e7561ce21f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:46.074809 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:46.074790    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7d221dc1-d60e-4929-bedb-38e7561ce21f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7d221dc1-d60e-4929-bedb-38e7561ce21f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:46.075136 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:46.075120    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7d221dc1-d60e-4929-bedb-38e7561ce21f-config-volume\") pod \"alertmanager-main-0\" (UID: \"7d221dc1-d60e-4929-bedb-38e7561ce21f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:46.075438 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:46.075423    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7d221dc1-d60e-4929-bedb-38e7561ce21f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7d221dc1-d60e-4929-bedb-38e7561ce21f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:46.076055 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:46.076034    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7d221dc1-d60e-4929-bedb-38e7561ce21f-web-config\") pod \"alertmanager-main-0\" (UID: \"7d221dc1-d60e-4929-bedb-38e7561ce21f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:46.080345 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:46.080319    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8zhx\" (UniqueName: \"kubernetes.io/projected/7d221dc1-d60e-4929-bedb-38e7561ce21f-kube-api-access-n8zhx\") pod \"alertmanager-main-0\" (UID: \"7d221dc1-d60e-4929-bedb-38e7561ce21f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:46.094256 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:46.094214    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="351a8f44-b900-4b0b-9d3b-8b1e24267d1b" path="/var/lib/kubelet/pods/351a8f44-b900-4b0b-9d3b-8b1e24267d1b/volumes"
Sep 15 11:27:46.213133 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:46.213081    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:27:46.498555 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:46.496802    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 11:27:46.499683 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:27:46.499627    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d221dc1_d60e_4929_bedb_38e7561ce21f.slice/crio-76c36311a67e543aab3f0b34cb3433100bf74569c94706746c147eaa2e4dfcdd WatchSource:0}: Error finding container 76c36311a67e543aab3f0b34cb3433100bf74569c94706746c147eaa2e4dfcdd: Status 404 returned error can't find the container with id 76c36311a67e543aab3f0b34cb3433100bf74569c94706746c147eaa2e4dfcdd
Sep 15 11:27:46.844326 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:46.844296    2575 generic.go:356] "Generic (PLEG): container finished" podID="7d221dc1-d60e-4929-bedb-38e7561ce21f" containerID="4576b25a737b92ae25356120cdbf0dcd00024753ba25cc2d658ce196204610b2" exitCode=0
Sep 15 11:27:46.844878 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:46.844381    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d221dc1-d60e-4929-bedb-38e7561ce21f","Type":"ContainerDied","Data":"4576b25a737b92ae25356120cdbf0dcd00024753ba25cc2d658ce196204610b2"}
Sep 15 11:27:46.844878 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:46.844479    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d221dc1-d60e-4929-bedb-38e7561ce21f","Type":"ContainerStarted","Data":"76c36311a67e543aab3f0b34cb3433100bf74569c94706746c147eaa2e4dfcdd"}
Sep 15 11:27:47.856754 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:47.856711    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d221dc1-d60e-4929-bedb-38e7561ce21f","Type":"ContainerStarted","Data":"9ee7ba5c1c37df0d0b97c864f45ad639311b83163259ebc2816ab59df32f8e74"}
Sep 15 11:27:47.857163 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:47.856802    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d221dc1-d60e-4929-bedb-38e7561ce21f","Type":"ContainerStarted","Data":"9d1574dbe935fcfa81255ef51f961fc8b0caeb3ba8f719d109ea57ac3a0da6c5"}
Sep 15 11:27:47.857163 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:47.856842    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d221dc1-d60e-4929-bedb-38e7561ce21f","Type":"ContainerStarted","Data":"aa9c78707c2b08ae69eeaa2eed381608da2e85f6d59a1e4abc8ccd666466c112"}
Sep 15 11:27:47.857163 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:47.856879    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d221dc1-d60e-4929-bedb-38e7561ce21f","Type":"ContainerStarted","Data":"86e1da8a8c37d3219b62d77002531c2f122288894f455a5bc6159b9709112a40"}
Sep 15 11:27:47.857163 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:47.856915    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d221dc1-d60e-4929-bedb-38e7561ce21f","Type":"ContainerStarted","Data":"57cf96c579f32a0ba88fa9e54abee6b06af403d4f36a433c5c3eac0488638d3f"}
Sep 15 11:27:47.857163 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:47.856952    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d221dc1-d60e-4929-bedb-38e7561ce21f","Type":"ContainerStarted","Data":"a46deeb33e100e08ea2cbef13676ecc92d8c2d3c86c2e033778d60fcc1458b93"}
Sep 15 11:27:47.893130 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:47.893067    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.8767113220000002 podStartE2EDuration="2.893048557s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.337235ms" isStatefulPod=false podCreationTimestamp="2026-09-15 11:27:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:27:47.892693232 +0000 UTC m=+138.319023829" watchObservedRunningTime="2026-09-15 11:27:47.893048557 +0000 UTC m=+138.319379153"
Sep 15 11:27:57.681974 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:57.681932    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-68f96bbcc8-t79kq"]
Sep 15 11:27:57.684912 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:57.684882    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68f96bbcc8-t79kq"
Sep 15 11:27:57.695673 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:57.695623    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68f96bbcc8-t79kq"]
Sep 15 11:27:57.773138 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:57.773091    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c87bda8-9322-409f-88e5-4b718536b082-service-ca\") pod \"console-68f96bbcc8-t79kq\" (UID: \"0c87bda8-9322-409f-88e5-4b718536b082\") " pod="openshift-console/console-68f96bbcc8-t79kq"
Sep 15 11:27:57.773138 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:57.773139    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c87bda8-9322-409f-88e5-4b718536b082-trusted-ca-bundle\") pod \"console-68f96bbcc8-t79kq\" (UID: \"0c87bda8-9322-409f-88e5-4b718536b082\") " pod="openshift-console/console-68f96bbcc8-t79kq"
Sep 15 11:27:57.773375 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:57.773240    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c87bda8-9322-409f-88e5-4b718536b082-oauth-serving-cert\") pod \"console-68f96bbcc8-t79kq\" (UID: \"0c87bda8-9322-409f-88e5-4b718536b082\") " pod="openshift-console/console-68f96bbcc8-t79kq"
Sep 15 11:27:57.773375 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:57.773281    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c87bda8-9322-409f-88e5-4b718536b082-console-oauth-config\") pod \"console-68f96bbcc8-t79kq\" (UID: \"0c87bda8-9322-409f-88e5-4b718536b082\") " pod="openshift-console/console-68f96bbcc8-t79kq"
Sep 15 11:27:57.773375 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:57.773307    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct4zp\" (UniqueName: \"kubernetes.io/projected/0c87bda8-9322-409f-88e5-4b718536b082-kube-api-access-ct4zp\") pod \"console-68f96bbcc8-t79kq\" (UID: \"0c87bda8-9322-409f-88e5-4b718536b082\") " pod="openshift-console/console-68f96bbcc8-t79kq"
Sep 15 11:27:57.773375 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:57.773355    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c87bda8-9322-409f-88e5-4b718536b082-console-serving-cert\") pod \"console-68f96bbcc8-t79kq\" (UID: \"0c87bda8-9322-409f-88e5-4b718536b082\") " pod="openshift-console/console-68f96bbcc8-t79kq"
Sep 15 11:27:57.773527 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:57.773429    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c87bda8-9322-409f-88e5-4b718536b082-console-config\") pod \"console-68f96bbcc8-t79kq\" (UID: \"0c87bda8-9322-409f-88e5-4b718536b082\") " pod="openshift-console/console-68f96bbcc8-t79kq"
Sep 15 11:27:57.874515 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:57.874476    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c87bda8-9322-409f-88e5-4b718536b082-oauth-serving-cert\") pod \"console-68f96bbcc8-t79kq\" (UID: \"0c87bda8-9322-409f-88e5-4b718536b082\") " pod="openshift-console/console-68f96bbcc8-t79kq"
Sep 15 11:27:57.874721 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:57.874521    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c87bda8-9322-409f-88e5-4b718536b082-console-oauth-config\") pod \"console-68f96bbcc8-t79kq\" (UID: \"0c87bda8-9322-409f-88e5-4b718536b082\") " pod="openshift-console/console-68f96bbcc8-t79kq"
Sep 15 11:27:57.874721 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:57.874551    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct4zp\" (UniqueName: \"kubernetes.io/projected/0c87bda8-9322-409f-88e5-4b718536b082-kube-api-access-ct4zp\") pod \"console-68f96bbcc8-t79kq\" (UID: \"0c87bda8-9322-409f-88e5-4b718536b082\") " pod="openshift-console/console-68f96bbcc8-t79kq"
Sep 15 11:27:57.874721 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:57.874588    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c87bda8-9322-409f-88e5-4b718536b082-console-serving-cert\") pod \"console-68f96bbcc8-t79kq\" (UID: \"0c87bda8-9322-409f-88e5-4b718536b082\") " pod="openshift-console/console-68f96bbcc8-t79kq"
Sep 15 11:27:57.874721 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:57.874613    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c87bda8-9322-409f-88e5-4b718536b082-console-config\") pod \"console-68f96bbcc8-t79kq\" (UID: \"0c87bda8-9322-409f-88e5-4b718536b082\") " pod="openshift-console/console-68f96bbcc8-t79kq"
Sep 15 11:27:57.874721 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:57.874637    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c87bda8-9322-409f-88e5-4b718536b082-service-ca\") pod \"console-68f96bbcc8-t79kq\" (UID: \"0c87bda8-9322-409f-88e5-4b718536b082\") " pod="openshift-console/console-68f96bbcc8-t79kq"
Sep 15 11:27:57.874721 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:57.874690    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c87bda8-9322-409f-88e5-4b718536b082-trusted-ca-bundle\") pod \"console-68f96bbcc8-t79kq\" (UID: \"0c87bda8-9322-409f-88e5-4b718536b082\") " pod="openshift-console/console-68f96bbcc8-t79kq"
Sep 15 11:27:57.875358 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:57.875334    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c87bda8-9322-409f-88e5-4b718536b082-oauth-serving-cert\") pod \"console-68f96bbcc8-t79kq\" (UID: \"0c87bda8-9322-409f-88e5-4b718536b082\") " pod="openshift-console/console-68f96bbcc8-t79kq"
Sep 15 11:27:57.875464 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:57.875430    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c87bda8-9322-409f-88e5-4b718536b082-console-config\") pod \"console-68f96bbcc8-t79kq\" (UID: \"0c87bda8-9322-409f-88e5-4b718536b082\") " pod="openshift-console/console-68f96bbcc8-t79kq"
Sep 15 11:27:57.875464 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:57.875451    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c87bda8-9322-409f-88e5-4b718536b082-service-ca\") pod \"console-68f96bbcc8-t79kq\" (UID: \"0c87bda8-9322-409f-88e5-4b718536b082\") " pod="openshift-console/console-68f96bbcc8-t79kq"
Sep 15 11:27:57.876108 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:57.876085    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c87bda8-9322-409f-88e5-4b718536b082-trusted-ca-bundle\") pod \"console-68f96bbcc8-t79kq\" (UID: \"0c87bda8-9322-409f-88e5-4b718536b082\") " pod="openshift-console/console-68f96bbcc8-t79kq"
Sep 15 11:27:57.877204 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:57.877182    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c87bda8-9322-409f-88e5-4b718536b082-console-oauth-config\") pod \"console-68f96bbcc8-t79kq\" (UID: \"0c87bda8-9322-409f-88e5-4b718536b082\") " pod="openshift-console/console-68f96bbcc8-t79kq"
Sep 15 11:27:57.877309 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:57.877291    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c87bda8-9322-409f-88e5-4b718536b082-console-serving-cert\") pod \"console-68f96bbcc8-t79kq\" (UID: \"0c87bda8-9322-409f-88e5-4b718536b082\") " pod="openshift-console/console-68f96bbcc8-t79kq"
Sep 15 11:27:57.882645 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:57.882615    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct4zp\" (UniqueName: \"kubernetes.io/projected/0c87bda8-9322-409f-88e5-4b718536b082-kube-api-access-ct4zp\") pod \"console-68f96bbcc8-t79kq\" (UID: \"0c87bda8-9322-409f-88e5-4b718536b082\") " pod="openshift-console/console-68f96bbcc8-t79kq"
Sep 15 11:27:57.996639 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:57.996544    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68f96bbcc8-t79kq"
Sep 15 11:27:58.269597 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:58.268499    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68f96bbcc8-t79kq"]
Sep 15 11:27:58.271586 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:27:58.271552    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c87bda8_9322_409f_88e5_4b718536b082.slice/crio-8d26207219ff42a026927ad65340be246a7db3639ffe51b9d13d884bdf997ade WatchSource:0}: Error finding container 8d26207219ff42a026927ad65340be246a7db3639ffe51b9d13d884bdf997ade: Status 404 returned error can't find the container with id 8d26207219ff42a026927ad65340be246a7db3639ffe51b9d13d884bdf997ade
Sep 15 11:27:58.903309 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:58.903270    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68f96bbcc8-t79kq" event={"ID":"0c87bda8-9322-409f-88e5-4b718536b082","Type":"ContainerStarted","Data":"185a00e9c2a2cde7f7cdbad1bdf5ba4900230a85c7acac408b422d7e8e38e418"}
Sep 15 11:27:58.903830 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:58.903326    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68f96bbcc8-t79kq" event={"ID":"0c87bda8-9322-409f-88e5-4b718536b082","Type":"ContainerStarted","Data":"8d26207219ff42a026927ad65340be246a7db3639ffe51b9d13d884bdf997ade"}
Sep 15 11:27:58.922711 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:27:58.922637    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-68f96bbcc8-t79kq" podStartSLOduration=1.9226178630000001 podStartE2EDuration="1.922617863s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:27:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:27:58.921157452 +0000 UTC m=+149.347488057" watchObservedRunningTime="2026-09-15 11:27:58.922617863 +0000 UTC m=+149.348948532"
Sep 15 11:28:07.997533 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:28:07.997467    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68f96bbcc8-t79kq"
Sep 15 11:28:07.998033 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:28:07.997564    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-68f96bbcc8-t79kq"
Sep 15 11:28:08.002686 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:28:08.002640    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-68f96bbcc8-t79kq"
Sep 15 11:28:08.948272 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:28:08.948235    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-68f96bbcc8-t79kq"
Sep 15 11:28:08.995359 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:28:08.995326    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bb459678f-5npxx"]
Sep 15 11:28:34.014905 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:28:34.014838    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5bb459678f-5npxx" podUID="ba839785-bf22-4551-8290-5c9e847a7c27" containerName="console" containerID="cri-o://3c3f0272cf1ce4aa2901c97fce7cbd85a930587eb07ede2d0cdff8b7425f226f" gracePeriod=15
Sep 15 11:28:34.254121 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:28:34.254091    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bb459678f-5npxx"
Sep 15 11:28:34.304505 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:28:34.304400    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba839785-bf22-4551-8290-5c9e847a7c27-console-serving-cert\") pod \"ba839785-bf22-4551-8290-5c9e847a7c27\" (UID: \"ba839785-bf22-4551-8290-5c9e847a7c27\") "
Sep 15 11:28:34.304505 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:28:34.304440    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6z7l8\" (UniqueName: \"kubernetes.io/projected/ba839785-bf22-4551-8290-5c9e847a7c27-kube-api-access-6z7l8\") pod \"ba839785-bf22-4551-8290-5c9e847a7c27\" (UID: \"ba839785-bf22-4551-8290-5c9e847a7c27\") "
Sep 15 11:28:34.304505 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:28:34.304459    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba839785-bf22-4551-8290-5c9e847a7c27-oauth-serving-cert\") pod \"ba839785-bf22-4551-8290-5c9e847a7c27\" (UID: \"ba839785-bf22-4551-8290-5c9e847a7c27\") "
Sep 15 11:28:34.304505 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:28:34.304479    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba839785-bf22-4551-8290-5c9e847a7c27-trusted-ca-bundle\") pod \"ba839785-bf22-4551-8290-5c9e847a7c27\" (UID: \"ba839785-bf22-4551-8290-5c9e847a7c27\") "
Sep 15 11:28:34.304872 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:28:34.304517    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba839785-bf22-4551-8290-5c9e847a7c27-console-config\") pod \"ba839785-bf22-4551-8290-5c9e847a7c27\" (UID: \"ba839785-bf22-4551-8290-5c9e847a7c27\") "
Sep 15 11:28:34.304872 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:28:34.304548    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba839785-bf22-4551-8290-5c9e847a7c27-service-ca\") pod \"ba839785-bf22-4551-8290-5c9e847a7c27\" (UID: \"ba839785-bf22-4551-8290-5c9e847a7c27\") "
Sep 15 11:28:34.304872 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:28:34.304588    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba839785-bf22-4551-8290-5c9e847a7c27-console-oauth-config\") pod \"ba839785-bf22-4551-8290-5c9e847a7c27\" (UID: \"ba839785-bf22-4551-8290-5c9e847a7c27\") "
Sep 15 11:28:34.305033 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:28:34.304987    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba839785-bf22-4551-8290-5c9e847a7c27-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ba839785-bf22-4551-8290-5c9e847a7c27" (UID: "ba839785-bf22-4551-8290-5c9e847a7c27"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:28:34.305090 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:28:34.305029    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba839785-bf22-4551-8290-5c9e847a7c27-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ba839785-bf22-4551-8290-5c9e847a7c27" (UID: "ba839785-bf22-4551-8290-5c9e847a7c27"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:28:34.305090 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:28:34.305047    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba839785-bf22-4551-8290-5c9e847a7c27-console-config" (OuterVolumeSpecName: "console-config") pod "ba839785-bf22-4551-8290-5c9e847a7c27" (UID: "ba839785-bf22-4551-8290-5c9e847a7c27"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:28:34.305090 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:28:34.305033    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba839785-bf22-4551-8290-5c9e847a7c27-service-ca" (OuterVolumeSpecName: "service-ca") pod "ba839785-bf22-4551-8290-5c9e847a7c27" (UID: "ba839785-bf22-4551-8290-5c9e847a7c27"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:28:34.306928 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:28:34.306883    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba839785-bf22-4551-8290-5c9e847a7c27-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ba839785-bf22-4551-8290-5c9e847a7c27" (UID: "ba839785-bf22-4551-8290-5c9e847a7c27"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:28:34.306928 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:28:34.306917    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba839785-bf22-4551-8290-5c9e847a7c27-kube-api-access-6z7l8" (OuterVolumeSpecName: "kube-api-access-6z7l8") pod "ba839785-bf22-4551-8290-5c9e847a7c27" (UID: "ba839785-bf22-4551-8290-5c9e847a7c27"). InnerVolumeSpecName "kube-api-access-6z7l8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:28:34.307084 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:28:34.306936    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba839785-bf22-4551-8290-5c9e847a7c27-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ba839785-bf22-4551-8290-5c9e847a7c27" (UID: "ba839785-bf22-4551-8290-5c9e847a7c27"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:28:34.405926 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:28:34.405884    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba839785-bf22-4551-8290-5c9e847a7c27-service-ca\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:28:34.405926 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:28:34.405916    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba839785-bf22-4551-8290-5c9e847a7c27-console-oauth-config\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:28:34.405926 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:28:34.405925    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba839785-bf22-4551-8290-5c9e847a7c27-console-serving-cert\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:28:34.405926 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:28:34.405936    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6z7l8\" (UniqueName: \"kubernetes.io/projected/ba839785-bf22-4551-8290-5c9e847a7c27-kube-api-access-6z7l8\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:28:34.406203 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:28:34.405945    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba839785-bf22-4551-8290-5c9e847a7c27-oauth-serving-cert\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:28:34.406203 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:28:34.405955    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba839785-bf22-4551-8290-5c9e847a7c27-trusted-ca-bundle\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:28:34.406203 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:28:34.405963    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba839785-bf22-4551-8290-5c9e847a7c27-console-config\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:28:35.055295 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:28:35.055257    2575 generic.go:356] "Generic (PLEG): container finished" podID="ba839785-bf22-4551-8290-5c9e847a7c27" containerID="3c3f0272cf1ce4aa2901c97fce7cbd85a930587eb07ede2d0cdff8b7425f226f" exitCode=0
Sep 15 11:28:35.055728 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:28:35.055312    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bb459678f-5npxx"
Sep 15 11:28:35.055728 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:28:35.055341    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bb459678f-5npxx" event={"ID":"ba839785-bf22-4551-8290-5c9e847a7c27","Type":"ContainerDied","Data":"3c3f0272cf1ce4aa2901c97fce7cbd85a930587eb07ede2d0cdff8b7425f226f"}
Sep 15 11:28:35.055728 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:28:35.055389    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bb459678f-5npxx" event={"ID":"ba839785-bf22-4551-8290-5c9e847a7c27","Type":"ContainerDied","Data":"04ff5c4443d8650c8faecda7d9f00c2983c7f4b7f1dd7698af1c13e4011b2bdd"}
Sep 15 11:28:35.055728 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:28:35.055413    2575 scope.go:117] "RemoveContainer" containerID="3c3f0272cf1ce4aa2901c97fce7cbd85a930587eb07ede2d0cdff8b7425f226f"
Sep 15 11:28:35.064523 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:28:35.064506    2575 scope.go:117] "RemoveContainer" containerID="3c3f0272cf1ce4aa2901c97fce7cbd85a930587eb07ede2d0cdff8b7425f226f"
Sep 15 11:28:35.064875 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:28:35.064850    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c3f0272cf1ce4aa2901c97fce7cbd85a930587eb07ede2d0cdff8b7425f226f\": container with ID starting with 3c3f0272cf1ce4aa2901c97fce7cbd85a930587eb07ede2d0cdff8b7425f226f not found: ID does not exist" containerID="3c3f0272cf1ce4aa2901c97fce7cbd85a930587eb07ede2d0cdff8b7425f226f"
Sep 15 11:28:35.064983 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:28:35.064882    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c3f0272cf1ce4aa2901c97fce7cbd85a930587eb07ede2d0cdff8b7425f226f"} err="failed to get container status \"3c3f0272cf1ce4aa2901c97fce7cbd85a930587eb07ede2d0cdff8b7425f226f\": rpc error: code = NotFound desc = could not find container \"3c3f0272cf1ce4aa2901c97fce7cbd85a930587eb07ede2d0cdff8b7425f226f\": container with ID starting with 3c3f0272cf1ce4aa2901c97fce7cbd85a930587eb07ede2d0cdff8b7425f226f not found: ID does not exist"
Sep 15 11:28:35.079262 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:28:35.079215    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bb459678f-5npxx"]
Sep 15 11:28:35.090366 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:28:35.090335    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5bb459678f-5npxx"]
Sep 15 11:28:36.092291 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:28:36.092254    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba839785-bf22-4551-8290-5c9e847a7c27" path="/var/lib/kubelet/pods/ba839785-bf22-4551-8290-5c9e847a7c27/volumes"
Sep 15 11:29:19.936908 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:19.936856    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j2qsc"]
Sep 15 11:29:19.937386 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:19.937239    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba839785-bf22-4551-8290-5c9e847a7c27" containerName="console"
Sep 15 11:29:19.937386 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:19.937252    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba839785-bf22-4551-8290-5c9e847a7c27" containerName="console"
Sep 15 11:29:19.937386 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:19.937302    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba839785-bf22-4551-8290-5c9e847a7c27" containerName="console"
Sep 15 11:29:19.939539 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:19.939520    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j2qsc"
Sep 15 11:29:19.942114 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:19.942091    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 11:29:19.942767 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:19.942742    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4z5m2\""
Sep 15 11:29:19.942767 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:19.942763    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 11:29:19.949031 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:19.949006    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j2qsc"]
Sep 15 11:29:20.002567 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:20.002525    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/157e3122-37a3-4aed-a9a6-ebc8710f2dd0-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j2qsc\" (UID: \"157e3122-37a3-4aed-a9a6-ebc8710f2dd0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j2qsc"
Sep 15 11:29:20.002785 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:20.002577    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvfjb\" (UniqueName: \"kubernetes.io/projected/157e3122-37a3-4aed-a9a6-ebc8710f2dd0-kube-api-access-jvfjb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j2qsc\" (UID: \"157e3122-37a3-4aed-a9a6-ebc8710f2dd0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j2qsc"
Sep 15 11:29:20.002785 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:20.002678    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/157e3122-37a3-4aed-a9a6-ebc8710f2dd0-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j2qsc\" (UID: \"157e3122-37a3-4aed-a9a6-ebc8710f2dd0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j2qsc"
Sep 15 11:29:20.103891 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:20.103847    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/157e3122-37a3-4aed-a9a6-ebc8710f2dd0-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j2qsc\" (UID: \"157e3122-37a3-4aed-a9a6-ebc8710f2dd0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j2qsc"
Sep 15 11:29:20.103891 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:20.103899    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvfjb\" (UniqueName: \"kubernetes.io/projected/157e3122-37a3-4aed-a9a6-ebc8710f2dd0-kube-api-access-jvfjb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j2qsc\" (UID: \"157e3122-37a3-4aed-a9a6-ebc8710f2dd0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j2qsc"
Sep 15 11:29:20.104115 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:20.103925    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/157e3122-37a3-4aed-a9a6-ebc8710f2dd0-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j2qsc\" (UID: \"157e3122-37a3-4aed-a9a6-ebc8710f2dd0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j2qsc"
Sep 15 11:29:20.104255 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:20.104235    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/157e3122-37a3-4aed-a9a6-ebc8710f2dd0-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j2qsc\" (UID: \"157e3122-37a3-4aed-a9a6-ebc8710f2dd0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j2qsc"
Sep 15 11:29:20.104294 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:20.104259    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/157e3122-37a3-4aed-a9a6-ebc8710f2dd0-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j2qsc\" (UID: \"157e3122-37a3-4aed-a9a6-ebc8710f2dd0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j2qsc"
Sep 15 11:29:20.112827 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:20.112791    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvfjb\" (UniqueName: \"kubernetes.io/projected/157e3122-37a3-4aed-a9a6-ebc8710f2dd0-kube-api-access-jvfjb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j2qsc\" (UID: \"157e3122-37a3-4aed-a9a6-ebc8710f2dd0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j2qsc"
Sep 15 11:29:20.250072 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:20.249990    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j2qsc"
Sep 15 11:29:20.525415 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:20.525388    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j2qsc"]
Sep 15 11:29:20.528069 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:29:20.528042    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod157e3122_37a3_4aed_a9a6_ebc8710f2dd0.slice/crio-48883b3e8254b633cd90f3fda9f80d874ef15f73856ec6f176e00b431e3dcdbb WatchSource:0}: Error finding container 48883b3e8254b633cd90f3fda9f80d874ef15f73856ec6f176e00b431e3dcdbb: Status 404 returned error can't find the container with id 48883b3e8254b633cd90f3fda9f80d874ef15f73856ec6f176e00b431e3dcdbb
Sep 15 11:29:21.243822 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:21.243783    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j2qsc" event={"ID":"157e3122-37a3-4aed-a9a6-ebc8710f2dd0","Type":"ContainerStarted","Data":"48883b3e8254b633cd90f3fda9f80d874ef15f73856ec6f176e00b431e3dcdbb"}
Sep 15 11:29:27.276206 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:27.276165    2575 generic.go:356] "Generic (PLEG): container finished" podID="157e3122-37a3-4aed-a9a6-ebc8710f2dd0" containerID="491e8bae40da0aa578284fa1f31edecbe5e2036c28994ddec832c84ef62f88c7" exitCode=0
Sep 15 11:29:27.276709 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:27.276255    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j2qsc" event={"ID":"157e3122-37a3-4aed-a9a6-ebc8710f2dd0","Type":"ContainerDied","Data":"491e8bae40da0aa578284fa1f31edecbe5e2036c28994ddec832c84ef62f88c7"}
Sep 15 11:29:31.296264 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:31.296227    2575 generic.go:356] "Generic (PLEG): container finished" podID="157e3122-37a3-4aed-a9a6-ebc8710f2dd0" containerID="ddaeec7ac3f3b126549ddc70ba75af41f25a2b0b2f9029eb9f4f5aab21f40b7e" exitCode=0
Sep 15 11:29:31.296671 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:31.296313    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j2qsc" event={"ID":"157e3122-37a3-4aed-a9a6-ebc8710f2dd0","Type":"ContainerDied","Data":"ddaeec7ac3f3b126549ddc70ba75af41f25a2b0b2f9029eb9f4f5aab21f40b7e"}
Sep 15 11:29:38.330604 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:38.330562    2575 generic.go:356] "Generic (PLEG): container finished" podID="157e3122-37a3-4aed-a9a6-ebc8710f2dd0" containerID="d24d9db7e50855c91f2a7bd1e24c63e0bfd4773608f1ec2d9e6f0f56c4275380" exitCode=0
Sep 15 11:29:38.331031 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:38.330611    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j2qsc" event={"ID":"157e3122-37a3-4aed-a9a6-ebc8710f2dd0","Type":"ContainerDied","Data":"d24d9db7e50855c91f2a7bd1e24c63e0bfd4773608f1ec2d9e6f0f56c4275380"}
Sep 15 11:29:39.459423 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:39.459396    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j2qsc"
Sep 15 11:29:39.586195 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:39.586100    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvfjb\" (UniqueName: \"kubernetes.io/projected/157e3122-37a3-4aed-a9a6-ebc8710f2dd0-kube-api-access-jvfjb\") pod \"157e3122-37a3-4aed-a9a6-ebc8710f2dd0\" (UID: \"157e3122-37a3-4aed-a9a6-ebc8710f2dd0\") "
Sep 15 11:29:39.586195 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:39.586190    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/157e3122-37a3-4aed-a9a6-ebc8710f2dd0-util\") pod \"157e3122-37a3-4aed-a9a6-ebc8710f2dd0\" (UID: \"157e3122-37a3-4aed-a9a6-ebc8710f2dd0\") "
Sep 15 11:29:39.586382 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:39.586228    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/157e3122-37a3-4aed-a9a6-ebc8710f2dd0-bundle\") pod \"157e3122-37a3-4aed-a9a6-ebc8710f2dd0\" (UID: \"157e3122-37a3-4aed-a9a6-ebc8710f2dd0\") "
Sep 15 11:29:39.587090 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:39.587048    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/157e3122-37a3-4aed-a9a6-ebc8710f2dd0-bundle" (OuterVolumeSpecName: "bundle") pod "157e3122-37a3-4aed-a9a6-ebc8710f2dd0" (UID: "157e3122-37a3-4aed-a9a6-ebc8710f2dd0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:29:39.588438 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:39.588412    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/157e3122-37a3-4aed-a9a6-ebc8710f2dd0-kube-api-access-jvfjb" (OuterVolumeSpecName: "kube-api-access-jvfjb") pod "157e3122-37a3-4aed-a9a6-ebc8710f2dd0" (UID: "157e3122-37a3-4aed-a9a6-ebc8710f2dd0"). InnerVolumeSpecName "kube-api-access-jvfjb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:29:39.590915 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:39.590886    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/157e3122-37a3-4aed-a9a6-ebc8710f2dd0-util" (OuterVolumeSpecName: "util") pod "157e3122-37a3-4aed-a9a6-ebc8710f2dd0" (UID: "157e3122-37a3-4aed-a9a6-ebc8710f2dd0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:29:39.687050 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:39.686999    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/157e3122-37a3-4aed-a9a6-ebc8710f2dd0-bundle\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:29:39.687050 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:39.687043    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvfjb\" (UniqueName: \"kubernetes.io/projected/157e3122-37a3-4aed-a9a6-ebc8710f2dd0-kube-api-access-jvfjb\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:29:39.687050 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:39.687055    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/157e3122-37a3-4aed-a9a6-ebc8710f2dd0-util\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:29:40.340568 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:40.340543    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j2qsc"
Sep 15 11:29:40.340720 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:40.340543    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j2qsc" event={"ID":"157e3122-37a3-4aed-a9a6-ebc8710f2dd0","Type":"ContainerDied","Data":"48883b3e8254b633cd90f3fda9f80d874ef15f73856ec6f176e00b431e3dcdbb"}
Sep 15 11:29:40.340720 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:40.340677    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="48883b3e8254b633cd90f3fda9f80d874ef15f73856ec6f176e00b431e3dcdbb"
Sep 15 11:29:48.396586 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:48.396541    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-brp59"]
Sep 15 11:29:48.397235 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:48.397065    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="157e3122-37a3-4aed-a9a6-ebc8710f2dd0" containerName="extract"
Sep 15 11:29:48.397235 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:48.397084    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="157e3122-37a3-4aed-a9a6-ebc8710f2dd0" containerName="extract"
Sep 15 11:29:48.397235 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:48.397107    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="157e3122-37a3-4aed-a9a6-ebc8710f2dd0" containerName="pull"
Sep 15 11:29:48.397235 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:48.397115    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="157e3122-37a3-4aed-a9a6-ebc8710f2dd0" containerName="pull"
Sep 15 11:29:48.397235 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:48.397133    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="157e3122-37a3-4aed-a9a6-ebc8710f2dd0" containerName="util"
Sep 15 11:29:48.397235 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:48.397143    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="157e3122-37a3-4aed-a9a6-ebc8710f2dd0" containerName="util"
Sep 15 11:29:48.397235 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:48.397227    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="157e3122-37a3-4aed-a9a6-ebc8710f2dd0" containerName="extract"
Sep 15 11:29:48.400715 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:48.400689    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-brp59"
Sep 15 11:29:48.404315 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:48.404287    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 15 11:29:48.404874 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:48.404859    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 15 11:29:48.404944 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:48.404927    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-fxkhm\""
Sep 15 11:29:48.421236 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:48.421196    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-brp59"]
Sep 15 11:29:48.564418 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:48.564375    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wkfg\" (UniqueName: \"kubernetes.io/projected/f2d7d3e5-35cd-4af6-bf05-7e1b0c4c9642-kube-api-access-5wkfg\") pod \"cert-manager-operator-controller-manager-55c444bf86-brp59\" (UID: \"f2d7d3e5-35cd-4af6-bf05-7e1b0c4c9642\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-brp59"
Sep 15 11:29:48.564418 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:48.564414    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f2d7d3e5-35cd-4af6-bf05-7e1b0c4c9642-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-brp59\" (UID: \"f2d7d3e5-35cd-4af6-bf05-7e1b0c4c9642\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-brp59"
Sep 15 11:29:48.665453 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:48.665349    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wkfg\" (UniqueName: \"kubernetes.io/projected/f2d7d3e5-35cd-4af6-bf05-7e1b0c4c9642-kube-api-access-5wkfg\") pod \"cert-manager-operator-controller-manager-55c444bf86-brp59\" (UID: \"f2d7d3e5-35cd-4af6-bf05-7e1b0c4c9642\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-brp59"
Sep 15 11:29:48.665453 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:48.665397    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f2d7d3e5-35cd-4af6-bf05-7e1b0c4c9642-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-brp59\" (UID: \"f2d7d3e5-35cd-4af6-bf05-7e1b0c4c9642\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-brp59"
Sep 15 11:29:48.665872 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:48.665851    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f2d7d3e5-35cd-4af6-bf05-7e1b0c4c9642-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-brp59\" (UID: \"f2d7d3e5-35cd-4af6-bf05-7e1b0c4c9642\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-brp59"
Sep 15 11:29:48.674755 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:48.674726    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wkfg\" (UniqueName: \"kubernetes.io/projected/f2d7d3e5-35cd-4af6-bf05-7e1b0c4c9642-kube-api-access-5wkfg\") pod \"cert-manager-operator-controller-manager-55c444bf86-brp59\" (UID: \"f2d7d3e5-35cd-4af6-bf05-7e1b0c4c9642\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-brp59"
Sep 15 11:29:48.710588 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:48.710544    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-brp59"
Sep 15 11:29:49.009094 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:49.009067    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-brp59"]
Sep 15 11:29:49.011050 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:29:49.011010    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2d7d3e5_35cd_4af6_bf05_7e1b0c4c9642.slice/crio-3f381b0eb4a69b05cba6e7d9d6e91ae41416386ca6e1837a9933f8ab42507ca2 WatchSource:0}: Error finding container 3f381b0eb4a69b05cba6e7d9d6e91ae41416386ca6e1837a9933f8ab42507ca2: Status 404 returned error can't find the container with id 3f381b0eb4a69b05cba6e7d9d6e91ae41416386ca6e1837a9933f8ab42507ca2
Sep 15 11:29:49.377794 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:49.377756    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-brp59" event={"ID":"f2d7d3e5-35cd-4af6-bf05-7e1b0c4c9642","Type":"ContainerStarted","Data":"3f381b0eb4a69b05cba6e7d9d6e91ae41416386ca6e1837a9933f8ab42507ca2"}
Sep 15 11:29:51.389483 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:51.389450    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-brp59" event={"ID":"f2d7d3e5-35cd-4af6-bf05-7e1b0c4c9642","Type":"ContainerStarted","Data":"8dc9279be18049011af7b9dad2204cf444b24a8bb827d5bdcff3c768aede7f62"}
Sep 15 11:29:51.431383 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:51.431303    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-brp59" podStartSLOduration=1.9176223719999999 podStartE2EDuration="3.431277917s" totalImagesPullingTime="1.513655545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:29:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:29:51.426300367 +0000 UTC m=+261.852630964" watchObservedRunningTime="2026-09-15 11:29:51.431277917 +0000 UTC m=+261.857608514"
Sep 15 11:29:52.590298 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:52.590210    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w6gl"]
Sep 15 11:29:52.592692 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:52.592674    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w6gl"
Sep 15 11:29:52.595927 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:52.595894    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b86598d-443f-484a-b81b-ba834d8e5d1f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w6gl\" (UID: \"1b86598d-443f-484a-b81b-ba834d8e5d1f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w6gl"
Sep 15 11:29:52.596117 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:52.595939    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh46x\" (UniqueName: \"kubernetes.io/projected/1b86598d-443f-484a-b81b-ba834d8e5d1f-kube-api-access-jh46x\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w6gl\" (UID: \"1b86598d-443f-484a-b81b-ba834d8e5d1f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w6gl"
Sep 15 11:29:52.596117 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:52.595981    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b86598d-443f-484a-b81b-ba834d8e5d1f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w6gl\" (UID: \"1b86598d-443f-484a-b81b-ba834d8e5d1f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w6gl"
Sep 15 11:29:52.596988 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:52.596968    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4z5m2\""
Sep 15 11:29:52.597416 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:52.597394    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 11:29:52.597489 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:52.597432    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 11:29:52.611034 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:52.611003    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w6gl"]
Sep 15 11:29:52.696334 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:52.696295    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b86598d-443f-484a-b81b-ba834d8e5d1f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w6gl\" (UID: \"1b86598d-443f-484a-b81b-ba834d8e5d1f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w6gl"
Sep 15 11:29:52.696334 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:52.696332    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh46x\" (UniqueName: \"kubernetes.io/projected/1b86598d-443f-484a-b81b-ba834d8e5d1f-kube-api-access-jh46x\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w6gl\" (UID: \"1b86598d-443f-484a-b81b-ba834d8e5d1f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w6gl"
Sep 15 11:29:52.696597 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:52.696357    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b86598d-443f-484a-b81b-ba834d8e5d1f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w6gl\" (UID: \"1b86598d-443f-484a-b81b-ba834d8e5d1f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w6gl"
Sep 15 11:29:52.696814 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:52.696792    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b86598d-443f-484a-b81b-ba834d8e5d1f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w6gl\" (UID: \"1b86598d-443f-484a-b81b-ba834d8e5d1f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w6gl"
Sep 15 11:29:52.696902 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:52.696807    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b86598d-443f-484a-b81b-ba834d8e5d1f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w6gl\" (UID: \"1b86598d-443f-484a-b81b-ba834d8e5d1f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w6gl"
Sep 15 11:29:52.717570 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:52.717540    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh46x\" (UniqueName: \"kubernetes.io/projected/1b86598d-443f-484a-b81b-ba834d8e5d1f-kube-api-access-jh46x\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w6gl\" (UID: \"1b86598d-443f-484a-b81b-ba834d8e5d1f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w6gl"
Sep 15 11:29:52.854221 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:52.854134    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xf9dl"]
Sep 15 11:29:52.856593 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:52.856569    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-xf9dl"
Sep 15 11:29:52.859199 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:52.859153    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 15 11:29:52.859365 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:52.859346    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 15 11:29:52.859423 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:52.859351    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-mzlcp\""
Sep 15 11:29:52.875951 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:52.875916    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xf9dl"]
Sep 15 11:29:52.898437 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:52.898398    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrz6p\" (UniqueName: \"kubernetes.io/projected/d2069453-cd88-4c2f-8d63-81000aa16be9-kube-api-access-qrz6p\") pod \"cert-manager-webhook-6486ffd997-xf9dl\" (UID: \"d2069453-cd88-4c2f-8d63-81000aa16be9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xf9dl"
Sep 15 11:29:52.898616 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:52.898453    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d2069453-cd88-4c2f-8d63-81000aa16be9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xf9dl\" (UID: \"d2069453-cd88-4c2f-8d63-81000aa16be9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xf9dl"
Sep 15 11:29:52.902317 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:52.902287    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w6gl"
Sep 15 11:29:52.999176 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:52.999135    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrz6p\" (UniqueName: \"kubernetes.io/projected/d2069453-cd88-4c2f-8d63-81000aa16be9-kube-api-access-qrz6p\") pod \"cert-manager-webhook-6486ffd997-xf9dl\" (UID: \"d2069453-cd88-4c2f-8d63-81000aa16be9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xf9dl"
Sep 15 11:29:52.999359 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:52.999235    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d2069453-cd88-4c2f-8d63-81000aa16be9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xf9dl\" (UID: \"d2069453-cd88-4c2f-8d63-81000aa16be9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xf9dl"
Sep 15 11:29:53.015853 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:53.015823    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrz6p\" (UniqueName: \"kubernetes.io/projected/d2069453-cd88-4c2f-8d63-81000aa16be9-kube-api-access-qrz6p\") pod \"cert-manager-webhook-6486ffd997-xf9dl\" (UID: \"d2069453-cd88-4c2f-8d63-81000aa16be9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xf9dl"
Sep 15 11:29:53.021769 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:53.021734    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d2069453-cd88-4c2f-8d63-81000aa16be9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xf9dl\" (UID: \"d2069453-cd88-4c2f-8d63-81000aa16be9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xf9dl"
Sep 15 11:29:53.180410 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:53.180318    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-xf9dl"
Sep 15 11:29:53.202574 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:53.202537    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w6gl"]
Sep 15 11:29:53.206692 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:29:53.206640    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b86598d_443f_484a_b81b_ba834d8e5d1f.slice/crio-0c31e27e0ff93002e639dea791a6ddd086cebf7cc0e75f8c28183dea67cf2a51 WatchSource:0}: Error finding container 0c31e27e0ff93002e639dea791a6ddd086cebf7cc0e75f8c28183dea67cf2a51: Status 404 returned error can't find the container with id 0c31e27e0ff93002e639dea791a6ddd086cebf7cc0e75f8c28183dea67cf2a51
Sep 15 11:29:53.401288 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:53.401255    2575 generic.go:356] "Generic (PLEG): container finished" podID="1b86598d-443f-484a-b81b-ba834d8e5d1f" containerID="4f8226cc5b1e6aa9cf576915baa8be37725f8e13f3c59398fb1ce449bd0850da" exitCode=0
Sep 15 11:29:53.401492 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:53.401345    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w6gl" event={"ID":"1b86598d-443f-484a-b81b-ba834d8e5d1f","Type":"ContainerDied","Data":"4f8226cc5b1e6aa9cf576915baa8be37725f8e13f3c59398fb1ce449bd0850da"}
Sep 15 11:29:53.401492 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:53.401402    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w6gl" event={"ID":"1b86598d-443f-484a-b81b-ba834d8e5d1f","Type":"ContainerStarted","Data":"0c31e27e0ff93002e639dea791a6ddd086cebf7cc0e75f8c28183dea67cf2a51"}
Sep 15 11:29:53.468395 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:53.468361    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xf9dl"]
Sep 15 11:29:53.471054 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:29:53.471017    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2069453_cd88_4c2f_8d63_81000aa16be9.slice/crio-71214e785b8bfd94ffd65a8b97d950671937c12b621bb8fcc6a85605b9cb3c25 WatchSource:0}: Error finding container 71214e785b8bfd94ffd65a8b97d950671937c12b621bb8fcc6a85605b9cb3c25: Status 404 returned error can't find the container with id 71214e785b8bfd94ffd65a8b97d950671937c12b621bb8fcc6a85605b9cb3c25
Sep 15 11:29:54.409073 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:54.409038    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-xf9dl" event={"ID":"d2069453-cd88-4c2f-8d63-81000aa16be9","Type":"ContainerStarted","Data":"71214e785b8bfd94ffd65a8b97d950671937c12b621bb8fcc6a85605b9cb3c25"}
Sep 15 11:29:56.080087 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:56.080045    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-54tr7"]
Sep 15 11:29:56.082934 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:56.082900    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-54tr7"
Sep 15 11:29:56.085403 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:56.085371    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-45z5x\""
Sep 15 11:29:56.096547 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:56.096495    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-54tr7"]
Sep 15 11:29:56.128081 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:56.128040    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdq5x\" (UniqueName: \"kubernetes.io/projected/3628034d-d51e-432c-9ab7-a09bcc7def66-kube-api-access-tdq5x\") pod \"cert-manager-cainjector-559cdd8c87-54tr7\" (UID: \"3628034d-d51e-432c-9ab7-a09bcc7def66\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-54tr7"
Sep 15 11:29:56.128305 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:56.128108    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3628034d-d51e-432c-9ab7-a09bcc7def66-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-54tr7\" (UID: \"3628034d-d51e-432c-9ab7-a09bcc7def66\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-54tr7"
Sep 15 11:29:56.229702 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:56.229635    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdq5x\" (UniqueName: \"kubernetes.io/projected/3628034d-d51e-432c-9ab7-a09bcc7def66-kube-api-access-tdq5x\") pod \"cert-manager-cainjector-559cdd8c87-54tr7\" (UID: \"3628034d-d51e-432c-9ab7-a09bcc7def66\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-54tr7"
Sep 15 11:29:56.229924 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:56.229762    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3628034d-d51e-432c-9ab7-a09bcc7def66-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-54tr7\" (UID: \"3628034d-d51e-432c-9ab7-a09bcc7def66\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-54tr7"
Sep 15 11:29:56.244880 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:56.244838    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3628034d-d51e-432c-9ab7-a09bcc7def66-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-54tr7\" (UID: \"3628034d-d51e-432c-9ab7-a09bcc7def66\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-54tr7"
Sep 15 11:29:56.249156 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:56.249096    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdq5x\" (UniqueName: \"kubernetes.io/projected/3628034d-d51e-432c-9ab7-a09bcc7def66-kube-api-access-tdq5x\") pod \"cert-manager-cainjector-559cdd8c87-54tr7\" (UID: \"3628034d-d51e-432c-9ab7-a09bcc7def66\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-54tr7"
Sep 15 11:29:56.396515 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:56.396415    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-54tr7"
Sep 15 11:29:56.424140 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:56.424102    2575 generic.go:356] "Generic (PLEG): container finished" podID="1b86598d-443f-484a-b81b-ba834d8e5d1f" containerID="b0349157bc1a52d9ff7df5c32eaadb9771324ba7711162014704971db3825a39" exitCode=0
Sep 15 11:29:56.424337 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:56.424194    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w6gl" event={"ID":"1b86598d-443f-484a-b81b-ba834d8e5d1f","Type":"ContainerDied","Data":"b0349157bc1a52d9ff7df5c32eaadb9771324ba7711162014704971db3825a39"}
Sep 15 11:29:56.683636 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:56.683604    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-54tr7"]
Sep 15 11:29:57.432640 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:57.432601    2575 generic.go:356] "Generic (PLEG): container finished" podID="1b86598d-443f-484a-b81b-ba834d8e5d1f" containerID="81afb333683d90480d46f4954094094df1de2c2b39e461a87362d28c2060dc83" exitCode=0
Sep 15 11:29:57.433077 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:57.432706    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w6gl" event={"ID":"1b86598d-443f-484a-b81b-ba834d8e5d1f","Type":"ContainerDied","Data":"81afb333683d90480d46f4954094094df1de2c2b39e461a87362d28c2060dc83"}
Sep 15 11:29:57.524421 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:29:57.524377    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3628034d_d51e_432c_9ab7_a09bcc7def66.slice/crio-abed1fe7acd0585c6c0a74699a46884725fde5d83d3ce565e22fc0c745c66733 WatchSource:0}: Error finding container abed1fe7acd0585c6c0a74699a46884725fde5d83d3ce565e22fc0c745c66733: Status 404 returned error can't find the container with id abed1fe7acd0585c6c0a74699a46884725fde5d83d3ce565e22fc0c745c66733
Sep 15 11:29:58.440516 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:58.440391    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-xf9dl" event={"ID":"d2069453-cd88-4c2f-8d63-81000aa16be9","Type":"ContainerStarted","Data":"33c80bd56be1a2d0a3df90195923a0445b7eee0ec41f510d1d8c69ec04fa42db"}
Sep 15 11:29:58.441019 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:58.440581    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-xf9dl"
Sep 15 11:29:58.442306 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:58.442274    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-54tr7" event={"ID":"3628034d-d51e-432c-9ab7-a09bcc7def66","Type":"ContainerStarted","Data":"c1fd2b279b9d64a6c4e794ebf81c97be92e93489e517ccc3f4c50a9729df9b34"}
Sep 15 11:29:58.442436 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:58.442317    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-54tr7" event={"ID":"3628034d-d51e-432c-9ab7-a09bcc7def66","Type":"ContainerStarted","Data":"abed1fe7acd0585c6c0a74699a46884725fde5d83d3ce565e22fc0c745c66733"}
Sep 15 11:29:58.495317 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:58.495263    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-xf9dl" podStartSLOduration=2.410309999 podStartE2EDuration="6.495245982s" totalImagesPullingTime="4.084935983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:29:58.492679914 +0000 UTC m=+268.919010513" watchObservedRunningTime="2026-09-15 11:29:58.495245982 +0000 UTC m=+268.921576577"
Sep 15 11:29:58.523535 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:58.523080    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-54tr7" podStartSLOduration=1.951392325 podStartE2EDuration="2.523053372s" totalImagesPullingTime="571.661047ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:29:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:29:58.521728838 +0000 UTC m=+268.948059437" watchObservedRunningTime="2026-09-15 11:29:58.523053372 +0000 UTC m=+268.949383970"
Sep 15 11:29:58.586786 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:58.586643    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w6gl"
Sep 15 11:29:58.652425 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:58.652386    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b86598d-443f-484a-b81b-ba834d8e5d1f-bundle\") pod \"1b86598d-443f-484a-b81b-ba834d8e5d1f\" (UID: \"1b86598d-443f-484a-b81b-ba834d8e5d1f\") "
Sep 15 11:29:58.652425 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:58.652429    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b86598d-443f-484a-b81b-ba834d8e5d1f-util\") pod \"1b86598d-443f-484a-b81b-ba834d8e5d1f\" (UID: \"1b86598d-443f-484a-b81b-ba834d8e5d1f\") "
Sep 15 11:29:58.652693 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:58.652471    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jh46x\" (UniqueName: \"kubernetes.io/projected/1b86598d-443f-484a-b81b-ba834d8e5d1f-kube-api-access-jh46x\") pod \"1b86598d-443f-484a-b81b-ba834d8e5d1f\" (UID: \"1b86598d-443f-484a-b81b-ba834d8e5d1f\") "
Sep 15 11:29:58.652853 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:58.652827    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b86598d-443f-484a-b81b-ba834d8e5d1f-bundle" (OuterVolumeSpecName: "bundle") pod "1b86598d-443f-484a-b81b-ba834d8e5d1f" (UID: "1b86598d-443f-484a-b81b-ba834d8e5d1f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:29:58.654757 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:58.654733    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b86598d-443f-484a-b81b-ba834d8e5d1f-kube-api-access-jh46x" (OuterVolumeSpecName: "kube-api-access-jh46x") pod "1b86598d-443f-484a-b81b-ba834d8e5d1f" (UID: "1b86598d-443f-484a-b81b-ba834d8e5d1f"). InnerVolumeSpecName "kube-api-access-jh46x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:29:58.658433 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:58.658377    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b86598d-443f-484a-b81b-ba834d8e5d1f-util" (OuterVolumeSpecName: "util") pod "1b86598d-443f-484a-b81b-ba834d8e5d1f" (UID: "1b86598d-443f-484a-b81b-ba834d8e5d1f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:29:58.753439 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:58.753348    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b86598d-443f-484a-b81b-ba834d8e5d1f-bundle\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:29:58.753439 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:58.753378    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b86598d-443f-484a-b81b-ba834d8e5d1f-util\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:29:58.753439 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:58.753388    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jh46x\" (UniqueName: \"kubernetes.io/projected/1b86598d-443f-484a-b81b-ba834d8e5d1f-kube-api-access-jh46x\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:29:59.449316 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:59.449275    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w6gl"
Sep 15 11:29:59.449316 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:59.449305    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2w6gl" event={"ID":"1b86598d-443f-484a-b81b-ba834d8e5d1f","Type":"ContainerDied","Data":"0c31e27e0ff93002e639dea791a6ddd086cebf7cc0e75f8c28183dea67cf2a51"}
Sep 15 11:29:59.449902 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:29:59.449355    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0c31e27e0ff93002e639dea791a6ddd086cebf7cc0e75f8c28183dea67cf2a51"
Sep 15 11:30:04.452210 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:04.452174    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-xf9dl"
Sep 15 11:30:05.089221 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:05.089184    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6b4jd"]
Sep 15 11:30:05.089514 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:05.089500    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b86598d-443f-484a-b81b-ba834d8e5d1f" containerName="pull"
Sep 15 11:30:05.089559 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:05.089516    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b86598d-443f-484a-b81b-ba834d8e5d1f" containerName="pull"
Sep 15 11:30:05.089559 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:05.089535    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b86598d-443f-484a-b81b-ba834d8e5d1f" containerName="extract"
Sep 15 11:30:05.089559 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:05.089540    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b86598d-443f-484a-b81b-ba834d8e5d1f" containerName="extract"
Sep 15 11:30:05.089559 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:05.089549    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b86598d-443f-484a-b81b-ba834d8e5d1f" containerName="util"
Sep 15 11:30:05.089559 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:05.089554    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b86598d-443f-484a-b81b-ba834d8e5d1f" containerName="util"
Sep 15 11:30:05.089741 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:05.089612    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b86598d-443f-484a-b81b-ba834d8e5d1f" containerName="extract"
Sep 15 11:30:05.091681 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:05.091642    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-6b4jd"
Sep 15 11:30:05.094547 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:05.094522    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-cw845\""
Sep 15 11:30:05.110289 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:05.110257    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6b4jd"]
Sep 15 11:30:05.213812 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:05.213768    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plpkg\" (UniqueName: \"kubernetes.io/projected/0869036a-4810-4d66-9d54-fb097350b74f-kube-api-access-plpkg\") pod \"cert-manager-55b4d954d5-6b4jd\" (UID: \"0869036a-4810-4d66-9d54-fb097350b74f\") " pod="cert-manager/cert-manager-55b4d954d5-6b4jd"
Sep 15 11:30:05.214054 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:05.213938    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0869036a-4810-4d66-9d54-fb097350b74f-bound-sa-token\") pod \"cert-manager-55b4d954d5-6b4jd\" (UID: \"0869036a-4810-4d66-9d54-fb097350b74f\") " pod="cert-manager/cert-manager-55b4d954d5-6b4jd"
Sep 15 11:30:05.315141 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:05.315099    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0869036a-4810-4d66-9d54-fb097350b74f-bound-sa-token\") pod \"cert-manager-55b4d954d5-6b4jd\" (UID: \"0869036a-4810-4d66-9d54-fb097350b74f\") " pod="cert-manager/cert-manager-55b4d954d5-6b4jd"
Sep 15 11:30:05.315361 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:05.315196    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plpkg\" (UniqueName: \"kubernetes.io/projected/0869036a-4810-4d66-9d54-fb097350b74f-kube-api-access-plpkg\") pod \"cert-manager-55b4d954d5-6b4jd\" (UID: \"0869036a-4810-4d66-9d54-fb097350b74f\") " pod="cert-manager/cert-manager-55b4d954d5-6b4jd"
Sep 15 11:30:05.326824 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:05.326791    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tmdsq"]
Sep 15 11:30:05.329339 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:05.329312    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tmdsq"
Sep 15 11:30:05.330629 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:05.330603    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0869036a-4810-4d66-9d54-fb097350b74f-bound-sa-token\") pod \"cert-manager-55b4d954d5-6b4jd\" (UID: \"0869036a-4810-4d66-9d54-fb097350b74f\") " pod="cert-manager/cert-manager-55b4d954d5-6b4jd"
Sep 15 11:30:05.330770 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:05.330748    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plpkg\" (UniqueName: \"kubernetes.io/projected/0869036a-4810-4d66-9d54-fb097350b74f-kube-api-access-plpkg\") pod \"cert-manager-55b4d954d5-6b4jd\" (UID: \"0869036a-4810-4d66-9d54-fb097350b74f\") " pod="cert-manager/cert-manager-55b4d954d5-6b4jd"
Sep 15 11:30:05.331624 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:05.331596    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 15 11:30:05.331758 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:05.331718    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 15 11:30:05.331818 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:05.331791    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-bwz77\""
Sep 15 11:30:05.344711 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:05.344601    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tmdsq"]
Sep 15 11:30:05.400740 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:05.400695    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-6b4jd"
Sep 15 11:30:05.416123 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:05.416094    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee5b51cf-50e5-4288-8b9f-c45ea8dcff77-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tmdsq\" (UID: \"ee5b51cf-50e5-4288-8b9f-c45ea8dcff77\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tmdsq"
Sep 15 11:30:05.416267 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:05.416150    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbbpc\" (UniqueName: \"kubernetes.io/projected/ee5b51cf-50e5-4288-8b9f-c45ea8dcff77-kube-api-access-wbbpc\") pod \"openshift-lws-operator-fd8ccff4c-tmdsq\" (UID: \"ee5b51cf-50e5-4288-8b9f-c45ea8dcff77\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tmdsq"
Sep 15 11:30:05.517517 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:05.517479    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee5b51cf-50e5-4288-8b9f-c45ea8dcff77-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tmdsq\" (UID: \"ee5b51cf-50e5-4288-8b9f-c45ea8dcff77\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tmdsq"
Sep 15 11:30:05.518069 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:05.517531    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbbpc\" (UniqueName: \"kubernetes.io/projected/ee5b51cf-50e5-4288-8b9f-c45ea8dcff77-kube-api-access-wbbpc\") pod \"openshift-lws-operator-fd8ccff4c-tmdsq\" (UID: \"ee5b51cf-50e5-4288-8b9f-c45ea8dcff77\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tmdsq"
Sep 15 11:30:05.518069 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:05.518025    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee5b51cf-50e5-4288-8b9f-c45ea8dcff77-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tmdsq\" (UID: \"ee5b51cf-50e5-4288-8b9f-c45ea8dcff77\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tmdsq"
Sep 15 11:30:05.529137 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:05.529107    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbbpc\" (UniqueName: \"kubernetes.io/projected/ee5b51cf-50e5-4288-8b9f-c45ea8dcff77-kube-api-access-wbbpc\") pod \"openshift-lws-operator-fd8ccff4c-tmdsq\" (UID: \"ee5b51cf-50e5-4288-8b9f-c45ea8dcff77\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tmdsq"
Sep 15 11:30:05.648064 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:05.647940    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tmdsq"
Sep 15 11:30:05.676696 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:05.676609    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6b4jd"]
Sep 15 11:30:05.680975 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:30:05.680936    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0869036a_4810_4d66_9d54_fb097350b74f.slice/crio-12d1b4c555044f06a804411ebbbbc4185b026549f9280b7607e6f889476d1b29 WatchSource:0}: Error finding container 12d1b4c555044f06a804411ebbbbc4185b026549f9280b7607e6f889476d1b29: Status 404 returned error can't find the container with id 12d1b4c555044f06a804411ebbbbc4185b026549f9280b7607e6f889476d1b29
Sep 15 11:30:05.931328 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:05.931258    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tmdsq"]
Sep 15 11:30:05.933605 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:30:05.933576    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee5b51cf_50e5_4288_8b9f_c45ea8dcff77.slice/crio-4b76f9be1472ec31f54e2ebf91c2d870b578b8de994955a307d7d2da523168b6 WatchSource:0}: Error finding container 4b76f9be1472ec31f54e2ebf91c2d870b578b8de994955a307d7d2da523168b6: Status 404 returned error can't find the container with id 4b76f9be1472ec31f54e2ebf91c2d870b578b8de994955a307d7d2da523168b6
Sep 15 11:30:06.486061 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:06.486014    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-6b4jd" event={"ID":"0869036a-4810-4d66-9d54-fb097350b74f","Type":"ContainerStarted","Data":"f492a0621777c7b186d5f67cb623db7fcf6c8a57eeb5a0c0c9be041c18bdd2fd"}
Sep 15 11:30:06.486260 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:06.486076    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-6b4jd" event={"ID":"0869036a-4810-4d66-9d54-fb097350b74f","Type":"ContainerStarted","Data":"12d1b4c555044f06a804411ebbbbc4185b026549f9280b7607e6f889476d1b29"}
Sep 15 11:30:06.487408 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:06.487378    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tmdsq" event={"ID":"ee5b51cf-50e5-4288-8b9f-c45ea8dcff77","Type":"ContainerStarted","Data":"4b76f9be1472ec31f54e2ebf91c2d870b578b8de994955a307d7d2da523168b6"}
Sep 15 11:30:06.503219 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:06.503155    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-6b4jd" podStartSLOduration=1.503132762 podStartE2EDuration="1.503132762s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:30:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:30:06.502838326 +0000 UTC m=+276.929168923" watchObservedRunningTime="2026-09-15 11:30:06.503132762 +0000 UTC m=+276.929463358"
Sep 15 11:30:08.501860 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:08.501822    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tmdsq" event={"ID":"ee5b51cf-50e5-4288-8b9f-c45ea8dcff77","Type":"ContainerStarted","Data":"47c58bb07023b889dddca7d51c19a7af18057753b10f2081bca78acbc8b51989"}
Sep 15 11:30:08.519350 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:08.519284    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tmdsq" podStartSLOduration=1.425109418 podStartE2EDuration="3.519257449s" totalImagesPullingTime="2.094148031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:30:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:30:08.518489511 +0000 UTC m=+278.944820107" watchObservedRunningTime="2026-09-15 11:30:08.519257449 +0000 UTC m=+278.945588048"
Sep 15 11:30:11.523175 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:11.523133    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff88z4"]
Sep 15 11:30:11.543519 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:11.543487    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff88z4"]
Sep 15 11:30:11.543721 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:11.543605    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff88z4"
Sep 15 11:30:11.546529 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:11.546499    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 11:30:11.547350 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:11.547329    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 11:30:11.547350 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:11.547338    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4z5m2\""
Sep 15 11:30:11.676644 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:11.676597    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zn9j4\" (UniqueName: \"kubernetes.io/projected/e34b604c-2e79-4bd2-8fa2-24b28efa9bbf-kube-api-access-zn9j4\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff88z4\" (UID: \"e34b604c-2e79-4bd2-8fa2-24b28efa9bbf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff88z4"
Sep 15 11:30:11.676871 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:11.676689    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e34b604c-2e79-4bd2-8fa2-24b28efa9bbf-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff88z4\" (UID: \"e34b604c-2e79-4bd2-8fa2-24b28efa9bbf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff88z4"
Sep 15 11:30:11.676871 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:11.676749    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e34b604c-2e79-4bd2-8fa2-24b28efa9bbf-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff88z4\" (UID: \"e34b604c-2e79-4bd2-8fa2-24b28efa9bbf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff88z4"
Sep 15 11:30:11.777984 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:11.777893    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e34b604c-2e79-4bd2-8fa2-24b28efa9bbf-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff88z4\" (UID: \"e34b604c-2e79-4bd2-8fa2-24b28efa9bbf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff88z4"
Sep 15 11:30:11.777984 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:11.777949    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zn9j4\" (UniqueName: \"kubernetes.io/projected/e34b604c-2e79-4bd2-8fa2-24b28efa9bbf-kube-api-access-zn9j4\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff88z4\" (UID: \"e34b604c-2e79-4bd2-8fa2-24b28efa9bbf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff88z4"
Sep 15 11:30:11.777984 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:11.777984    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e34b604c-2e79-4bd2-8fa2-24b28efa9bbf-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff88z4\" (UID: \"e34b604c-2e79-4bd2-8fa2-24b28efa9bbf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff88z4"
Sep 15 11:30:11.778317 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:11.778299    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e34b604c-2e79-4bd2-8fa2-24b28efa9bbf-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff88z4\" (UID: \"e34b604c-2e79-4bd2-8fa2-24b28efa9bbf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff88z4"
Sep 15 11:30:11.778362 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:11.778323    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e34b604c-2e79-4bd2-8fa2-24b28efa9bbf-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff88z4\" (UID: \"e34b604c-2e79-4bd2-8fa2-24b28efa9bbf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff88z4"
Sep 15 11:30:11.789295 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:11.789253    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zn9j4\" (UniqueName: \"kubernetes.io/projected/e34b604c-2e79-4bd2-8fa2-24b28efa9bbf-kube-api-access-zn9j4\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff88z4\" (UID: \"e34b604c-2e79-4bd2-8fa2-24b28efa9bbf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff88z4"
Sep 15 11:30:11.853914 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:11.853875    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff88z4"
Sep 15 11:30:12.146806 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:12.146778    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff88z4"]
Sep 15 11:30:12.148895 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:30:12.148863    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode34b604c_2e79_4bd2_8fa2_24b28efa9bbf.slice/crio-9ec2b188492e2fa47c988ba695c45fcceca19e86ce2c61ca35d681d239684d31 WatchSource:0}: Error finding container 9ec2b188492e2fa47c988ba695c45fcceca19e86ce2c61ca35d681d239684d31: Status 404 returned error can't find the container with id 9ec2b188492e2fa47c988ba695c45fcceca19e86ce2c61ca35d681d239684d31
Sep 15 11:30:12.524710 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:12.524596    2575 generic.go:356] "Generic (PLEG): container finished" podID="e34b604c-2e79-4bd2-8fa2-24b28efa9bbf" containerID="5fa50018b06a404751a2391e82b78dd20737251e63ad8d914518c16239af8ed4" exitCode=0
Sep 15 11:30:12.525135 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:12.524727    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff88z4" event={"ID":"e34b604c-2e79-4bd2-8fa2-24b28efa9bbf","Type":"ContainerDied","Data":"5fa50018b06a404751a2391e82b78dd20737251e63ad8d914518c16239af8ed4"}
Sep 15 11:30:12.525135 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:12.524803    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff88z4" event={"ID":"e34b604c-2e79-4bd2-8fa2-24b28efa9bbf","Type":"ContainerStarted","Data":"9ec2b188492e2fa47c988ba695c45fcceca19e86ce2c61ca35d681d239684d31"}
Sep 15 11:30:13.530986 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:13.530948    2575 generic.go:356] "Generic (PLEG): container finished" podID="e34b604c-2e79-4bd2-8fa2-24b28efa9bbf" containerID="cdf2f1a95d9b6d762c935b45d09715c5f1a4e2b6f5c5f698d692f34e7c1f1b96" exitCode=0
Sep 15 11:30:13.531384 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:13.531014    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff88z4" event={"ID":"e34b604c-2e79-4bd2-8fa2-24b28efa9bbf","Type":"ContainerDied","Data":"cdf2f1a95d9b6d762c935b45d09715c5f1a4e2b6f5c5f698d692f34e7c1f1b96"}
Sep 15 11:30:14.538552 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:14.538513    2575 generic.go:356] "Generic (PLEG): container finished" podID="e34b604c-2e79-4bd2-8fa2-24b28efa9bbf" containerID="d4704bf23fe60e0e00c93e5bc5356bd4d3cdf662c08019f7ad50b714029eb23a" exitCode=0
Sep 15 11:30:14.538990 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:14.538605    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff88z4" event={"ID":"e34b604c-2e79-4bd2-8fa2-24b28efa9bbf","Type":"ContainerDied","Data":"d4704bf23fe60e0e00c93e5bc5356bd4d3cdf662c08019f7ad50b714029eb23a"}
Sep 15 11:30:15.670953 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:15.670927    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff88z4"
Sep 15 11:30:15.814527 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:15.814423    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e34b604c-2e79-4bd2-8fa2-24b28efa9bbf-util\") pod \"e34b604c-2e79-4bd2-8fa2-24b28efa9bbf\" (UID: \"e34b604c-2e79-4bd2-8fa2-24b28efa9bbf\") "
Sep 15 11:30:15.814527 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:15.814468    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zn9j4\" (UniqueName: \"kubernetes.io/projected/e34b604c-2e79-4bd2-8fa2-24b28efa9bbf-kube-api-access-zn9j4\") pod \"e34b604c-2e79-4bd2-8fa2-24b28efa9bbf\" (UID: \"e34b604c-2e79-4bd2-8fa2-24b28efa9bbf\") "
Sep 15 11:30:15.814527 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:15.814503    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e34b604c-2e79-4bd2-8fa2-24b28efa9bbf-bundle\") pod \"e34b604c-2e79-4bd2-8fa2-24b28efa9bbf\" (UID: \"e34b604c-2e79-4bd2-8fa2-24b28efa9bbf\") "
Sep 15 11:30:15.815334 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:15.815303    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e34b604c-2e79-4bd2-8fa2-24b28efa9bbf-bundle" (OuterVolumeSpecName: "bundle") pod "e34b604c-2e79-4bd2-8fa2-24b28efa9bbf" (UID: "e34b604c-2e79-4bd2-8fa2-24b28efa9bbf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:30:15.816723 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:15.816680    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e34b604c-2e79-4bd2-8fa2-24b28efa9bbf-kube-api-access-zn9j4" (OuterVolumeSpecName: "kube-api-access-zn9j4") pod "e34b604c-2e79-4bd2-8fa2-24b28efa9bbf" (UID: "e34b604c-2e79-4bd2-8fa2-24b28efa9bbf"). InnerVolumeSpecName "kube-api-access-zn9j4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:30:15.820649 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:15.820590    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e34b604c-2e79-4bd2-8fa2-24b28efa9bbf-util" (OuterVolumeSpecName: "util") pod "e34b604c-2e79-4bd2-8fa2-24b28efa9bbf" (UID: "e34b604c-2e79-4bd2-8fa2-24b28efa9bbf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:30:15.915414 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:15.915374    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e34b604c-2e79-4bd2-8fa2-24b28efa9bbf-util\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:30:15.915414 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:15.915405    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zn9j4\" (UniqueName: \"kubernetes.io/projected/e34b604c-2e79-4bd2-8fa2-24b28efa9bbf-kube-api-access-zn9j4\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:30:15.915619 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:15.915432    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e34b604c-2e79-4bd2-8fa2-24b28efa9bbf-bundle\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:30:16.550743 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:16.550648    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff88z4"
Sep 15 11:30:16.550743 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:16.550647    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff88z4" event={"ID":"e34b604c-2e79-4bd2-8fa2-24b28efa9bbf","Type":"ContainerDied","Data":"9ec2b188492e2fa47c988ba695c45fcceca19e86ce2c61ca35d681d239684d31"}
Sep 15 11:30:16.550743 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:16.550713    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9ec2b188492e2fa47c988ba695c45fcceca19e86ce2c61ca35d681d239684d31"
Sep 15 11:30:26.370776 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:26.370735    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0khlxg"]
Sep 15 11:30:26.371192 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:26.371083    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e34b604c-2e79-4bd2-8fa2-24b28efa9bbf" containerName="pull"
Sep 15 11:30:26.371192 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:26.371095    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e34b604c-2e79-4bd2-8fa2-24b28efa9bbf" containerName="pull"
Sep 15 11:30:26.371192 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:26.371121    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e34b604c-2e79-4bd2-8fa2-24b28efa9bbf" containerName="extract"
Sep 15 11:30:26.371192 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:26.371127    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e34b604c-2e79-4bd2-8fa2-24b28efa9bbf" containerName="extract"
Sep 15 11:30:26.371192 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:26.371137    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e34b604c-2e79-4bd2-8fa2-24b28efa9bbf" containerName="util"
Sep 15 11:30:26.371192 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:26.371142    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e34b604c-2e79-4bd2-8fa2-24b28efa9bbf" containerName="util"
Sep 15 11:30:26.371192 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:26.371193    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e34b604c-2e79-4bd2-8fa2-24b28efa9bbf" containerName="extract"
Sep 15 11:30:26.373505 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:26.373485    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0khlxg"
Sep 15 11:30:26.377505 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:26.377477    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 11:30:26.377648 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:26.377575    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 11:30:26.378243 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:26.378226    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4z5m2\""
Sep 15 11:30:26.404479 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:26.404441    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0khlxg"]
Sep 15 11:30:26.515160 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:26.515113    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2917d427-cb7d-4ccd-a54d-de5c62d504dc-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0khlxg\" (UID: \"2917d427-cb7d-4ccd-a54d-de5c62d504dc\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0khlxg"
Sep 15 11:30:26.515362 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:26.515188    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2917d427-cb7d-4ccd-a54d-de5c62d504dc-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0khlxg\" (UID: \"2917d427-cb7d-4ccd-a54d-de5c62d504dc\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0khlxg"
Sep 15 11:30:26.515362 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:26.515279    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpxhv\" (UniqueName: \"kubernetes.io/projected/2917d427-cb7d-4ccd-a54d-de5c62d504dc-kube-api-access-gpxhv\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0khlxg\" (UID: \"2917d427-cb7d-4ccd-a54d-de5c62d504dc\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0khlxg"
Sep 15 11:30:26.616082 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:26.616042    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2917d427-cb7d-4ccd-a54d-de5c62d504dc-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0khlxg\" (UID: \"2917d427-cb7d-4ccd-a54d-de5c62d504dc\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0khlxg"
Sep 15 11:30:26.616253 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:26.616102    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2917d427-cb7d-4ccd-a54d-de5c62d504dc-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0khlxg\" (UID: \"2917d427-cb7d-4ccd-a54d-de5c62d504dc\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0khlxg"
Sep 15 11:30:26.616253 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:26.616135    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpxhv\" (UniqueName: \"kubernetes.io/projected/2917d427-cb7d-4ccd-a54d-de5c62d504dc-kube-api-access-gpxhv\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0khlxg\" (UID: \"2917d427-cb7d-4ccd-a54d-de5c62d504dc\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0khlxg"
Sep 15 11:30:26.616493 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:26.616471    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2917d427-cb7d-4ccd-a54d-de5c62d504dc-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0khlxg\" (UID: \"2917d427-cb7d-4ccd-a54d-de5c62d504dc\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0khlxg"
Sep 15 11:30:26.616530 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:26.616505    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2917d427-cb7d-4ccd-a54d-de5c62d504dc-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0khlxg\" (UID: \"2917d427-cb7d-4ccd-a54d-de5c62d504dc\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0khlxg"
Sep 15 11:30:26.628399 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:26.628339    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpxhv\" (UniqueName: \"kubernetes.io/projected/2917d427-cb7d-4ccd-a54d-de5c62d504dc-kube-api-access-gpxhv\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0khlxg\" (UID: \"2917d427-cb7d-4ccd-a54d-de5c62d504dc\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0khlxg"
Sep 15 11:30:26.682983 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:26.682939    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0khlxg"
Sep 15 11:30:26.963226 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:26.963134    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0khlxg"]
Sep 15 11:30:26.966159 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:30:26.966126    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2917d427_cb7d_4ccd_a54d_de5c62d504dc.slice/crio-dcc3b893cbfb8f7178c18d6aafda43eff48bcf816fd8e03a04a5d3c7f3ced0c2 WatchSource:0}: Error finding container dcc3b893cbfb8f7178c18d6aafda43eff48bcf816fd8e03a04a5d3c7f3ced0c2: Status 404 returned error can't find the container with id dcc3b893cbfb8f7178c18d6aafda43eff48bcf816fd8e03a04a5d3c7f3ced0c2
Sep 15 11:30:27.609217 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:27.609182    2575 generic.go:356] "Generic (PLEG): container finished" podID="2917d427-cb7d-4ccd-a54d-de5c62d504dc" containerID="5ddb5f9af69675fcd09c5ee8e0183c0ab51412729c5d4a05128e94d5a9c6073b" exitCode=0
Sep 15 11:30:27.609668 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:27.609271    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0khlxg" event={"ID":"2917d427-cb7d-4ccd-a54d-de5c62d504dc","Type":"ContainerDied","Data":"5ddb5f9af69675fcd09c5ee8e0183c0ab51412729c5d4a05128e94d5a9c6073b"}
Sep 15 11:30:27.609668 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:27.609333    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0khlxg" event={"ID":"2917d427-cb7d-4ccd-a54d-de5c62d504dc","Type":"ContainerStarted","Data":"dcc3b893cbfb8f7178c18d6aafda43eff48bcf816fd8e03a04a5d3c7f3ced0c2"}
Sep 15 11:30:27.809685 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:27.809631    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b96c7c888-9nzmj"]
Sep 15 11:30:27.812896 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:27.812864    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b96c7c888-9nzmj"
Sep 15 11:30:27.815877 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:27.815850    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 15 11:30:27.815877 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:27.815871    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 15 11:30:27.816233 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:27.816216    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 15 11:30:27.816286 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:27.816238    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-vtkfp\""
Sep 15 11:30:27.816917 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:27.816896    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 15 11:30:27.837232 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:27.837199    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b96c7c888-9nzmj"]
Sep 15 11:30:27.929233 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:27.929133    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/66140c79-49a9-451d-8815-727ceed5f655-manifests\") pod \"opendatahub-operator-controller-manager-b96c7c888-9nzmj\" (UID: \"66140c79-49a9-451d-8815-727ceed5f655\") " pod="opendatahub/opendatahub-operator-controller-manager-b96c7c888-9nzmj"
Sep 15 11:30:27.929233 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:27.929181    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qx9v\" (UniqueName: \"kubernetes.io/projected/66140c79-49a9-451d-8815-727ceed5f655-kube-api-access-7qx9v\") pod \"opendatahub-operator-controller-manager-b96c7c888-9nzmj\" (UID: \"66140c79-49a9-451d-8815-727ceed5f655\") " pod="opendatahub/opendatahub-operator-controller-manager-b96c7c888-9nzmj"
Sep 15 11:30:27.929421 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:27.929270    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/66140c79-49a9-451d-8815-727ceed5f655-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b96c7c888-9nzmj\" (UID: \"66140c79-49a9-451d-8815-727ceed5f655\") " pod="opendatahub/opendatahub-operator-controller-manager-b96c7c888-9nzmj"
Sep 15 11:30:27.929421 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:27.929319    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66140c79-49a9-451d-8815-727ceed5f655-tmp\") pod \"opendatahub-operator-controller-manager-b96c7c888-9nzmj\" (UID: \"66140c79-49a9-451d-8815-727ceed5f655\") " pod="opendatahub/opendatahub-operator-controller-manager-b96c7c888-9nzmj"
Sep 15 11:30:27.929421 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:27.929363    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/66140c79-49a9-451d-8815-727ceed5f655-webhook-cert\") pod \"opendatahub-operator-controller-manager-b96c7c888-9nzmj\" (UID: \"66140c79-49a9-451d-8815-727ceed5f655\") " pod="opendatahub/opendatahub-operator-controller-manager-b96c7c888-9nzmj"
Sep 15 11:30:28.030506 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:28.030442    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/66140c79-49a9-451d-8815-727ceed5f655-webhook-cert\") pod \"opendatahub-operator-controller-manager-b96c7c888-9nzmj\" (UID: \"66140c79-49a9-451d-8815-727ceed5f655\") " pod="opendatahub/opendatahub-operator-controller-manager-b96c7c888-9nzmj"
Sep 15 11:30:28.030730 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:28.030529    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/66140c79-49a9-451d-8815-727ceed5f655-manifests\") pod \"opendatahub-operator-controller-manager-b96c7c888-9nzmj\" (UID: \"66140c79-49a9-451d-8815-727ceed5f655\") " pod="opendatahub/opendatahub-operator-controller-manager-b96c7c888-9nzmj"
Sep 15 11:30:28.030730 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:28.030551    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qx9v\" (UniqueName: \"kubernetes.io/projected/66140c79-49a9-451d-8815-727ceed5f655-kube-api-access-7qx9v\") pod \"opendatahub-operator-controller-manager-b96c7c888-9nzmj\" (UID: \"66140c79-49a9-451d-8815-727ceed5f655\") " pod="opendatahub/opendatahub-operator-controller-manager-b96c7c888-9nzmj"
Sep 15 11:30:28.030730 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:28.030593    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/66140c79-49a9-451d-8815-727ceed5f655-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b96c7c888-9nzmj\" (UID: \"66140c79-49a9-451d-8815-727ceed5f655\") " pod="opendatahub/opendatahub-operator-controller-manager-b96c7c888-9nzmj"
Sep 15 11:30:28.030730 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:28.030625    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66140c79-49a9-451d-8815-727ceed5f655-tmp\") pod \"opendatahub-operator-controller-manager-b96c7c888-9nzmj\" (UID: \"66140c79-49a9-451d-8815-727ceed5f655\") " pod="opendatahub/opendatahub-operator-controller-manager-b96c7c888-9nzmj"
Sep 15 11:30:28.031073 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:28.031048    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/66140c79-49a9-451d-8815-727ceed5f655-manifests\") pod \"opendatahub-operator-controller-manager-b96c7c888-9nzmj\" (UID: \"66140c79-49a9-451d-8815-727ceed5f655\") " pod="opendatahub/opendatahub-operator-controller-manager-b96c7c888-9nzmj"
Sep 15 11:30:28.033059 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:28.033027    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66140c79-49a9-451d-8815-727ceed5f655-tmp\") pod \"opendatahub-operator-controller-manager-b96c7c888-9nzmj\" (UID: \"66140c79-49a9-451d-8815-727ceed5f655\") " pod="opendatahub/opendatahub-operator-controller-manager-b96c7c888-9nzmj"
Sep 15 11:30:28.033188 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:28.033169    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/66140c79-49a9-451d-8815-727ceed5f655-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b96c7c888-9nzmj\" (UID: \"66140c79-49a9-451d-8815-727ceed5f655\") " pod="opendatahub/opendatahub-operator-controller-manager-b96c7c888-9nzmj"
Sep 15 11:30:28.033236 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:28.033214    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/66140c79-49a9-451d-8815-727ceed5f655-webhook-cert\") pod \"opendatahub-operator-controller-manager-b96c7c888-9nzmj\" (UID: \"66140c79-49a9-451d-8815-727ceed5f655\") " pod="opendatahub/opendatahub-operator-controller-manager-b96c7c888-9nzmj"
Sep 15 11:30:28.050875 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:28.050834    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qx9v\" (UniqueName: \"kubernetes.io/projected/66140c79-49a9-451d-8815-727ceed5f655-kube-api-access-7qx9v\") pod \"opendatahub-operator-controller-manager-b96c7c888-9nzmj\" (UID: \"66140c79-49a9-451d-8815-727ceed5f655\") " pod="opendatahub/opendatahub-operator-controller-manager-b96c7c888-9nzmj"
Sep 15 11:30:28.124479 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:28.124410    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b96c7c888-9nzmj"
Sep 15 11:30:28.422223 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:28.422195    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b96c7c888-9nzmj"]
Sep 15 11:30:28.457805 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:30:28.457720    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66140c79_49a9_451d_8815_727ceed5f655.slice/crio-103f062ebb978df4e52a11266ef3d3f0fe9770966e7c01d1b3c5f811218a2f46 WatchSource:0}: Error finding container 103f062ebb978df4e52a11266ef3d3f0fe9770966e7c01d1b3c5f811218a2f46: Status 404 returned error can't find the container with id 103f062ebb978df4e52a11266ef3d3f0fe9770966e7c01d1b3c5f811218a2f46
Sep 15 11:30:28.617416 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:28.617377    2575 generic.go:356] "Generic (PLEG): container finished" podID="2917d427-cb7d-4ccd-a54d-de5c62d504dc" containerID="5f6e9bea79c87a1db6b630feb6ff96c44666cda9eb47f2eea326b1c970133c38" exitCode=0
Sep 15 11:30:28.617943 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:28.617415    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0khlxg" event={"ID":"2917d427-cb7d-4ccd-a54d-de5c62d504dc","Type":"ContainerDied","Data":"5f6e9bea79c87a1db6b630feb6ff96c44666cda9eb47f2eea326b1c970133c38"}
Sep 15 11:30:28.619170 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:28.619051    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b96c7c888-9nzmj" event={"ID":"66140c79-49a9-451d-8815-727ceed5f655","Type":"ContainerStarted","Data":"103f062ebb978df4e52a11266ef3d3f0fe9770966e7c01d1b3c5f811218a2f46"}
Sep 15 11:30:29.628759 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:29.628704    2575 generic.go:356] "Generic (PLEG): container finished" podID="2917d427-cb7d-4ccd-a54d-de5c62d504dc" containerID="6bc9e39629d04c45ea940ad6ab8db23a70d9d0d901008f063e48b42c38db481e" exitCode=0
Sep 15 11:30:29.629244 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:29.628851    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0khlxg" event={"ID":"2917d427-cb7d-4ccd-a54d-de5c62d504dc","Type":"ContainerDied","Data":"6bc9e39629d04c45ea940ad6ab8db23a70d9d0d901008f063e48b42c38db481e"}
Sep 15 11:30:31.568255 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:31.568221    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0khlxg"
Sep 15 11:30:31.584786 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:31.584758    2575 kubelet.go:1648] "Image garbage collection succeeded"
Sep 15 11:30:31.641702 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:31.641644    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0khlxg" event={"ID":"2917d427-cb7d-4ccd-a54d-de5c62d504dc","Type":"ContainerDied","Data":"dcc3b893cbfb8f7178c18d6aafda43eff48bcf816fd8e03a04a5d3c7f3ced0c2"}
Sep 15 11:30:31.641702 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:31.641679    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0khlxg"
Sep 15 11:30:31.641821 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:31.641722    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dcc3b893cbfb8f7178c18d6aafda43eff48bcf816fd8e03a04a5d3c7f3ced0c2"
Sep 15 11:30:31.665731 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:31.665680    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2917d427-cb7d-4ccd-a54d-de5c62d504dc-bundle\") pod \"2917d427-cb7d-4ccd-a54d-de5c62d504dc\" (UID: \"2917d427-cb7d-4ccd-a54d-de5c62d504dc\") "
Sep 15 11:30:31.665929 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:31.665766    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpxhv\" (UniqueName: \"kubernetes.io/projected/2917d427-cb7d-4ccd-a54d-de5c62d504dc-kube-api-access-gpxhv\") pod \"2917d427-cb7d-4ccd-a54d-de5c62d504dc\" (UID: \"2917d427-cb7d-4ccd-a54d-de5c62d504dc\") "
Sep 15 11:30:31.666445 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:31.666410    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2917d427-cb7d-4ccd-a54d-de5c62d504dc-bundle" (OuterVolumeSpecName: "bundle") pod "2917d427-cb7d-4ccd-a54d-de5c62d504dc" (UID: "2917d427-cb7d-4ccd-a54d-de5c62d504dc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:30:31.667908 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:31.667884    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2917d427-cb7d-4ccd-a54d-de5c62d504dc-kube-api-access-gpxhv" (OuterVolumeSpecName: "kube-api-access-gpxhv") pod "2917d427-cb7d-4ccd-a54d-de5c62d504dc" (UID: "2917d427-cb7d-4ccd-a54d-de5c62d504dc"). InnerVolumeSpecName "kube-api-access-gpxhv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:30:31.766446 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:31.766392    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2917d427-cb7d-4ccd-a54d-de5c62d504dc-util\") pod \"2917d427-cb7d-4ccd-a54d-de5c62d504dc\" (UID: \"2917d427-cb7d-4ccd-a54d-de5c62d504dc\") "
Sep 15 11:30:31.766621 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:31.766568    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2917d427-cb7d-4ccd-a54d-de5c62d504dc-bundle\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:30:31.766621 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:31.766579    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpxhv\" (UniqueName: \"kubernetes.io/projected/2917d427-cb7d-4ccd-a54d-de5c62d504dc-kube-api-access-gpxhv\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:30:31.772147 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:31.772114    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2917d427-cb7d-4ccd-a54d-de5c62d504dc-util" (OuterVolumeSpecName: "util") pod "2917d427-cb7d-4ccd-a54d-de5c62d504dc" (UID: "2917d427-cb7d-4ccd-a54d-de5c62d504dc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:30:31.867080 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:31.867030    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2917d427-cb7d-4ccd-a54d-de5c62d504dc-util\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:30:32.648493 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:32.648452    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b96c7c888-9nzmj" event={"ID":"66140c79-49a9-451d-8815-727ceed5f655","Type":"ContainerStarted","Data":"ddd48e17068938a14d1c1357ac60cc259762426446a3ac4fd1a34feec4496c99"}
Sep 15 11:30:33.656031 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:33.655985    2575 generic.go:356] "Generic (PLEG): container finished" podID="66140c79-49a9-451d-8815-727ceed5f655" containerID="ddd48e17068938a14d1c1357ac60cc259762426446a3ac4fd1a34feec4496c99" exitCode=0
Sep 15 11:30:33.656448 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:33.656052    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b96c7c888-9nzmj" event={"ID":"66140c79-49a9-451d-8815-727ceed5f655","Type":"ContainerDied","Data":"ddd48e17068938a14d1c1357ac60cc259762426446a3ac4fd1a34feec4496c99"}
Sep 15 11:30:33.656600 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:33.656582    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 11:30:34.663012 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:34.662979    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b96c7c888-9nzmj" event={"ID":"66140c79-49a9-451d-8815-727ceed5f655","Type":"ContainerStarted","Data":"d16d40415646b3b065a5c639972a2233d93528bfda8d971a83cb0b8eeebe95ea"}
Sep 15 11:30:34.663404 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:34.663087    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b96c7c888-9nzmj"
Sep 15 11:30:34.692512 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:34.692452    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-b96c7c888-9nzmj" podStartSLOduration=2.853360593 podStartE2EDuration="7.692435315s" totalImagesPullingTime="3.663078168s" totalInitContainerRuntime="1.175996554s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:30:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:30:34.689869163 +0000 UTC m=+305.116199758" watchObservedRunningTime="2026-09-15 11:30:34.692435315 +0000 UTC m=+305.118765910"
Sep 15 11:30:45.670941 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:45.670900    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b96c7c888-9nzmj"
Sep 15 11:30:48.347336 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:48.347295    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-79674675df-ptdl6"]
Sep 15 11:30:48.347829 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:48.347671    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2917d427-cb7d-4ccd-a54d-de5c62d504dc" containerName="util"
Sep 15 11:30:48.347829 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:48.347688    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2917d427-cb7d-4ccd-a54d-de5c62d504dc" containerName="util"
Sep 15 11:30:48.347829 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:48.347702    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2917d427-cb7d-4ccd-a54d-de5c62d504dc" containerName="extract"
Sep 15 11:30:48.347829 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:48.347708    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2917d427-cb7d-4ccd-a54d-de5c62d504dc" containerName="extract"
Sep 15 11:30:48.347829 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:48.347726    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2917d427-cb7d-4ccd-a54d-de5c62d504dc" containerName="pull"
Sep 15 11:30:48.347829 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:48.347732    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2917d427-cb7d-4ccd-a54d-de5c62d504dc" containerName="pull"
Sep 15 11:30:48.347829 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:48.347787    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2917d427-cb7d-4ccd-a54d-de5c62d504dc" containerName="extract"
Sep 15 11:30:48.356019 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:48.355987    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-79674675df-ptdl6"
Sep 15 11:30:48.378958 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:48.378928    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-79674675df-ptdl6"]
Sep 15 11:30:48.390465 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:48.390425    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 15 11:30:48.391356 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:48.391313    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 15 11:30:48.391356 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:48.391321    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 15 11:30:48.391574 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:48.391323    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 15 11:30:48.391574 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:48.391443    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-sdl7t\""
Sep 15 11:30:48.412990 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:48.412949    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r47r4\" (UniqueName: \"kubernetes.io/projected/a3719401-4dc0-4e1c-b3b7-f669615eb88a-kube-api-access-r47r4\") pod \"kube-auth-proxy-79674675df-ptdl6\" (UID: \"a3719401-4dc0-4e1c-b3b7-f669615eb88a\") " pod="openshift-ingress/kube-auth-proxy-79674675df-ptdl6"
Sep 15 11:30:48.412990 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:48.412993    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3719401-4dc0-4e1c-b3b7-f669615eb88a-tls-certs\") pod \"kube-auth-proxy-79674675df-ptdl6\" (UID: \"a3719401-4dc0-4e1c-b3b7-f669615eb88a\") " pod="openshift-ingress/kube-auth-proxy-79674675df-ptdl6"
Sep 15 11:30:48.413202 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:48.413068    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3719401-4dc0-4e1c-b3b7-f669615eb88a-tmp\") pod \"kube-auth-proxy-79674675df-ptdl6\" (UID: \"a3719401-4dc0-4e1c-b3b7-f669615eb88a\") " pod="openshift-ingress/kube-auth-proxy-79674675df-ptdl6"
Sep 15 11:30:48.513931 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:48.513883    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r47r4\" (UniqueName: \"kubernetes.io/projected/a3719401-4dc0-4e1c-b3b7-f669615eb88a-kube-api-access-r47r4\") pod \"kube-auth-proxy-79674675df-ptdl6\" (UID: \"a3719401-4dc0-4e1c-b3b7-f669615eb88a\") " pod="openshift-ingress/kube-auth-proxy-79674675df-ptdl6"
Sep 15 11:30:48.513931 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:48.513933    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3719401-4dc0-4e1c-b3b7-f669615eb88a-tls-certs\") pod \"kube-auth-proxy-79674675df-ptdl6\" (UID: \"a3719401-4dc0-4e1c-b3b7-f669615eb88a\") " pod="openshift-ingress/kube-auth-proxy-79674675df-ptdl6"
Sep 15 11:30:48.514220 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:48.513977    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3719401-4dc0-4e1c-b3b7-f669615eb88a-tmp\") pod \"kube-auth-proxy-79674675df-ptdl6\" (UID: \"a3719401-4dc0-4e1c-b3b7-f669615eb88a\") " pod="openshift-ingress/kube-auth-proxy-79674675df-ptdl6"
Sep 15 11:30:48.516435 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:48.516403    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3719401-4dc0-4e1c-b3b7-f669615eb88a-tmp\") pod \"kube-auth-proxy-79674675df-ptdl6\" (UID: \"a3719401-4dc0-4e1c-b3b7-f669615eb88a\") " pod="openshift-ingress/kube-auth-proxy-79674675df-ptdl6"
Sep 15 11:30:48.516577 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:48.516540    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3719401-4dc0-4e1c-b3b7-f669615eb88a-tls-certs\") pod \"kube-auth-proxy-79674675df-ptdl6\" (UID: \"a3719401-4dc0-4e1c-b3b7-f669615eb88a\") " pod="openshift-ingress/kube-auth-proxy-79674675df-ptdl6"
Sep 15 11:30:48.615360 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:48.615282    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r47r4\" (UniqueName: \"kubernetes.io/projected/a3719401-4dc0-4e1c-b3b7-f669615eb88a-kube-api-access-r47r4\") pod \"kube-auth-proxy-79674675df-ptdl6\" (UID: \"a3719401-4dc0-4e1c-b3b7-f669615eb88a\") " pod="openshift-ingress/kube-auth-proxy-79674675df-ptdl6"
Sep 15 11:30:48.666332 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:48.666293    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-79674675df-ptdl6"
Sep 15 11:30:48.980319 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:48.980236    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-79674675df-ptdl6"]
Sep 15 11:30:48.983683 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:30:48.983622    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3719401_4dc0_4e1c_b3b7_f669615eb88a.slice/crio-7a9516ec0334336e5baa336c2bf9aaf661262f05e3a7fefd16a5713194dbd6c6 WatchSource:0}: Error finding container 7a9516ec0334336e5baa336c2bf9aaf661262f05e3a7fefd16a5713194dbd6c6: Status 404 returned error can't find the container with id 7a9516ec0334336e5baa336c2bf9aaf661262f05e3a7fefd16a5713194dbd6c6
Sep 15 11:30:49.743386 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:49.743347    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-79674675df-ptdl6" event={"ID":"a3719401-4dc0-4e1c-b3b7-f669615eb88a","Type":"ContainerStarted","Data":"7a9516ec0334336e5baa336c2bf9aaf661262f05e3a7fefd16a5713194dbd6c6"}
Sep 15 11:30:52.760882 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:52.760838    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-79674675df-ptdl6" event={"ID":"a3719401-4dc0-4e1c-b3b7-f669615eb88a","Type":"ContainerStarted","Data":"af92485c0910678724677f0323d21667b54d6883437d2c5e2ecf3315cbed973e"}
Sep 15 11:30:52.785350 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:52.785299    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-79674675df-ptdl6" podStartSLOduration=2.051704395 podStartE2EDuration="4.785281053s" totalImagesPullingTime="2.733576658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:30:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:30:52.782815029 +0000 UTC m=+323.209145637" watchObservedRunningTime="2026-09-15 11:30:52.785281053 +0000 UTC m=+323.211611648"
Sep 15 11:30:57.825086 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:57.825047    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c"]
Sep 15 11:30:57.828906 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:57.828883    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c"
Sep 15 11:30:57.832605 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:57.832574    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-dmjlh\""
Sep 15 11:30:57.833326 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:57.833302    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 15 11:30:57.843872 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:57.843838    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c"]
Sep 15 11:30:57.901930 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:57.901888    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c\" (UID: \"6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c"
Sep 15 11:30:57.901930 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:57.901935    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c\" (UID: \"6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c"
Sep 15 11:30:57.902148 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:57.901969    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c\" (UID: \"6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c"
Sep 15 11:30:57.902148 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:57.902009    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c\" (UID: \"6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c"
Sep 15 11:30:57.902148 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:57.902035    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c\" (UID: \"6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c"
Sep 15 11:30:57.902148 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:57.902075    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c\" (UID: \"6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c"
Sep 15 11:30:57.902276 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:57.902147    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c\" (UID: \"6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c"
Sep 15 11:30:57.902276 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:57.902180    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpg7f\" (UniqueName: \"kubernetes.io/projected/6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad-kube-api-access-tpg7f\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c\" (UID: \"6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c"
Sep 15 11:30:57.902276 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:57.902216    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c\" (UID: \"6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c"
Sep 15 11:30:58.003420 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:58.003377    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c\" (UID: \"6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c"
Sep 15 11:30:58.003625 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:58.003437    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c\" (UID: \"6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c"
Sep 15 11:30:58.003625 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:58.003466    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c\" (UID: \"6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c"
Sep 15 11:30:58.003625 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:58.003487    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c\" (UID: \"6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c"
Sep 15 11:30:58.003625 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:58.003511    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c\" (UID: \"6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c"
Sep 15 11:30:58.003625 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:58.003557    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c\" (UID: \"6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c"
Sep 15 11:30:58.003625 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:58.003594    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpg7f\" (UniqueName: \"kubernetes.io/projected/6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad-kube-api-access-tpg7f\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c\" (UID: \"6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c"
Sep 15 11:30:58.004043 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:58.003638    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c\" (UID: \"6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c"
Sep 15 11:30:58.004043 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:58.003696    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c\" (UID: \"6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c"
Sep 15 11:30:58.004043 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:58.003963    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c\" (UID: \"6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c"
Sep 15 11:30:58.004447 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:58.004244    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c\" (UID: \"6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c"
Sep 15 11:30:58.004447 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:58.004372    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c\" (UID: \"6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c"
Sep 15 11:30:58.004447 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:58.004420    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c\" (UID: \"6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c"
Sep 15 11:30:58.004695 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:58.004639    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c\" (UID: \"6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c"
Sep 15 11:30:58.006114 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:58.006091    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c\" (UID: \"6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c"
Sep 15 11:30:58.006239 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:58.006221    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c\" (UID: \"6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c"
Sep 15 11:30:58.026482 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:58.026447    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpg7f\" (UniqueName: \"kubernetes.io/projected/6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad-kube-api-access-tpg7f\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c\" (UID: \"6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c"
Sep 15 11:30:58.030317 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:58.030291    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c\" (UID: \"6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c"
Sep 15 11:30:58.139597 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:58.139492    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c"
Sep 15 11:30:58.421427 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:58.421335    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-st8kl"]
Sep 15 11:30:58.425177 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:58.425149    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-st8kl"
Sep 15 11:30:58.428169 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:58.428136    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-nfcq6\""
Sep 15 11:30:58.428344 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:58.428186    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 15 11:30:58.443032 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:58.442995    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-st8kl"]
Sep 15 11:30:58.447014 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:58.446895    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c"]
Sep 15 11:30:58.451826 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:30:58.451791    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e5ad2d8_2523_4e84_a32f_3cc9eb2afdad.slice/crio-65186898a21266cb31902bed895100ba69084f74a65a01ee59a0db023f67f370 WatchSource:0}: Error finding container 65186898a21266cb31902bed895100ba69084f74a65a01ee59a0db023f67f370: Status 404 returned error can't find the container with id 65186898a21266cb31902bed895100ba69084f74a65a01ee59a0db023f67f370
Sep 15 11:30:58.508179 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:58.508142    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6ead0d0d-537c-4283-9bba-be92cb669493-cert\") pod \"odh-model-controller-7998c67dc4-st8kl\" (UID: \"6ead0d0d-537c-4283-9bba-be92cb669493\") " pod="opendatahub/odh-model-controller-7998c67dc4-st8kl"
Sep 15 11:30:58.508354 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:58.508258    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grc2z\" (UniqueName: \"kubernetes.io/projected/6ead0d0d-537c-4283-9bba-be92cb669493-kube-api-access-grc2z\") pod \"odh-model-controller-7998c67dc4-st8kl\" (UID: \"6ead0d0d-537c-4283-9bba-be92cb669493\") " pod="opendatahub/odh-model-controller-7998c67dc4-st8kl"
Sep 15 11:30:58.608937 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:58.608892    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6ead0d0d-537c-4283-9bba-be92cb669493-cert\") pod \"odh-model-controller-7998c67dc4-st8kl\" (UID: \"6ead0d0d-537c-4283-9bba-be92cb669493\") " pod="opendatahub/odh-model-controller-7998c67dc4-st8kl"
Sep 15 11:30:58.609128 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:58.608971    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grc2z\" (UniqueName: \"kubernetes.io/projected/6ead0d0d-537c-4283-9bba-be92cb669493-kube-api-access-grc2z\") pod \"odh-model-controller-7998c67dc4-st8kl\" (UID: \"6ead0d0d-537c-4283-9bba-be92cb669493\") " pod="opendatahub/odh-model-controller-7998c67dc4-st8kl"
Sep 15 11:30:58.611560 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:58.611527    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6ead0d0d-537c-4283-9bba-be92cb669493-cert\") pod \"odh-model-controller-7998c67dc4-st8kl\" (UID: \"6ead0d0d-537c-4283-9bba-be92cb669493\") " pod="opendatahub/odh-model-controller-7998c67dc4-st8kl"
Sep 15 11:30:58.618029 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:58.617993    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grc2z\" (UniqueName: \"kubernetes.io/projected/6ead0d0d-537c-4283-9bba-be92cb669493-kube-api-access-grc2z\") pod \"odh-model-controller-7998c67dc4-st8kl\" (UID: \"6ead0d0d-537c-4283-9bba-be92cb669493\") " pod="opendatahub/odh-model-controller-7998c67dc4-st8kl"
Sep 15 11:30:58.737283 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:58.737179    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-st8kl"
Sep 15 11:30:58.796925 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:58.796879    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c" event={"ID":"6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad","Type":"ContainerStarted","Data":"65186898a21266cb31902bed895100ba69084f74a65a01ee59a0db023f67f370"}
Sep 15 11:30:59.000983 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:59.000899    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-fw6nx"]
Sep 15 11:30:59.004611 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:59.004588    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-fw6nx"
Sep 15 11:30:59.008507 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:59.008475    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-2cg8n\""
Sep 15 11:30:59.008507 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:59.008500    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 15 11:30:59.014828 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:59.014791    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-fw6nx"]
Sep 15 11:30:59.020239 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:59.020206    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-st8kl"]
Sep 15 11:30:59.021600 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:30:59.021571    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ead0d0d_537c_4283_9bba_be92cb669493.slice/crio-f754a504a51b4dd62ef0f943c3374f53fb2ca6312130cb1cf7948d8ca3fc474d WatchSource:0}: Error finding container f754a504a51b4dd62ef0f943c3374f53fb2ca6312130cb1cf7948d8ca3fc474d: Status 404 returned error can't find the container with id f754a504a51b4dd62ef0f943c3374f53fb2ca6312130cb1cf7948d8ca3fc474d
Sep 15 11:30:59.114472 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:59.114390    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80f17fda-ba80-4ed4-a42c-658bb39be158-tls-certs\") pod \"model-serving-api-54d89bd5fc-fw6nx\" (UID: \"80f17fda-ba80-4ed4-a42c-658bb39be158\") " pod="opendatahub/model-serving-api-54d89bd5fc-fw6nx"
Sep 15 11:30:59.114472 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:59.114454    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d5z5\" (UniqueName: \"kubernetes.io/projected/80f17fda-ba80-4ed4-a42c-658bb39be158-kube-api-access-2d5z5\") pod \"model-serving-api-54d89bd5fc-fw6nx\" (UID: \"80f17fda-ba80-4ed4-a42c-658bb39be158\") " pod="opendatahub/model-serving-api-54d89bd5fc-fw6nx"
Sep 15 11:30:59.215394 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:59.215351    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80f17fda-ba80-4ed4-a42c-658bb39be158-tls-certs\") pod \"model-serving-api-54d89bd5fc-fw6nx\" (UID: \"80f17fda-ba80-4ed4-a42c-658bb39be158\") " pod="opendatahub/model-serving-api-54d89bd5fc-fw6nx"
Sep 15 11:30:59.215598 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:59.215413    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d5z5\" (UniqueName: \"kubernetes.io/projected/80f17fda-ba80-4ed4-a42c-658bb39be158-kube-api-access-2d5z5\") pod \"model-serving-api-54d89bd5fc-fw6nx\" (UID: \"80f17fda-ba80-4ed4-a42c-658bb39be158\") " pod="opendatahub/model-serving-api-54d89bd5fc-fw6nx"
Sep 15 11:30:59.215598 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:30:59.215508    2575 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 15 11:30:59.215752 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:30:59.215602    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80f17fda-ba80-4ed4-a42c-658bb39be158-tls-certs podName:80f17fda-ba80-4ed4-a42c-658bb39be158 nodeName:}" failed. No retries permitted until 2026-09-15 11:30:59.715574498 +0000 UTC m=+330.141905088 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/80f17fda-ba80-4ed4-a42c-658bb39be158-tls-certs") pod "model-serving-api-54d89bd5fc-fw6nx" (UID: "80f17fda-ba80-4ed4-a42c-658bb39be158") : secret "model-serving-api-tls" not found
Sep 15 11:30:59.228797 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:59.228759    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d5z5\" (UniqueName: \"kubernetes.io/projected/80f17fda-ba80-4ed4-a42c-658bb39be158-kube-api-access-2d5z5\") pod \"model-serving-api-54d89bd5fc-fw6nx\" (UID: \"80f17fda-ba80-4ed4-a42c-658bb39be158\") " pod="opendatahub/model-serving-api-54d89bd5fc-fw6nx"
Sep 15 11:30:59.721271 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:59.721220    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80f17fda-ba80-4ed4-a42c-658bb39be158-tls-certs\") pod \"model-serving-api-54d89bd5fc-fw6nx\" (UID: \"80f17fda-ba80-4ed4-a42c-658bb39be158\") " pod="opendatahub/model-serving-api-54d89bd5fc-fw6nx"
Sep 15 11:30:59.724346 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:59.724314    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80f17fda-ba80-4ed4-a42c-658bb39be158-tls-certs\") pod \"model-serving-api-54d89bd5fc-fw6nx\" (UID: \"80f17fda-ba80-4ed4-a42c-658bb39be158\") " pod="opendatahub/model-serving-api-54d89bd5fc-fw6nx"
Sep 15 11:30:59.804781 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:59.804733    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-st8kl" event={"ID":"6ead0d0d-537c-4283-9bba-be92cb669493","Type":"ContainerStarted","Data":"f754a504a51b4dd62ef0f943c3374f53fb2ca6312130cb1cf7948d8ca3fc474d"}
Sep 15 11:30:59.941942 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:30:59.941901    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-fw6nx"
Sep 15 11:31:00.245480 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:00.245441    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-fw6nx"]
Sep 15 11:31:01.265213 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:31:01.265171    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80f17fda_ba80_4ed4_a42c_658bb39be158.slice/crio-291f90a6d0b32339f9fbcae1ac3f50153dda7e90915193546073ff266f8fc9d3 WatchSource:0}: Error finding container 291f90a6d0b32339f9fbcae1ac3f50153dda7e90915193546073ff266f8fc9d3: Status 404 returned error can't find the container with id 291f90a6d0b32339f9fbcae1ac3f50153dda7e90915193546073ff266f8fc9d3
Sep 15 11:31:01.820838 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:01.820802    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-fw6nx" event={"ID":"80f17fda-ba80-4ed4-a42c-658bb39be158","Type":"ContainerStarted","Data":"291f90a6d0b32339f9fbcae1ac3f50153dda7e90915193546073ff266f8fc9d3"}
Sep 15 11:31:02.532101 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:02.532064    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:31:02.532344 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:02.532139    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:31:02.532344 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:02.532171    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:31:02.835558 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:02.835419    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c" event={"ID":"6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad","Type":"ContainerStarted","Data":"ad328e47ae2d28f5d825f00155ce7bc86e20782f8a16b6b84832eb3bf3511cde"}
Sep 15 11:31:02.838149 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:02.838086    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-st8kl" event={"ID":"6ead0d0d-537c-4283-9bba-be92cb669493","Type":"ContainerStarted","Data":"8d7a98b290857031a7de3b3b95b0a79389fa90b124983008952467f822f08f2e"}
Sep 15 11:31:02.838330 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:02.838165    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-st8kl"
Sep 15 11:31:02.859252 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:02.859154    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c" podStartSLOduration=1.782122376 podStartE2EDuration="5.859130864s" totalImagesPullingTime="4.077008488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:30:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:31:02.856248311 +0000 UTC m=+333.282578909" watchObservedRunningTime="2026-09-15 11:31:02.859130864 +0000 UTC m=+333.285461459"
Sep 15 11:31:02.875637 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:02.875575    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-st8kl" podStartSLOduration=1.282537812 podStartE2EDuration="4.875551851s" totalImagesPullingTime="3.593014039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:30:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:31:02.872921896 +0000 UTC m=+333.299252492" watchObservedRunningTime="2026-09-15 11:31:02.875551851 +0000 UTC m=+333.301882447"
Sep 15 11:31:03.140498 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:03.140400    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c"
Sep 15 11:31:03.141926 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:03.141858    2575 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 15 11:31:03.142076 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:03.141943    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c" podUID="6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 15 11:31:04.143713 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:04.143604    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c"
Sep 15 11:31:04.304231 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:04.304182    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-667dbb5fb5-527sq"]
Sep 15 11:31:04.308511 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:04.308484    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-667dbb5fb5-527sq"
Sep 15 11:31:04.311620 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:04.311597    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-kc5kw\""
Sep 15 11:31:04.311781 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:04.311597    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 15 11:31:04.311917 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:04.311900    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 15 11:31:04.311996 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:04.311931    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 15 11:31:04.320281 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:04.320255    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-667dbb5fb5-527sq"]
Sep 15 11:31:04.466142 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:04.466047    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/05797d60-711b-46cf-b919-2b0550863e05-metrics-cert\") pod \"lws-controller-manager-667dbb5fb5-527sq\" (UID: \"05797d60-711b-46cf-b919-2b0550863e05\") " pod="openshift-lws-operator/lws-controller-manager-667dbb5fb5-527sq"
Sep 15 11:31:04.466142 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:04.466098    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/05797d60-711b-46cf-b919-2b0550863e05-manager-config\") pod \"lws-controller-manager-667dbb5fb5-527sq\" (UID: \"05797d60-711b-46cf-b919-2b0550863e05\") " pod="openshift-lws-operator/lws-controller-manager-667dbb5fb5-527sq"
Sep 15 11:31:04.466344 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:04.466189    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxp64\" (UniqueName: \"kubernetes.io/projected/05797d60-711b-46cf-b919-2b0550863e05-kube-api-access-jxp64\") pod \"lws-controller-manager-667dbb5fb5-527sq\" (UID: \"05797d60-711b-46cf-b919-2b0550863e05\") " pod="openshift-lws-operator/lws-controller-manager-667dbb5fb5-527sq"
Sep 15 11:31:04.466344 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:04.466243    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05797d60-711b-46cf-b919-2b0550863e05-cert\") pod \"lws-controller-manager-667dbb5fb5-527sq\" (UID: \"05797d60-711b-46cf-b919-2b0550863e05\") " pod="openshift-lws-operator/lws-controller-manager-667dbb5fb5-527sq"
Sep 15 11:31:04.567193 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:04.567149    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxp64\" (UniqueName: \"kubernetes.io/projected/05797d60-711b-46cf-b919-2b0550863e05-kube-api-access-jxp64\") pod \"lws-controller-manager-667dbb5fb5-527sq\" (UID: \"05797d60-711b-46cf-b919-2b0550863e05\") " pod="openshift-lws-operator/lws-controller-manager-667dbb5fb5-527sq"
Sep 15 11:31:04.567193 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:04.567204    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05797d60-711b-46cf-b919-2b0550863e05-cert\") pod \"lws-controller-manager-667dbb5fb5-527sq\" (UID: \"05797d60-711b-46cf-b919-2b0550863e05\") " pod="openshift-lws-operator/lws-controller-manager-667dbb5fb5-527sq"
Sep 15 11:31:04.567425 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:04.567244    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/05797d60-711b-46cf-b919-2b0550863e05-metrics-cert\") pod \"lws-controller-manager-667dbb5fb5-527sq\" (UID: \"05797d60-711b-46cf-b919-2b0550863e05\") " pod="openshift-lws-operator/lws-controller-manager-667dbb5fb5-527sq"
Sep 15 11:31:04.567425 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:04.567277    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/05797d60-711b-46cf-b919-2b0550863e05-manager-config\") pod \"lws-controller-manager-667dbb5fb5-527sq\" (UID: \"05797d60-711b-46cf-b919-2b0550863e05\") " pod="openshift-lws-operator/lws-controller-manager-667dbb5fb5-527sq"
Sep 15 11:31:04.568251 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:04.568225    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/05797d60-711b-46cf-b919-2b0550863e05-manager-config\") pod \"lws-controller-manager-667dbb5fb5-527sq\" (UID: \"05797d60-711b-46cf-b919-2b0550863e05\") " pod="openshift-lws-operator/lws-controller-manager-667dbb5fb5-527sq"
Sep 15 11:31:04.569878 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:04.569857    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/05797d60-711b-46cf-b919-2b0550863e05-metrics-cert\") pod \"lws-controller-manager-667dbb5fb5-527sq\" (UID: \"05797d60-711b-46cf-b919-2b0550863e05\") " pod="openshift-lws-operator/lws-controller-manager-667dbb5fb5-527sq"
Sep 15 11:31:04.569969 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:04.569943    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05797d60-711b-46cf-b919-2b0550863e05-cert\") pod \"lws-controller-manager-667dbb5fb5-527sq\" (UID: \"05797d60-711b-46cf-b919-2b0550863e05\") " pod="openshift-lws-operator/lws-controller-manager-667dbb5fb5-527sq"
Sep 15 11:31:04.576371 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:04.576346    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxp64\" (UniqueName: \"kubernetes.io/projected/05797d60-711b-46cf-b919-2b0550863e05-kube-api-access-jxp64\") pod \"lws-controller-manager-667dbb5fb5-527sq\" (UID: \"05797d60-711b-46cf-b919-2b0550863e05\") " pod="openshift-lws-operator/lws-controller-manager-667dbb5fb5-527sq"
Sep 15 11:31:04.618394 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:04.618351    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-667dbb5fb5-527sq"
Sep 15 11:31:04.850216 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:04.850172    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-fw6nx" event={"ID":"80f17fda-ba80-4ed4-a42c-658bb39be158","Type":"ContainerStarted","Data":"ece95ff669c0370ba6fe5fcc6f19ed586761dac68a78343dee3efa3dd7c90b5e"}
Sep 15 11:31:04.850436 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:04.850380    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c"
Sep 15 11:31:04.850436 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:04.850429    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-fw6nx"
Sep 15 11:31:04.851446 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:04.851420    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c"
Sep 15 11:31:04.890485 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:04.890429    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-fw6nx" podStartSLOduration=4.3261697869999995 podStartE2EDuration="6.890406026s" totalImagesPullingTime="2.564236239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:30:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:31:04.889809866 +0000 UTC m=+335.316140463" watchObservedRunningTime="2026-09-15 11:31:04.890406026 +0000 UTC m=+335.316736624"
Sep 15 11:31:04.922680 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:04.922630    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-667dbb5fb5-527sq"]
Sep 15 11:31:04.923850 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:31:04.923816    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05797d60_711b_46cf_b919_2b0550863e05.slice/crio-0dac77f184d8c1314e3b2633b52f852e089f7071539d2b634bd470883fdb2626 WatchSource:0}: Error finding container 0dac77f184d8c1314e3b2633b52f852e089f7071539d2b634bd470883fdb2626: Status 404 returned error can't find the container with id 0dac77f184d8c1314e3b2633b52f852e089f7071539d2b634bd470883fdb2626
Sep 15 11:31:05.858755 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:05.858683    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-667dbb5fb5-527sq" event={"ID":"05797d60-711b-46cf-b919-2b0550863e05","Type":"ContainerStarted","Data":"0dac77f184d8c1314e3b2633b52f852e089f7071539d2b634bd470883fdb2626"}
Sep 15 11:31:07.872616 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:07.872576    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-667dbb5fb5-527sq" event={"ID":"05797d60-711b-46cf-b919-2b0550863e05","Type":"ContainerStarted","Data":"daccc36f318793a1c282340d595782fa0add4e84a44636483327b7ff65bc525e"}
Sep 15 11:31:07.873087 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:07.872767    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-667dbb5fb5-527sq"
Sep 15 11:31:07.898285 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:07.898230    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-667dbb5fb5-527sq" podStartSLOduration=1.588432171 podStartE2EDuration="3.898213841s" totalImagesPullingTime="2.30978167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:31:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:31:07.896402746 +0000 UTC m=+338.322733343" watchObservedRunningTime="2026-09-15 11:31:07.898213841 +0000 UTC m=+338.324544436"
Sep 15 11:31:13.845254 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:13.845211    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-st8kl"
Sep 15 11:31:15.863769 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:15.863734    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-fw6nx"
Sep 15 11:31:17.338886 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:17.338838    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67c488f774-8vfmf"]
Sep 15 11:31:17.342961 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:17.342931    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67c488f774-8vfmf"
Sep 15 11:31:17.375788 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:17.375759    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67c488f774-8vfmf"]
Sep 15 11:31:17.396820 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:17.396779    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lwh5\" (UniqueName: \"kubernetes.io/projected/c2b243e1-5294-417b-a00c-34eb2c5edfbe-kube-api-access-4lwh5\") pod \"console-67c488f774-8vfmf\" (UID: \"c2b243e1-5294-417b-a00c-34eb2c5edfbe\") " pod="openshift-console/console-67c488f774-8vfmf"
Sep 15 11:31:17.396995 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:17.396826    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2b243e1-5294-417b-a00c-34eb2c5edfbe-console-config\") pod \"console-67c488f774-8vfmf\" (UID: \"c2b243e1-5294-417b-a00c-34eb2c5edfbe\") " pod="openshift-console/console-67c488f774-8vfmf"
Sep 15 11:31:17.396995 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:17.396885    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2b243e1-5294-417b-a00c-34eb2c5edfbe-service-ca\") pod \"console-67c488f774-8vfmf\" (UID: \"c2b243e1-5294-417b-a00c-34eb2c5edfbe\") " pod="openshift-console/console-67c488f774-8vfmf"
Sep 15 11:31:17.396995 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:17.396935    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2b243e1-5294-417b-a00c-34eb2c5edfbe-trusted-ca-bundle\") pod \"console-67c488f774-8vfmf\" (UID: \"c2b243e1-5294-417b-a00c-34eb2c5edfbe\") " pod="openshift-console/console-67c488f774-8vfmf"
Sep 15 11:31:17.396995 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:17.396954    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2b243e1-5294-417b-a00c-34eb2c5edfbe-console-oauth-config\") pod \"console-67c488f774-8vfmf\" (UID: \"c2b243e1-5294-417b-a00c-34eb2c5edfbe\") " pod="openshift-console/console-67c488f774-8vfmf"
Sep 15 11:31:17.396995 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:17.396991    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2b243e1-5294-417b-a00c-34eb2c5edfbe-oauth-serving-cert\") pod \"console-67c488f774-8vfmf\" (UID: \"c2b243e1-5294-417b-a00c-34eb2c5edfbe\") " pod="openshift-console/console-67c488f774-8vfmf"
Sep 15 11:31:17.397166 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:17.397041    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2b243e1-5294-417b-a00c-34eb2c5edfbe-console-serving-cert\") pod \"console-67c488f774-8vfmf\" (UID: \"c2b243e1-5294-417b-a00c-34eb2c5edfbe\") " pod="openshift-console/console-67c488f774-8vfmf"
Sep 15 11:31:17.497908 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:17.497865    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2b243e1-5294-417b-a00c-34eb2c5edfbe-console-config\") pod \"console-67c488f774-8vfmf\" (UID: \"c2b243e1-5294-417b-a00c-34eb2c5edfbe\") " pod="openshift-console/console-67c488f774-8vfmf"
Sep 15 11:31:17.497908 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:17.497908    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2b243e1-5294-417b-a00c-34eb2c5edfbe-service-ca\") pod \"console-67c488f774-8vfmf\" (UID: \"c2b243e1-5294-417b-a00c-34eb2c5edfbe\") " pod="openshift-console/console-67c488f774-8vfmf"
Sep 15 11:31:17.498167 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:17.497935    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2b243e1-5294-417b-a00c-34eb2c5edfbe-trusted-ca-bundle\") pod \"console-67c488f774-8vfmf\" (UID: \"c2b243e1-5294-417b-a00c-34eb2c5edfbe\") " pod="openshift-console/console-67c488f774-8vfmf"
Sep 15 11:31:17.498167 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:17.497951    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2b243e1-5294-417b-a00c-34eb2c5edfbe-console-oauth-config\") pod \"console-67c488f774-8vfmf\" (UID: \"c2b243e1-5294-417b-a00c-34eb2c5edfbe\") " pod="openshift-console/console-67c488f774-8vfmf"
Sep 15 11:31:17.498167 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:17.498079    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2b243e1-5294-417b-a00c-34eb2c5edfbe-oauth-serving-cert\") pod \"console-67c488f774-8vfmf\" (UID: \"c2b243e1-5294-417b-a00c-34eb2c5edfbe\") " pod="openshift-console/console-67c488f774-8vfmf"
Sep 15 11:31:17.498167 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:17.498138    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2b243e1-5294-417b-a00c-34eb2c5edfbe-console-serving-cert\") pod \"console-67c488f774-8vfmf\" (UID: \"c2b243e1-5294-417b-a00c-34eb2c5edfbe\") " pod="openshift-console/console-67c488f774-8vfmf"
Sep 15 11:31:17.498355 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:17.498222    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lwh5\" (UniqueName: \"kubernetes.io/projected/c2b243e1-5294-417b-a00c-34eb2c5edfbe-kube-api-access-4lwh5\") pod \"console-67c488f774-8vfmf\" (UID: \"c2b243e1-5294-417b-a00c-34eb2c5edfbe\") " pod="openshift-console/console-67c488f774-8vfmf"
Sep 15 11:31:17.498798 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:17.498765    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2b243e1-5294-417b-a00c-34eb2c5edfbe-service-ca\") pod \"console-67c488f774-8vfmf\" (UID: \"c2b243e1-5294-417b-a00c-34eb2c5edfbe\") " pod="openshift-console/console-67c488f774-8vfmf"
Sep 15 11:31:17.498944 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:17.498895    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2b243e1-5294-417b-a00c-34eb2c5edfbe-console-config\") pod \"console-67c488f774-8vfmf\" (UID: \"c2b243e1-5294-417b-a00c-34eb2c5edfbe\") " pod="openshift-console/console-67c488f774-8vfmf"
Sep 15 11:31:17.498944 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:17.498935    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2b243e1-5294-417b-a00c-34eb2c5edfbe-trusted-ca-bundle\") pod \"console-67c488f774-8vfmf\" (UID: \"c2b243e1-5294-417b-a00c-34eb2c5edfbe\") " pod="openshift-console/console-67c488f774-8vfmf"
Sep 15 11:31:17.499095 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:17.499074    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2b243e1-5294-417b-a00c-34eb2c5edfbe-oauth-serving-cert\") pod \"console-67c488f774-8vfmf\" (UID: \"c2b243e1-5294-417b-a00c-34eb2c5edfbe\") " pod="openshift-console/console-67c488f774-8vfmf"
Sep 15 11:31:17.500639 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:17.500618    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2b243e1-5294-417b-a00c-34eb2c5edfbe-console-oauth-config\") pod \"console-67c488f774-8vfmf\" (UID: \"c2b243e1-5294-417b-a00c-34eb2c5edfbe\") " pod="openshift-console/console-67c488f774-8vfmf"
Sep 15 11:31:17.500755 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:17.500737    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2b243e1-5294-417b-a00c-34eb2c5edfbe-console-serving-cert\") pod \"console-67c488f774-8vfmf\" (UID: \"c2b243e1-5294-417b-a00c-34eb2c5edfbe\") " pod="openshift-console/console-67c488f774-8vfmf"
Sep 15 11:31:17.506861 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:17.506835    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lwh5\" (UniqueName: \"kubernetes.io/projected/c2b243e1-5294-417b-a00c-34eb2c5edfbe-kube-api-access-4lwh5\") pod \"console-67c488f774-8vfmf\" (UID: \"c2b243e1-5294-417b-a00c-34eb2c5edfbe\") " pod="openshift-console/console-67c488f774-8vfmf"
Sep 15 11:31:17.653160 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:17.653046    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67c488f774-8vfmf"
Sep 15 11:31:17.932410 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:17.932382    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67c488f774-8vfmf"]
Sep 15 11:31:17.934536 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:31:17.934501    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2b243e1_5294_417b_a00c_34eb2c5edfbe.slice/crio-8a8b02d6e4388fa097eed06a1db699a29a2a644a5ea344487454ec34383b0022 WatchSource:0}: Error finding container 8a8b02d6e4388fa097eed06a1db699a29a2a644a5ea344487454ec34383b0022: Status 404 returned error can't find the container with id 8a8b02d6e4388fa097eed06a1db699a29a2a644a5ea344487454ec34383b0022
Sep 15 11:31:18.881329 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:18.881293    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-667dbb5fb5-527sq"
Sep 15 11:31:18.935818 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:18.935776    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67c488f774-8vfmf" event={"ID":"c2b243e1-5294-417b-a00c-34eb2c5edfbe","Type":"ContainerStarted","Data":"851c50dff86f2eb3cc6deb4900b60ae46dd502cbed9b315a60139255b1728f42"}
Sep 15 11:31:18.936022 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:18.935845    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67c488f774-8vfmf" event={"ID":"c2b243e1-5294-417b-a00c-34eb2c5edfbe","Type":"ContainerStarted","Data":"8a8b02d6e4388fa097eed06a1db699a29a2a644a5ea344487454ec34383b0022"}
Sep 15 11:31:18.966166 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:18.966101    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67c488f774-8vfmf" podStartSLOduration=1.966075634 podStartE2EDuration="1.966075634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:31:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:31:18.965564721 +0000 UTC m=+349.391895319" watchObservedRunningTime="2026-09-15 11:31:18.966075634 +0000 UTC m=+349.392406231"
Sep 15 11:31:27.653557 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:27.653466    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67c488f774-8vfmf"
Sep 15 11:31:27.653557 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:27.653535    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67c488f774-8vfmf"
Sep 15 11:31:27.658426 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:27.658391    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67c488f774-8vfmf"
Sep 15 11:31:27.988802 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:27.988717    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67c488f774-8vfmf"
Sep 15 11:31:28.035418 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:28.035377    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68f96bbcc8-t79kq"]
Sep 15 11:31:53.056366 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:53.056301    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-68f96bbcc8-t79kq" podUID="0c87bda8-9322-409f-88e5-4b718536b082" containerName="console" containerID="cri-o://185a00e9c2a2cde7f7cdbad1bdf5ba4900230a85c7acac408b422d7e8e38e418" gracePeriod=15
Sep 15 11:31:53.309835 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:53.309762    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68f96bbcc8-t79kq"
Sep 15 11:31:53.451870 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:53.451827    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c87bda8-9322-409f-88e5-4b718536b082-trusted-ca-bundle\") pod \"0c87bda8-9322-409f-88e5-4b718536b082\" (UID: \"0c87bda8-9322-409f-88e5-4b718536b082\") "
Sep 15 11:31:53.452054 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:53.451924    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c87bda8-9322-409f-88e5-4b718536b082-console-serving-cert\") pod \"0c87bda8-9322-409f-88e5-4b718536b082\" (UID: \"0c87bda8-9322-409f-88e5-4b718536b082\") "
Sep 15 11:31:53.452054 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:53.451963    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c87bda8-9322-409f-88e5-4b718536b082-service-ca\") pod \"0c87bda8-9322-409f-88e5-4b718536b082\" (UID: \"0c87bda8-9322-409f-88e5-4b718536b082\") "
Sep 15 11:31:53.452054 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:53.451992    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c87bda8-9322-409f-88e5-4b718536b082-console-oauth-config\") pod \"0c87bda8-9322-409f-88e5-4b718536b082\" (UID: \"0c87bda8-9322-409f-88e5-4b718536b082\") "
Sep 15 11:31:53.452205 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:53.452180    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c87bda8-9322-409f-88e5-4b718536b082-oauth-serving-cert\") pod \"0c87bda8-9322-409f-88e5-4b718536b082\" (UID: \"0c87bda8-9322-409f-88e5-4b718536b082\") "
Sep 15 11:31:53.452259 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:53.452225    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c87bda8-9322-409f-88e5-4b718536b082-console-config\") pod \"0c87bda8-9322-409f-88e5-4b718536b082\" (UID: \"0c87bda8-9322-409f-88e5-4b718536b082\") "
Sep 15 11:31:53.452344 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:53.452318    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c87bda8-9322-409f-88e5-4b718536b082-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0c87bda8-9322-409f-88e5-4b718536b082" (UID: "0c87bda8-9322-409f-88e5-4b718536b082"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:31:53.452403 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:53.452330    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ct4zp\" (UniqueName: \"kubernetes.io/projected/0c87bda8-9322-409f-88e5-4b718536b082-kube-api-access-ct4zp\") pod \"0c87bda8-9322-409f-88e5-4b718536b082\" (UID: \"0c87bda8-9322-409f-88e5-4b718536b082\") "
Sep 15 11:31:53.452556 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:53.452519    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c87bda8-9322-409f-88e5-4b718536b082-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0c87bda8-9322-409f-88e5-4b718536b082" (UID: "0c87bda8-9322-409f-88e5-4b718536b082"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:31:53.452556 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:53.452529    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c87bda8-9322-409f-88e5-4b718536b082-service-ca" (OuterVolumeSpecName: "service-ca") pod "0c87bda8-9322-409f-88e5-4b718536b082" (UID: "0c87bda8-9322-409f-88e5-4b718536b082"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:31:53.452702 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:53.452618    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c87bda8-9322-409f-88e5-4b718536b082-console-config" (OuterVolumeSpecName: "console-config") pod "0c87bda8-9322-409f-88e5-4b718536b082" (UID: "0c87bda8-9322-409f-88e5-4b718536b082"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:31:53.452884 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:53.452864    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c87bda8-9322-409f-88e5-4b718536b082-trusted-ca-bundle\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:31:53.452927 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:53.452892    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c87bda8-9322-409f-88e5-4b718536b082-service-ca\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:31:53.452927 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:53.452909    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c87bda8-9322-409f-88e5-4b718536b082-oauth-serving-cert\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:31:53.452989 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:53.452924    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c87bda8-9322-409f-88e5-4b718536b082-console-config\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:31:53.454270 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:53.454241    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c87bda8-9322-409f-88e5-4b718536b082-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0c87bda8-9322-409f-88e5-4b718536b082" (UID: "0c87bda8-9322-409f-88e5-4b718536b082"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:31:53.454370 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:53.454281    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c87bda8-9322-409f-88e5-4b718536b082-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0c87bda8-9322-409f-88e5-4b718536b082" (UID: "0c87bda8-9322-409f-88e5-4b718536b082"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:31:53.454370 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:53.454295    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c87bda8-9322-409f-88e5-4b718536b082-kube-api-access-ct4zp" (OuterVolumeSpecName: "kube-api-access-ct4zp") pod "0c87bda8-9322-409f-88e5-4b718536b082" (UID: "0c87bda8-9322-409f-88e5-4b718536b082"). InnerVolumeSpecName "kube-api-access-ct4zp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:31:53.553555 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:53.553516    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ct4zp\" (UniqueName: \"kubernetes.io/projected/0c87bda8-9322-409f-88e5-4b718536b082-kube-api-access-ct4zp\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:31:53.553555 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:53.553549    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c87bda8-9322-409f-88e5-4b718536b082-console-serving-cert\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:31:53.553555 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:53.553558    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c87bda8-9322-409f-88e5-4b718536b082-console-oauth-config\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:31:54.125603 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:54.125564    2575 generic.go:356] "Generic (PLEG): container finished" podID="0c87bda8-9322-409f-88e5-4b718536b082" containerID="185a00e9c2a2cde7f7cdbad1bdf5ba4900230a85c7acac408b422d7e8e38e418" exitCode=0
Sep 15 11:31:54.126030 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:54.125619    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68f96bbcc8-t79kq"
Sep 15 11:31:54.126030 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:54.125672    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68f96bbcc8-t79kq" event={"ID":"0c87bda8-9322-409f-88e5-4b718536b082","Type":"ContainerDied","Data":"185a00e9c2a2cde7f7cdbad1bdf5ba4900230a85c7acac408b422d7e8e38e418"}
Sep 15 11:31:54.126030 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:54.125723    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68f96bbcc8-t79kq" event={"ID":"0c87bda8-9322-409f-88e5-4b718536b082","Type":"ContainerDied","Data":"8d26207219ff42a026927ad65340be246a7db3639ffe51b9d13d884bdf997ade"}
Sep 15 11:31:54.126030 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:54.125744    2575 scope.go:117] "RemoveContainer" containerID="185a00e9c2a2cde7f7cdbad1bdf5ba4900230a85c7acac408b422d7e8e38e418"
Sep 15 11:31:54.134527 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:54.134508    2575 scope.go:117] "RemoveContainer" containerID="185a00e9c2a2cde7f7cdbad1bdf5ba4900230a85c7acac408b422d7e8e38e418"
Sep 15 11:31:54.134894 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:31:54.134874    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"185a00e9c2a2cde7f7cdbad1bdf5ba4900230a85c7acac408b422d7e8e38e418\": container with ID starting with 185a00e9c2a2cde7f7cdbad1bdf5ba4900230a85c7acac408b422d7e8e38e418 not found: ID does not exist" containerID="185a00e9c2a2cde7f7cdbad1bdf5ba4900230a85c7acac408b422d7e8e38e418"
Sep 15 11:31:54.134948 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:54.134905    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"185a00e9c2a2cde7f7cdbad1bdf5ba4900230a85c7acac408b422d7e8e38e418"} err="failed to get container status \"185a00e9c2a2cde7f7cdbad1bdf5ba4900230a85c7acac408b422d7e8e38e418\": rpc error: code = NotFound desc = could not find container \"185a00e9c2a2cde7f7cdbad1bdf5ba4900230a85c7acac408b422d7e8e38e418\": container with ID starting with 185a00e9c2a2cde7f7cdbad1bdf5ba4900230a85c7acac408b422d7e8e38e418 not found: ID does not exist"
Sep 15 11:31:54.153113 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:54.153077    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68f96bbcc8-t79kq"]
Sep 15 11:31:54.159729 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:54.159693    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-68f96bbcc8-t79kq"]
Sep 15 11:31:56.094477 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:31:56.094435    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c87bda8-9322-409f-88e5-4b718536b082" path="/var/lib/kubelet/pods/0c87bda8-9322-409f-88e5-4b718536b082/volumes"
Sep 15 11:32:04.475115 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.475076    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q4f6f"]
Sep 15 11:32:04.475612 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.475474    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c87bda8-9322-409f-88e5-4b718536b082" containerName="console"
Sep 15 11:32:04.475612 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.475486    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c87bda8-9322-409f-88e5-4b718536b082" containerName="console"
Sep 15 11:32:04.475612 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.475567    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c87bda8-9322-409f-88e5-4b718536b082" containerName="console"
Sep 15 11:32:04.479399 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.479375    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q4f6f"
Sep 15 11:32:04.483475 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.483450    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 11:32:04.483628 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.483612    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4z5m2\""
Sep 15 11:32:04.486498 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.486475    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 11:32:04.503504 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.503474    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q4f6f"]
Sep 15 11:32:04.551946 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.551907    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06974682-950f-40ff-a0a3-06803363400d-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q4f6f\" (UID: \"06974682-950f-40ff-a0a3-06803363400d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q4f6f"
Sep 15 11:32:04.552117 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.551958    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm75r\" (UniqueName: \"kubernetes.io/projected/06974682-950f-40ff-a0a3-06803363400d-kube-api-access-wm75r\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q4f6f\" (UID: \"06974682-950f-40ff-a0a3-06803363400d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q4f6f"
Sep 15 11:32:04.552117 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.552016    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06974682-950f-40ff-a0a3-06803363400d-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q4f6f\" (UID: \"06974682-950f-40ff-a0a3-06803363400d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q4f6f"
Sep 15 11:32:04.566301 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.566266    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crqlcs"]
Sep 15 11:32:04.569308 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.569282    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crqlcs"
Sep 15 11:32:04.580264 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.580233    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crqlcs"]
Sep 15 11:32:04.631511 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.631470    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6795rr"]
Sep 15 11:32:04.634201 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.634182    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6795rr"
Sep 15 11:32:04.644721 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.644690    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6795rr"]
Sep 15 11:32:04.652707 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.652668    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be88a752-3143-4208-8e10-c6c9f064bd78-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crqlcs\" (UID: \"be88a752-3143-4208-8e10-c6c9f064bd78\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crqlcs"
Sep 15 11:32:04.652854 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.652716    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/baec4ae3-0277-4e5a-9e94-7968868f78e4-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6795rr\" (UID: \"baec4ae3-0277-4e5a-9e94-7968868f78e4\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6795rr"
Sep 15 11:32:04.652854 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.652741    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/baec4ae3-0277-4e5a-9e94-7968868f78e4-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6795rr\" (UID: \"baec4ae3-0277-4e5a-9e94-7968868f78e4\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6795rr"
Sep 15 11:32:04.652854 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.652765    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06974682-950f-40ff-a0a3-06803363400d-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q4f6f\" (UID: \"06974682-950f-40ff-a0a3-06803363400d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q4f6f"
Sep 15 11:32:04.652854 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.652793    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spf7t\" (UniqueName: \"kubernetes.io/projected/baec4ae3-0277-4e5a-9e94-7968868f78e4-kube-api-access-spf7t\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6795rr\" (UID: \"baec4ae3-0277-4e5a-9e94-7968868f78e4\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6795rr"
Sep 15 11:32:04.653013 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.652882    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfl7m\" (UniqueName: \"kubernetes.io/projected/be88a752-3143-4208-8e10-c6c9f064bd78-kube-api-access-gfl7m\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crqlcs\" (UID: \"be88a752-3143-4208-8e10-c6c9f064bd78\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crqlcs"
Sep 15 11:32:04.653013 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.652917    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be88a752-3143-4208-8e10-c6c9f064bd78-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crqlcs\" (UID: \"be88a752-3143-4208-8e10-c6c9f064bd78\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crqlcs"
Sep 15 11:32:04.653013 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.652983    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06974682-950f-40ff-a0a3-06803363400d-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q4f6f\" (UID: \"06974682-950f-40ff-a0a3-06803363400d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q4f6f"
Sep 15 11:32:04.653112 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.653025    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm75r\" (UniqueName: \"kubernetes.io/projected/06974682-950f-40ff-a0a3-06803363400d-kube-api-access-wm75r\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q4f6f\" (UID: \"06974682-950f-40ff-a0a3-06803363400d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q4f6f"
Sep 15 11:32:04.653146 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.653130    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06974682-950f-40ff-a0a3-06803363400d-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q4f6f\" (UID: \"06974682-950f-40ff-a0a3-06803363400d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q4f6f"
Sep 15 11:32:04.653266 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.653250    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06974682-950f-40ff-a0a3-06803363400d-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q4f6f\" (UID: \"06974682-950f-40ff-a0a3-06803363400d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q4f6f"
Sep 15 11:32:04.666776 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.666732    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm75r\" (UniqueName: \"kubernetes.io/projected/06974682-950f-40ff-a0a3-06803363400d-kube-api-access-wm75r\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q4f6f\" (UID: \"06974682-950f-40ff-a0a3-06803363400d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q4f6f"
Sep 15 11:32:04.737811 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.737708    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqtqpb"]
Sep 15 11:32:04.744994 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.744962    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqtqpb"
Sep 15 11:32:04.751859 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.751827    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqtqpb"]
Sep 15 11:32:04.753534 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.753497    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be88a752-3143-4208-8e10-c6c9f064bd78-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crqlcs\" (UID: \"be88a752-3143-4208-8e10-c6c9f064bd78\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crqlcs"
Sep 15 11:32:04.753869 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.753547    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/baec4ae3-0277-4e5a-9e94-7968868f78e4-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6795rr\" (UID: \"baec4ae3-0277-4e5a-9e94-7968868f78e4\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6795rr"
Sep 15 11:32:04.753869 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.753582    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/baec4ae3-0277-4e5a-9e94-7968868f78e4-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6795rr\" (UID: \"baec4ae3-0277-4e5a-9e94-7968868f78e4\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6795rr"
Sep 15 11:32:04.753869 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.753611    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spf7t\" (UniqueName: \"kubernetes.io/projected/baec4ae3-0277-4e5a-9e94-7968868f78e4-kube-api-access-spf7t\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6795rr\" (UID: \"baec4ae3-0277-4e5a-9e94-7968868f78e4\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6795rr"
Sep 15 11:32:04.753869 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.753721    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfl7m\" (UniqueName: \"kubernetes.io/projected/be88a752-3143-4208-8e10-c6c9f064bd78-kube-api-access-gfl7m\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crqlcs\" (UID: \"be88a752-3143-4208-8e10-c6c9f064bd78\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crqlcs"
Sep 15 11:32:04.753869 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.753764    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be88a752-3143-4208-8e10-c6c9f064bd78-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crqlcs\" (UID: \"be88a752-3143-4208-8e10-c6c9f064bd78\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crqlcs"
Sep 15 11:32:04.754114 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.753962    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be88a752-3143-4208-8e10-c6c9f064bd78-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crqlcs\" (UID: \"be88a752-3143-4208-8e10-c6c9f064bd78\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crqlcs"
Sep 15 11:32:04.754185 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.754158    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be88a752-3143-4208-8e10-c6c9f064bd78-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crqlcs\" (UID: \"be88a752-3143-4208-8e10-c6c9f064bd78\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crqlcs"
Sep 15 11:32:04.754348 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.754325    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/baec4ae3-0277-4e5a-9e94-7968868f78e4-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6795rr\" (UID: \"baec4ae3-0277-4e5a-9e94-7968868f78e4\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6795rr"
Sep 15 11:32:04.754502 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.754432    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/baec4ae3-0277-4e5a-9e94-7968868f78e4-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6795rr\" (UID: \"baec4ae3-0277-4e5a-9e94-7968868f78e4\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6795rr"
Sep 15 11:32:04.770829 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.770782    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spf7t\" (UniqueName: \"kubernetes.io/projected/baec4ae3-0277-4e5a-9e94-7968868f78e4-kube-api-access-spf7t\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6795rr\" (UID: \"baec4ae3-0277-4e5a-9e94-7968868f78e4\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6795rr"
Sep 15 11:32:04.775382 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.775344    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfl7m\" (UniqueName: \"kubernetes.io/projected/be88a752-3143-4208-8e10-c6c9f064bd78-kube-api-access-gfl7m\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crqlcs\" (UID: \"be88a752-3143-4208-8e10-c6c9f064bd78\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crqlcs"
Sep 15 11:32:04.789191 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.789155    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q4f6f"
Sep 15 11:32:04.854516 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.854475    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c0417b0-c2f1-4b15-ab2c-8ef275a63226-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqtqpb\" (UID: \"9c0417b0-c2f1-4b15-ab2c-8ef275a63226\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqtqpb"
Sep 15 11:32:04.854722 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.854588    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c0417b0-c2f1-4b15-ab2c-8ef275a63226-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqtqpb\" (UID: \"9c0417b0-c2f1-4b15-ab2c-8ef275a63226\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqtqpb"
Sep 15 11:32:04.854821 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.854786    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlvxh\" (UniqueName: \"kubernetes.io/projected/9c0417b0-c2f1-4b15-ab2c-8ef275a63226-kube-api-access-rlvxh\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqtqpb\" (UID: \"9c0417b0-c2f1-4b15-ab2c-8ef275a63226\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqtqpb"
Sep 15 11:32:04.880366 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.880325    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crqlcs"
Sep 15 11:32:04.944135 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.944102    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6795rr"
Sep 15 11:32:04.955675 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.955617    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlvxh\" (UniqueName: \"kubernetes.io/projected/9c0417b0-c2f1-4b15-ab2c-8ef275a63226-kube-api-access-rlvxh\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqtqpb\" (UID: \"9c0417b0-c2f1-4b15-ab2c-8ef275a63226\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqtqpb"
Sep 15 11:32:04.955927 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.955897    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c0417b0-c2f1-4b15-ab2c-8ef275a63226-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqtqpb\" (UID: \"9c0417b0-c2f1-4b15-ab2c-8ef275a63226\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqtqpb"
Sep 15 11:32:04.956002 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.955938    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c0417b0-c2f1-4b15-ab2c-8ef275a63226-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqtqpb\" (UID: \"9c0417b0-c2f1-4b15-ab2c-8ef275a63226\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqtqpb"
Sep 15 11:32:04.956456 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.956388    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c0417b0-c2f1-4b15-ab2c-8ef275a63226-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqtqpb\" (UID: \"9c0417b0-c2f1-4b15-ab2c-8ef275a63226\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqtqpb"
Sep 15 11:32:04.956617 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.956509    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c0417b0-c2f1-4b15-ab2c-8ef275a63226-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqtqpb\" (UID: \"9c0417b0-c2f1-4b15-ab2c-8ef275a63226\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqtqpb"
Sep 15 11:32:04.968947 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:04.968920    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlvxh\" (UniqueName: \"kubernetes.io/projected/9c0417b0-c2f1-4b15-ab2c-8ef275a63226-kube-api-access-rlvxh\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqtqpb\" (UID: \"9c0417b0-c2f1-4b15-ab2c-8ef275a63226\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqtqpb"
Sep 15 11:32:05.057037 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:05.056994    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqtqpb"
Sep 15 11:32:05.070415 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:05.070381    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q4f6f"]
Sep 15 11:32:05.072235 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:32:05.072206    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06974682_950f_40ff_a0a3_06803363400d.slice/crio-fccdc3d4f6c1fd1dc357c56cab762cf938f6093dda87e306a315e64b1cd00ae8 WatchSource:0}: Error finding container fccdc3d4f6c1fd1dc357c56cab762cf938f6093dda87e306a315e64b1cd00ae8: Status 404 returned error can't find the container with id fccdc3d4f6c1fd1dc357c56cab762cf938f6093dda87e306a315e64b1cd00ae8
Sep 15 11:32:05.164830 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:05.164482    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crqlcs"]
Sep 15 11:32:05.184583 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:05.184548    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crqlcs" event={"ID":"be88a752-3143-4208-8e10-c6c9f064bd78","Type":"ContainerStarted","Data":"486dc899e9babe634951cc1b062487b305032a8859e425b4e990768853236879"}
Sep 15 11:32:05.186583 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:05.186546    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q4f6f" event={"ID":"06974682-950f-40ff-a0a3-06803363400d","Type":"ContainerStarted","Data":"c58ba512b66e1d9d5301bd7a79ed924daf00e8f589b4be2e9bedac3db23339d9"}
Sep 15 11:32:05.186729 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:05.186608    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q4f6f" event={"ID":"06974682-950f-40ff-a0a3-06803363400d","Type":"ContainerStarted","Data":"fccdc3d4f6c1fd1dc357c56cab762cf938f6093dda87e306a315e64b1cd00ae8"}
Sep 15 11:32:05.230557 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:05.230527    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6795rr"]
Sep 15 11:32:05.231723 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:32:05.231695    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaec4ae3_0277_4e5a_9e94_7968868f78e4.slice/crio-b3b318c37dbb9de875d7ee328b2dece498d0242bb2428fe70eb0cfcda9c9f02a WatchSource:0}: Error finding container b3b318c37dbb9de875d7ee328b2dece498d0242bb2428fe70eb0cfcda9c9f02a: Status 404 returned error can't find the container with id b3b318c37dbb9de875d7ee328b2dece498d0242bb2428fe70eb0cfcda9c9f02a
Sep 15 11:32:05.340044 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:05.340014    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqtqpb"]
Sep 15 11:32:05.369409 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:32:05.369378    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c0417b0_c2f1_4b15_ab2c_8ef275a63226.slice/crio-10af050c711ced57108baf114ddde980ef6fad489be00d54b8a69bfc261979cc WatchSource:0}: Error finding container 10af050c711ced57108baf114ddde980ef6fad489be00d54b8a69bfc261979cc: Status 404 returned error can't find the container with id 10af050c711ced57108baf114ddde980ef6fad489be00d54b8a69bfc261979cc
Sep 15 11:32:06.194731 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:06.194696    2575 generic.go:356] "Generic (PLEG): container finished" podID="9c0417b0-c2f1-4b15-ab2c-8ef275a63226" containerID="620a9612d8af58e35e3d1f586db601f519ea002ee16594ac197869b1843eb79c" exitCode=0
Sep 15 11:32:06.195206 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:06.194787    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqtqpb" event={"ID":"9c0417b0-c2f1-4b15-ab2c-8ef275a63226","Type":"ContainerDied","Data":"620a9612d8af58e35e3d1f586db601f519ea002ee16594ac197869b1843eb79c"}
Sep 15 11:32:06.195206 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:06.194843    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqtqpb" event={"ID":"9c0417b0-c2f1-4b15-ab2c-8ef275a63226","Type":"ContainerStarted","Data":"10af050c711ced57108baf114ddde980ef6fad489be00d54b8a69bfc261979cc"}
Sep 15 11:32:06.196582 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:06.196556    2575 generic.go:356] "Generic (PLEG): container finished" podID="baec4ae3-0277-4e5a-9e94-7968868f78e4" containerID="075eb31fe9e9b62f8dd8eef11e41ddceb34430a1a1bd40912ee5b5f15d33d41f" exitCode=0
Sep 15 11:32:06.196702 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:06.196664    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6795rr" event={"ID":"baec4ae3-0277-4e5a-9e94-7968868f78e4","Type":"ContainerDied","Data":"075eb31fe9e9b62f8dd8eef11e41ddceb34430a1a1bd40912ee5b5f15d33d41f"}
Sep 15 11:32:06.196776 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:06.196719    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6795rr" event={"ID":"baec4ae3-0277-4e5a-9e94-7968868f78e4","Type":"ContainerStarted","Data":"b3b318c37dbb9de875d7ee328b2dece498d0242bb2428fe70eb0cfcda9c9f02a"}
Sep 15 11:32:06.198669 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:06.198629    2575 generic.go:356] "Generic (PLEG): container finished" podID="be88a752-3143-4208-8e10-c6c9f064bd78" containerID="f7e98f791993f1f5573dc6e66db5c855dbd1f788e703007291a32d572fc5321c" exitCode=0
Sep 15 11:32:06.198779 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:06.198699    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crqlcs" event={"ID":"be88a752-3143-4208-8e10-c6c9f064bd78","Type":"ContainerDied","Data":"f7e98f791993f1f5573dc6e66db5c855dbd1f788e703007291a32d572fc5321c"}
Sep 15 11:32:06.200699 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:06.200639    2575 generic.go:356] "Generic (PLEG): container finished" podID="06974682-950f-40ff-a0a3-06803363400d" containerID="c58ba512b66e1d9d5301bd7a79ed924daf00e8f589b4be2e9bedac3db23339d9" exitCode=0
Sep 15 11:32:06.200791 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:06.200710    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q4f6f" event={"ID":"06974682-950f-40ff-a0a3-06803363400d","Type":"ContainerDied","Data":"c58ba512b66e1d9d5301bd7a79ed924daf00e8f589b4be2e9bedac3db23339d9"}
Sep 15 11:32:07.208767 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:07.208692    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6795rr" event={"ID":"baec4ae3-0277-4e5a-9e94-7968868f78e4","Type":"ContainerStarted","Data":"6f9af6583f933e912c1258a3997503404e216a889c32fbd23373135a63d43b40"}
Sep 15 11:32:07.211187 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:07.211134    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crqlcs" event={"ID":"be88a752-3143-4208-8e10-c6c9f064bd78","Type":"ContainerStarted","Data":"a7caf794d0316aaac6a60c35e20b49025d46d3dee507fc7645f8eda0623b9d3f"}
Sep 15 11:32:07.214117 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:07.213806    2575 generic.go:356] "Generic (PLEG): container finished" podID="06974682-950f-40ff-a0a3-06803363400d" containerID="2c77fdb871fc88a906329e8d366a7e2ebc08597f94c7305a66fb920e96e4e01e" exitCode=0
Sep 15 11:32:07.214117 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:07.213914    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q4f6f" event={"ID":"06974682-950f-40ff-a0a3-06803363400d","Type":"ContainerDied","Data":"2c77fdb871fc88a906329e8d366a7e2ebc08597f94c7305a66fb920e96e4e01e"}
Sep 15 11:32:07.217578 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:07.217546    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqtqpb" event={"ID":"9c0417b0-c2f1-4b15-ab2c-8ef275a63226","Type":"ContainerStarted","Data":"ab9cebb9de26449059b44064d3dbda955474f860ea494389aca974210e4ce831"}
Sep 15 11:32:08.225204 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:08.225164    2575 generic.go:356] "Generic (PLEG): container finished" podID="baec4ae3-0277-4e5a-9e94-7968868f78e4" containerID="6f9af6583f933e912c1258a3997503404e216a889c32fbd23373135a63d43b40" exitCode=0
Sep 15 11:32:08.225682 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:08.225238    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6795rr" event={"ID":"baec4ae3-0277-4e5a-9e94-7968868f78e4","Type":"ContainerDied","Data":"6f9af6583f933e912c1258a3997503404e216a889c32fbd23373135a63d43b40"}
Sep 15 11:32:08.227745 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:08.227724    2575 generic.go:356] "Generic (PLEG): container finished" podID="be88a752-3143-4208-8e10-c6c9f064bd78" containerID="a7caf794d0316aaac6a60c35e20b49025d46d3dee507fc7645f8eda0623b9d3f" exitCode=0
Sep 15 11:32:08.227851 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:08.227798    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crqlcs" event={"ID":"be88a752-3143-4208-8e10-c6c9f064bd78","Type":"ContainerDied","Data":"a7caf794d0316aaac6a60c35e20b49025d46d3dee507fc7645f8eda0623b9d3f"}
Sep 15 11:32:08.230490 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:08.230467    2575 generic.go:356] "Generic (PLEG): container finished" podID="06974682-950f-40ff-a0a3-06803363400d" containerID="059305ce36ee483d1e2ab6ca80fcc8e599a61d52b007be803f9d24eb7a2c1097" exitCode=0
Sep 15 11:32:08.230622 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:08.230569    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q4f6f" event={"ID":"06974682-950f-40ff-a0a3-06803363400d","Type":"ContainerDied","Data":"059305ce36ee483d1e2ab6ca80fcc8e599a61d52b007be803f9d24eb7a2c1097"}
Sep 15 11:32:08.233152 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:08.233124    2575 generic.go:356] "Generic (PLEG): container finished" podID="9c0417b0-c2f1-4b15-ab2c-8ef275a63226" containerID="ab9cebb9de26449059b44064d3dbda955474f860ea494389aca974210e4ce831" exitCode=0
Sep 15 11:32:08.233273 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:08.233207    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqtqpb" event={"ID":"9c0417b0-c2f1-4b15-ab2c-8ef275a63226","Type":"ContainerDied","Data":"ab9cebb9de26449059b44064d3dbda955474f860ea494389aca974210e4ce831"}
Sep 15 11:32:09.240877 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:09.240845    2575 generic.go:356] "Generic (PLEG): container finished" podID="baec4ae3-0277-4e5a-9e94-7968868f78e4" containerID="af934eb8ff5960788457d4ee9819fa764f0618508e818b746501f831ecb76ed2" exitCode=0
Sep 15 11:32:09.241268 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:09.240931    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6795rr" event={"ID":"baec4ae3-0277-4e5a-9e94-7968868f78e4","Type":"ContainerDied","Data":"af934eb8ff5960788457d4ee9819fa764f0618508e818b746501f831ecb76ed2"}
Sep 15 11:32:09.243230 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:09.243203    2575 generic.go:356] "Generic (PLEG): container finished" podID="be88a752-3143-4208-8e10-c6c9f064bd78" containerID="da98481523da6593a891b5fbb5f8ecb86b9e91722254af307184a54fe602433f" exitCode=0
Sep 15 11:32:09.243364 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:09.243285    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crqlcs" event={"ID":"be88a752-3143-4208-8e10-c6c9f064bd78","Type":"ContainerDied","Data":"da98481523da6593a891b5fbb5f8ecb86b9e91722254af307184a54fe602433f"}
Sep 15 11:32:09.245566 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:09.245543    2575 generic.go:356] "Generic (PLEG): container finished" podID="9c0417b0-c2f1-4b15-ab2c-8ef275a63226" containerID="04edd27a44b66021b2a087382d1331147b868e8985e4af4c042317257e1cc3b3" exitCode=0
Sep 15 11:32:09.245740 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:09.245616    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqtqpb" event={"ID":"9c0417b0-c2f1-4b15-ab2c-8ef275a63226","Type":"ContainerDied","Data":"04edd27a44b66021b2a087382d1331147b868e8985e4af4c042317257e1cc3b3"}
Sep 15 11:32:09.383959 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:09.383930    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q4f6f"
Sep 15 11:32:09.500148 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:09.500102    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06974682-950f-40ff-a0a3-06803363400d-bundle\") pod \"06974682-950f-40ff-a0a3-06803363400d\" (UID: \"06974682-950f-40ff-a0a3-06803363400d\") "
Sep 15 11:32:09.500378 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:09.500159    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wm75r\" (UniqueName: \"kubernetes.io/projected/06974682-950f-40ff-a0a3-06803363400d-kube-api-access-wm75r\") pod \"06974682-950f-40ff-a0a3-06803363400d\" (UID: \"06974682-950f-40ff-a0a3-06803363400d\") "
Sep 15 11:32:09.500378 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:09.500188    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06974682-950f-40ff-a0a3-06803363400d-util\") pod \"06974682-950f-40ff-a0a3-06803363400d\" (UID: \"06974682-950f-40ff-a0a3-06803363400d\") "
Sep 15 11:32:09.500750 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:09.500727    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06974682-950f-40ff-a0a3-06803363400d-bundle" (OuterVolumeSpecName: "bundle") pod "06974682-950f-40ff-a0a3-06803363400d" (UID: "06974682-950f-40ff-a0a3-06803363400d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:32:09.502363 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:09.502336    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06974682-950f-40ff-a0a3-06803363400d-kube-api-access-wm75r" (OuterVolumeSpecName: "kube-api-access-wm75r") pod "06974682-950f-40ff-a0a3-06803363400d" (UID: "06974682-950f-40ff-a0a3-06803363400d"). InnerVolumeSpecName "kube-api-access-wm75r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:32:09.505735 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:09.505684    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06974682-950f-40ff-a0a3-06803363400d-util" (OuterVolumeSpecName: "util") pod "06974682-950f-40ff-a0a3-06803363400d" (UID: "06974682-950f-40ff-a0a3-06803363400d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:32:09.601681 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:09.601597    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wm75r\" (UniqueName: \"kubernetes.io/projected/06974682-950f-40ff-a0a3-06803363400d-kube-api-access-wm75r\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:32:09.601681 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:09.601641    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06974682-950f-40ff-a0a3-06803363400d-util\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:32:09.601681 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:09.601687    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06974682-950f-40ff-a0a3-06803363400d-bundle\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:32:10.253397 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:10.253366    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q4f6f"
Sep 15 11:32:10.253836 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:10.253403    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7q4f6f" event={"ID":"06974682-950f-40ff-a0a3-06803363400d","Type":"ContainerDied","Data":"fccdc3d4f6c1fd1dc357c56cab762cf938f6093dda87e306a315e64b1cd00ae8"}
Sep 15 11:32:10.253836 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:10.253455    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fccdc3d4f6c1fd1dc357c56cab762cf938f6093dda87e306a315e64b1cd00ae8"
Sep 15 11:32:10.409739 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:10.409706    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crqlcs"
Sep 15 11:32:10.458037 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:10.458004    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6795rr"
Sep 15 11:32:10.462531 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:10.462500    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqtqpb"
Sep 15 11:32:10.509545 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:10.509514    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c0417b0-c2f1-4b15-ab2c-8ef275a63226-util\") pod \"9c0417b0-c2f1-4b15-ab2c-8ef275a63226\" (UID: \"9c0417b0-c2f1-4b15-ab2c-8ef275a63226\") "
Sep 15 11:32:10.509720 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:10.509575    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be88a752-3143-4208-8e10-c6c9f064bd78-util\") pod \"be88a752-3143-4208-8e10-c6c9f064bd78\" (UID: \"be88a752-3143-4208-8e10-c6c9f064bd78\") "
Sep 15 11:32:10.509720 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:10.509624    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfl7m\" (UniqueName: \"kubernetes.io/projected/be88a752-3143-4208-8e10-c6c9f064bd78-kube-api-access-gfl7m\") pod \"be88a752-3143-4208-8e10-c6c9f064bd78\" (UID: \"be88a752-3143-4208-8e10-c6c9f064bd78\") "
Sep 15 11:32:10.509720 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:10.509715    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/baec4ae3-0277-4e5a-9e94-7968868f78e4-bundle\") pod \"baec4ae3-0277-4e5a-9e94-7968868f78e4\" (UID: \"baec4ae3-0277-4e5a-9e94-7968868f78e4\") "
Sep 15 11:32:10.509918 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:10.509737    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spf7t\" (UniqueName: \"kubernetes.io/projected/baec4ae3-0277-4e5a-9e94-7968868f78e4-kube-api-access-spf7t\") pod \"baec4ae3-0277-4e5a-9e94-7968868f78e4\" (UID: \"baec4ae3-0277-4e5a-9e94-7968868f78e4\") "
Sep 15 11:32:10.509918 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:10.509756    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be88a752-3143-4208-8e10-c6c9f064bd78-bundle\") pod \"be88a752-3143-4208-8e10-c6c9f064bd78\" (UID: \"be88a752-3143-4208-8e10-c6c9f064bd78\") "
Sep 15 11:32:10.509918 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:10.509783    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/baec4ae3-0277-4e5a-9e94-7968868f78e4-util\") pod \"baec4ae3-0277-4e5a-9e94-7968868f78e4\" (UID: \"baec4ae3-0277-4e5a-9e94-7968868f78e4\") "
Sep 15 11:32:10.509918 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:10.509812    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c0417b0-c2f1-4b15-ab2c-8ef275a63226-bundle\") pod \"9c0417b0-c2f1-4b15-ab2c-8ef275a63226\" (UID: \"9c0417b0-c2f1-4b15-ab2c-8ef275a63226\") "
Sep 15 11:32:10.509918 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:10.509852    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rlvxh\" (UniqueName: \"kubernetes.io/projected/9c0417b0-c2f1-4b15-ab2c-8ef275a63226-kube-api-access-rlvxh\") pod \"9c0417b0-c2f1-4b15-ab2c-8ef275a63226\" (UID: \"9c0417b0-c2f1-4b15-ab2c-8ef275a63226\") "
Sep 15 11:32:10.510513 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:10.510256    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/baec4ae3-0277-4e5a-9e94-7968868f78e4-bundle" (OuterVolumeSpecName: "bundle") pod "baec4ae3-0277-4e5a-9e94-7968868f78e4" (UID: "baec4ae3-0277-4e5a-9e94-7968868f78e4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:32:10.511091 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:10.511046    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be88a752-3143-4208-8e10-c6c9f064bd78-bundle" (OuterVolumeSpecName: "bundle") pod "be88a752-3143-4208-8e10-c6c9f064bd78" (UID: "be88a752-3143-4208-8e10-c6c9f064bd78"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:32:10.512012 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:10.511988    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c0417b0-c2f1-4b15-ab2c-8ef275a63226-bundle" (OuterVolumeSpecName: "bundle") pod "9c0417b0-c2f1-4b15-ab2c-8ef275a63226" (UID: "9c0417b0-c2f1-4b15-ab2c-8ef275a63226"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:32:10.512419 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:10.512395    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c0417b0-c2f1-4b15-ab2c-8ef275a63226-kube-api-access-rlvxh" (OuterVolumeSpecName: "kube-api-access-rlvxh") pod "9c0417b0-c2f1-4b15-ab2c-8ef275a63226" (UID: "9c0417b0-c2f1-4b15-ab2c-8ef275a63226"). InnerVolumeSpecName "kube-api-access-rlvxh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:32:10.514067 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:10.514046    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be88a752-3143-4208-8e10-c6c9f064bd78-kube-api-access-gfl7m" (OuterVolumeSpecName: "kube-api-access-gfl7m") pod "be88a752-3143-4208-8e10-c6c9f064bd78" (UID: "be88a752-3143-4208-8e10-c6c9f064bd78"). InnerVolumeSpecName "kube-api-access-gfl7m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:32:10.515688 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:10.515642    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/baec4ae3-0277-4e5a-9e94-7968868f78e4-kube-api-access-spf7t" (OuterVolumeSpecName: "kube-api-access-spf7t") pod "baec4ae3-0277-4e5a-9e94-7968868f78e4" (UID: "baec4ae3-0277-4e5a-9e94-7968868f78e4"). InnerVolumeSpecName "kube-api-access-spf7t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:32:10.517003 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:10.516980    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be88a752-3143-4208-8e10-c6c9f064bd78-util" (OuterVolumeSpecName: "util") pod "be88a752-3143-4208-8e10-c6c9f064bd78" (UID: "be88a752-3143-4208-8e10-c6c9f064bd78"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:32:10.518857 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:10.518831    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c0417b0-c2f1-4b15-ab2c-8ef275a63226-util" (OuterVolumeSpecName: "util") pod "9c0417b0-c2f1-4b15-ab2c-8ef275a63226" (UID: "9c0417b0-c2f1-4b15-ab2c-8ef275a63226"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:32:10.518913 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:10.518890    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/baec4ae3-0277-4e5a-9e94-7968868f78e4-util" (OuterVolumeSpecName: "util") pod "baec4ae3-0277-4e5a-9e94-7968868f78e4" (UID: "baec4ae3-0277-4e5a-9e94-7968868f78e4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:32:10.611160 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:10.611114    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfl7m\" (UniqueName: \"kubernetes.io/projected/be88a752-3143-4208-8e10-c6c9f064bd78-kube-api-access-gfl7m\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:32:10.611160 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:10.611152    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/baec4ae3-0277-4e5a-9e94-7968868f78e4-bundle\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:32:10.611160 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:10.611162    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spf7t\" (UniqueName: \"kubernetes.io/projected/baec4ae3-0277-4e5a-9e94-7968868f78e4-kube-api-access-spf7t\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:32:10.611160 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:10.611171    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be88a752-3143-4208-8e10-c6c9f064bd78-bundle\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:32:10.611425 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:10.611180    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/baec4ae3-0277-4e5a-9e94-7968868f78e4-util\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:32:10.611425 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:10.611190    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c0417b0-c2f1-4b15-ab2c-8ef275a63226-bundle\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:32:10.611425 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:10.611198    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rlvxh\" (UniqueName: \"kubernetes.io/projected/9c0417b0-c2f1-4b15-ab2c-8ef275a63226-kube-api-access-rlvxh\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:32:10.611425 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:10.611206    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c0417b0-c2f1-4b15-ab2c-8ef275a63226-util\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:32:10.611425 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:10.611214    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be88a752-3143-4208-8e10-c6c9f064bd78-util\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:32:11.262345 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:11.262313    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6795rr"
Sep 15 11:32:11.262898 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:11.262348    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6795rr" event={"ID":"baec4ae3-0277-4e5a-9e94-7968868f78e4","Type":"ContainerDied","Data":"b3b318c37dbb9de875d7ee328b2dece498d0242bb2428fe70eb0cfcda9c9f02a"}
Sep 15 11:32:11.262898 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:11.262397    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b3b318c37dbb9de875d7ee328b2dece498d0242bb2428fe70eb0cfcda9c9f02a"
Sep 15 11:32:11.264558 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:11.264532    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crqlcs"
Sep 15 11:32:11.264558 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:11.264550    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crqlcs" event={"ID":"be88a752-3143-4208-8e10-c6c9f064bd78","Type":"ContainerDied","Data":"486dc899e9babe634951cc1b062487b305032a8859e425b4e990768853236879"}
Sep 15 11:32:11.264766 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:11.264589    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="486dc899e9babe634951cc1b062487b305032a8859e425b4e990768853236879"
Sep 15 11:32:11.266873 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:11.266830    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqtqpb" event={"ID":"9c0417b0-c2f1-4b15-ab2c-8ef275a63226","Type":"ContainerDied","Data":"10af050c711ced57108baf114ddde980ef6fad489be00d54b8a69bfc261979cc"}
Sep 15 11:32:11.266873 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:11.266856    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqtqpb"
Sep 15 11:32:11.267078 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:32:11.266880    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="10af050c711ced57108baf114ddde980ef6fad489be00d54b8a69bfc261979cc"
Sep 15 11:32:11.295638 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:32:11.295594    2575 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaec4ae3_0277_4e5a_9e94_7968868f78e4.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c0417b0_c2f1_4b15_ab2c_8ef275a63226.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe88a752_3143_4208_8e10_c6c9f064bd78.slice/crio-486dc899e9babe634951cc1b062487b305032a8859e425b4e990768853236879\": RecentStats: unable to find data in memory cache]"
Sep 15 11:33:12.052766 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:12.052672    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-wjlsb"]
Sep 15 11:33:12.053359 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:12.053278    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06974682-950f-40ff-a0a3-06803363400d" containerName="extract"
Sep 15 11:33:12.053359 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:12.053302    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="06974682-950f-40ff-a0a3-06803363400d" containerName="extract"
Sep 15 11:33:12.053359 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:12.053314    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c0417b0-c2f1-4b15-ab2c-8ef275a63226" containerName="extract"
Sep 15 11:33:12.053359 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:12.053323    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c0417b0-c2f1-4b15-ab2c-8ef275a63226" containerName="extract"
Sep 15 11:33:12.053359 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:12.053345    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be88a752-3143-4208-8e10-c6c9f064bd78" containerName="extract"
Sep 15 11:33:12.053359 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:12.053353    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="be88a752-3143-4208-8e10-c6c9f064bd78" containerName="extract"
Sep 15 11:33:12.053720 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:12.053372    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c0417b0-c2f1-4b15-ab2c-8ef275a63226" containerName="util"
Sep 15 11:33:12.053720 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:12.053379    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c0417b0-c2f1-4b15-ab2c-8ef275a63226" containerName="util"
Sep 15 11:33:12.053720 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:12.053390    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06974682-950f-40ff-a0a3-06803363400d" containerName="pull"
Sep 15 11:33:12.053720 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:12.053398    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="06974682-950f-40ff-a0a3-06803363400d" containerName="pull"
Sep 15 11:33:12.053720 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:12.053407    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be88a752-3143-4208-8e10-c6c9f064bd78" containerName="pull"
Sep 15 11:33:12.053720 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:12.053414    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="be88a752-3143-4208-8e10-c6c9f064bd78" containerName="pull"
Sep 15 11:33:12.053720 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:12.053430    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06974682-950f-40ff-a0a3-06803363400d" containerName="util"
Sep 15 11:33:12.053720 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:12.053439    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="06974682-950f-40ff-a0a3-06803363400d" containerName="util"
Sep 15 11:33:12.053720 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:12.053450    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be88a752-3143-4208-8e10-c6c9f064bd78" containerName="util"
Sep 15 11:33:12.053720 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:12.053459    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="be88a752-3143-4208-8e10-c6c9f064bd78" containerName="util"
Sep 15 11:33:12.053720 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:12.053471    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baec4ae3-0277-4e5a-9e94-7968868f78e4" containerName="pull"
Sep 15 11:33:12.053720 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:12.053479    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="baec4ae3-0277-4e5a-9e94-7968868f78e4" containerName="pull"
Sep 15 11:33:12.053720 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:12.053489    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baec4ae3-0277-4e5a-9e94-7968868f78e4" containerName="extract"
Sep 15 11:33:12.053720 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:12.053498    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="baec4ae3-0277-4e5a-9e94-7968868f78e4" containerName="extract"
Sep 15 11:33:12.053720 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:12.053513    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baec4ae3-0277-4e5a-9e94-7968868f78e4" containerName="util"
Sep 15 11:33:12.053720 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:12.053522    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="baec4ae3-0277-4e5a-9e94-7968868f78e4" containerName="util"
Sep 15 11:33:12.053720 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:12.053536    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c0417b0-c2f1-4b15-ab2c-8ef275a63226" containerName="pull"
Sep 15 11:33:12.053720 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:12.053543    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c0417b0-c2f1-4b15-ab2c-8ef275a63226" containerName="pull"
Sep 15 11:33:12.053720 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:12.053649    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c0417b0-c2f1-4b15-ab2c-8ef275a63226" containerName="extract"
Sep 15 11:33:12.053720 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:12.053681    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="baec4ae3-0277-4e5a-9e94-7968868f78e4" containerName="extract"
Sep 15 11:33:12.053720 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:12.053691    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="be88a752-3143-4208-8e10-c6c9f064bd78" containerName="extract"
Sep 15 11:33:12.053720 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:12.053703    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="06974682-950f-40ff-a0a3-06803363400d" containerName="extract"
Sep 15 11:33:12.057373 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:12.057351    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-wjlsb"
Sep 15 11:33:12.059972 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:12.059949    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 15 11:33:12.060633 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:12.060615    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-wlpnn\""
Sep 15 11:33:12.060768 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:12.060614    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 15 11:33:12.064200 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:12.064173    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-wjlsb"]
Sep 15 11:33:12.200091 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:12.200048    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txz88\" (UniqueName: \"kubernetes.io/projected/e6d14c58-5500-45e8-9c00-28327f253dfc-kube-api-access-txz88\") pod \"authorino-7bcfd8f9cd-wjlsb\" (UID: \"e6d14c58-5500-45e8-9c00-28327f253dfc\") " pod="kuadrant-system/authorino-7bcfd8f9cd-wjlsb"
Sep 15 11:33:12.301081 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:12.301045    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txz88\" (UniqueName: \"kubernetes.io/projected/e6d14c58-5500-45e8-9c00-28327f253dfc-kube-api-access-txz88\") pod \"authorino-7bcfd8f9cd-wjlsb\" (UID: \"e6d14c58-5500-45e8-9c00-28327f253dfc\") " pod="kuadrant-system/authorino-7bcfd8f9cd-wjlsb"
Sep 15 11:33:12.312521 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:12.312453    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txz88\" (UniqueName: \"kubernetes.io/projected/e6d14c58-5500-45e8-9c00-28327f253dfc-kube-api-access-txz88\") pod \"authorino-7bcfd8f9cd-wjlsb\" (UID: \"e6d14c58-5500-45e8-9c00-28327f253dfc\") " pod="kuadrant-system/authorino-7bcfd8f9cd-wjlsb"
Sep 15 11:33:12.367380 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:12.367339    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-wjlsb"
Sep 15 11:33:12.641294 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:12.641264    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-wjlsb"]
Sep 15 11:33:12.642999 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:33:12.642972    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode6d14c58_5500_45e8_9c00_28327f253dfc.slice/crio-04fbbfb9db917f2d8b940438aadc6427e8e9243002865fa368f30443a68c8da6 WatchSource:0}: Error finding container 04fbbfb9db917f2d8b940438aadc6427e8e9243002865fa368f30443a68c8da6: Status 404 returned error can't find the container with id 04fbbfb9db917f2d8b940438aadc6427e8e9243002865fa368f30443a68c8da6
Sep 15 11:33:13.616759 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:13.616712    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-wjlsb" event={"ID":"e6d14c58-5500-45e8-9c00-28327f253dfc","Type":"ContainerStarted","Data":"04fbbfb9db917f2d8b940438aadc6427e8e9243002865fa368f30443a68c8da6"}
Sep 15 11:33:14.975129 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:14.974432    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-wjlsb"]
Sep 15 11:33:15.632075 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:15.631974    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-wjlsb" event={"ID":"e6d14c58-5500-45e8-9c00-28327f253dfc","Type":"ContainerStarted","Data":"dd42bd695eb2d11568cf1d248beee27496145d8ab17f7d21025a80abe505bfda"}
Sep 15 11:33:15.632075 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:15.632029    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-wjlsb" podUID="e6d14c58-5500-45e8-9c00-28327f253dfc" containerName="authorino" containerID="cri-o://dd42bd695eb2d11568cf1d248beee27496145d8ab17f7d21025a80abe505bfda" gracePeriod=30
Sep 15 11:33:15.667642 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:15.667577    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-wjlsb" podStartSLOduration=0.975013916 podStartE2EDuration="3.667555707s" totalImagesPullingTime="2.692541791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:33:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:33:15.66320492 +0000 UTC m=+466.089535515" watchObservedRunningTime="2026-09-15 11:33:15.667555707 +0000 UTC m=+466.093886303"
Sep 15 11:33:15.882539 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:15.882476    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-wjlsb"
Sep 15 11:33:16.040177 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:16.040136    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txz88\" (UniqueName: \"kubernetes.io/projected/e6d14c58-5500-45e8-9c00-28327f253dfc-kube-api-access-txz88\") pod \"e6d14c58-5500-45e8-9c00-28327f253dfc\" (UID: \"e6d14c58-5500-45e8-9c00-28327f253dfc\") "
Sep 15 11:33:16.042430 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:16.042399    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6d14c58-5500-45e8-9c00-28327f253dfc-kube-api-access-txz88" (OuterVolumeSpecName: "kube-api-access-txz88") pod "e6d14c58-5500-45e8-9c00-28327f253dfc" (UID: "e6d14c58-5500-45e8-9c00-28327f253dfc"). InnerVolumeSpecName "kube-api-access-txz88". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:33:16.140926 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:16.140838    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txz88\" (UniqueName: \"kubernetes.io/projected/e6d14c58-5500-45e8-9c00-28327f253dfc-kube-api-access-txz88\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:33:16.639183 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:16.639148    2575 generic.go:356] "Generic (PLEG): container finished" podID="e6d14c58-5500-45e8-9c00-28327f253dfc" containerID="dd42bd695eb2d11568cf1d248beee27496145d8ab17f7d21025a80abe505bfda" exitCode=0
Sep 15 11:33:16.639365 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:16.639193    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-wjlsb"
Sep 15 11:33:16.639365 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:16.639214    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-wjlsb" event={"ID":"e6d14c58-5500-45e8-9c00-28327f253dfc","Type":"ContainerDied","Data":"dd42bd695eb2d11568cf1d248beee27496145d8ab17f7d21025a80abe505bfda"}
Sep 15 11:33:16.639365 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:16.639247    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-wjlsb" event={"ID":"e6d14c58-5500-45e8-9c00-28327f253dfc","Type":"ContainerDied","Data":"04fbbfb9db917f2d8b940438aadc6427e8e9243002865fa368f30443a68c8da6"}
Sep 15 11:33:16.639365 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:16.639264    2575 scope.go:117] "RemoveContainer" containerID="dd42bd695eb2d11568cf1d248beee27496145d8ab17f7d21025a80abe505bfda"
Sep 15 11:33:16.648470 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:16.648444    2575 scope.go:117] "RemoveContainer" containerID="dd42bd695eb2d11568cf1d248beee27496145d8ab17f7d21025a80abe505bfda"
Sep 15 11:33:16.648843 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:33:16.648822    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd42bd695eb2d11568cf1d248beee27496145d8ab17f7d21025a80abe505bfda\": container with ID starting with dd42bd695eb2d11568cf1d248beee27496145d8ab17f7d21025a80abe505bfda not found: ID does not exist" containerID="dd42bd695eb2d11568cf1d248beee27496145d8ab17f7d21025a80abe505bfda"
Sep 15 11:33:16.648968 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:16.648853    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd42bd695eb2d11568cf1d248beee27496145d8ab17f7d21025a80abe505bfda"} err="failed to get container status \"dd42bd695eb2d11568cf1d248beee27496145d8ab17f7d21025a80abe505bfda\": rpc error: code = NotFound desc = could not find container \"dd42bd695eb2d11568cf1d248beee27496145d8ab17f7d21025a80abe505bfda\": container with ID starting with dd42bd695eb2d11568cf1d248beee27496145d8ab17f7d21025a80abe505bfda not found: ID does not exist"
Sep 15 11:33:16.656351 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:16.656316    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-wjlsb"]
Sep 15 11:33:16.661174 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:16.661144    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-wjlsb"]
Sep 15 11:33:18.093859 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:18.093820    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6d14c58-5500-45e8-9c00-28327f253dfc" path="/var/lib/kubelet/pods/e6d14c58-5500-45e8-9c00-28327f253dfc/volumes"
Sep 15 11:33:39.858408 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:39.858371    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-bpb8z"]
Sep 15 11:33:39.858821 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:39.858791    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6d14c58-5500-45e8-9c00-28327f253dfc" containerName="authorino"
Sep 15 11:33:39.858821 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:39.858805    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6d14c58-5500-45e8-9c00-28327f253dfc" containerName="authorino"
Sep 15 11:33:39.858898 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:39.858869    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6d14c58-5500-45e8-9c00-28327f253dfc" containerName="authorino"
Sep 15 11:33:39.862837 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:39.862814    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-bpb8z"
Sep 15 11:33:39.865179 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:39.865155    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 15 11:33:39.865333 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:39.865190    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 15 11:33:39.865333 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:39.865238    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-wlpnn\""
Sep 15 11:33:39.870826 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:39.870798    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-bpb8z"]
Sep 15 11:33:39.949872 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:39.949833    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjkzj\" (UniqueName: \"kubernetes.io/projected/05b3aac6-ccf7-4f22-b91d-2b500d01b62b-kube-api-access-wjkzj\") pod \"authorino-557f876f69-bpb8z\" (UID: \"05b3aac6-ccf7-4f22-b91d-2b500d01b62b\") " pod="kuadrant-system/authorino-557f876f69-bpb8z"
Sep 15 11:33:40.050858 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:40.050816    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjkzj\" (UniqueName: \"kubernetes.io/projected/05b3aac6-ccf7-4f22-b91d-2b500d01b62b-kube-api-access-wjkzj\") pod \"authorino-557f876f69-bpb8z\" (UID: \"05b3aac6-ccf7-4f22-b91d-2b500d01b62b\") " pod="kuadrant-system/authorino-557f876f69-bpb8z"
Sep 15 11:33:40.062217 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:40.062186    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjkzj\" (UniqueName: \"kubernetes.io/projected/05b3aac6-ccf7-4f22-b91d-2b500d01b62b-kube-api-access-wjkzj\") pod \"authorino-557f876f69-bpb8z\" (UID: \"05b3aac6-ccf7-4f22-b91d-2b500d01b62b\") " pod="kuadrant-system/authorino-557f876f69-bpb8z"
Sep 15 11:33:40.109013 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:40.108923    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-bpb8z"]
Sep 15 11:33:40.109230 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:40.109218    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-bpb8z"
Sep 15 11:33:40.146260 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:40.146219    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6bbcb78597-k4k9b"]
Sep 15 11:33:40.150034 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:40.150000    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bbcb78597-k4k9b"
Sep 15 11:33:40.153616 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:40.153582    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 15 11:33:40.167255 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:40.166375    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6bbcb78597-k4k9b"]
Sep 15 11:33:40.252996 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:40.252961    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8cd851fa-565b-45c2-a6bd-4c3a24574799-tls-cert\") pod \"authorino-6bbcb78597-k4k9b\" (UID: \"8cd851fa-565b-45c2-a6bd-4c3a24574799\") " pod="kuadrant-system/authorino-6bbcb78597-k4k9b"
Sep 15 11:33:40.252996 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:40.252998    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfg7m\" (UniqueName: \"kubernetes.io/projected/8cd851fa-565b-45c2-a6bd-4c3a24574799-kube-api-access-kfg7m\") pod \"authorino-6bbcb78597-k4k9b\" (UID: \"8cd851fa-565b-45c2-a6bd-4c3a24574799\") " pod="kuadrant-system/authorino-6bbcb78597-k4k9b"
Sep 15 11:33:40.354602 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:40.354566    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8cd851fa-565b-45c2-a6bd-4c3a24574799-tls-cert\") pod \"authorino-6bbcb78597-k4k9b\" (UID: \"8cd851fa-565b-45c2-a6bd-4c3a24574799\") " pod="kuadrant-system/authorino-6bbcb78597-k4k9b"
Sep 15 11:33:40.354602 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:40.354605    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfg7m\" (UniqueName: \"kubernetes.io/projected/8cd851fa-565b-45c2-a6bd-4c3a24574799-kube-api-access-kfg7m\") pod \"authorino-6bbcb78597-k4k9b\" (UID: \"8cd851fa-565b-45c2-a6bd-4c3a24574799\") " pod="kuadrant-system/authorino-6bbcb78597-k4k9b"
Sep 15 11:33:40.357318 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:40.357288    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8cd851fa-565b-45c2-a6bd-4c3a24574799-tls-cert\") pod \"authorino-6bbcb78597-k4k9b\" (UID: \"8cd851fa-565b-45c2-a6bd-4c3a24574799\") " pod="kuadrant-system/authorino-6bbcb78597-k4k9b"
Sep 15 11:33:40.366620 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:40.366527    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfg7m\" (UniqueName: \"kubernetes.io/projected/8cd851fa-565b-45c2-a6bd-4c3a24574799-kube-api-access-kfg7m\") pod \"authorino-6bbcb78597-k4k9b\" (UID: \"8cd851fa-565b-45c2-a6bd-4c3a24574799\") " pod="kuadrant-system/authorino-6bbcb78597-k4k9b"
Sep 15 11:33:40.389372 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:40.389342    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-bpb8z"]
Sep 15 11:33:40.391762 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:33:40.391725    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod05b3aac6_ccf7_4f22_b91d_2b500d01b62b.slice/crio-f06c156241c62afff5615507945c8ffdf998563806b5d74a0833a79c685e0bac WatchSource:0}: Error finding container f06c156241c62afff5615507945c8ffdf998563806b5d74a0833a79c685e0bac: Status 404 returned error can't find the container with id f06c156241c62afff5615507945c8ffdf998563806b5d74a0833a79c685e0bac
Sep 15 11:33:40.461623 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:40.461576    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bbcb78597-k4k9b"
Sep 15 11:33:40.737098 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:40.737067    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6bbcb78597-k4k9b"]
Sep 15 11:33:40.738861 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:33:40.738836    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8cd851fa_565b_45c2_a6bd_4c3a24574799.slice/crio-1ad4c2241e6352f0c5069ad07ee46d681c9f040ca539c1d55edcd53f1127739c WatchSource:0}: Error finding container 1ad4c2241e6352f0c5069ad07ee46d681c9f040ca539c1d55edcd53f1127739c: Status 404 returned error can't find the container with id 1ad4c2241e6352f0c5069ad07ee46d681c9f040ca539c1d55edcd53f1127739c
Sep 15 11:33:40.775394 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:40.775354    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-bpb8z" event={"ID":"05b3aac6-ccf7-4f22-b91d-2b500d01b62b","Type":"ContainerStarted","Data":"f06c156241c62afff5615507945c8ffdf998563806b5d74a0833a79c685e0bac"}
Sep 15 11:33:40.776753 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:40.776720    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6bbcb78597-k4k9b" event={"ID":"8cd851fa-565b-45c2-a6bd-4c3a24574799","Type":"ContainerStarted","Data":"1ad4c2241e6352f0c5069ad07ee46d681c9f040ca539c1d55edcd53f1127739c"}
Sep 15 11:33:41.785308 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:41.785266    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-bpb8z" event={"ID":"05b3aac6-ccf7-4f22-b91d-2b500d01b62b","Type":"ContainerStarted","Data":"4f8a0552242d164593ec5362b0a2b506a34251367ce67fc5c22b47eb78a1fc19"}
Sep 15 11:33:41.785838 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:41.785318    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-557f876f69-bpb8z" podUID="05b3aac6-ccf7-4f22-b91d-2b500d01b62b" containerName="authorino" containerID="cri-o://4f8a0552242d164593ec5362b0a2b506a34251367ce67fc5c22b47eb78a1fc19" gracePeriod=30
Sep 15 11:33:41.787091 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:41.787060    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6bbcb78597-k4k9b" event={"ID":"8cd851fa-565b-45c2-a6bd-4c3a24574799","Type":"ContainerStarted","Data":"021b8bd1a4987541eedd369386ef1045b4421d5f4e857a60429a3cc1bb13ed36"}
Sep 15 11:33:41.800253 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:41.800206    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-557f876f69-bpb8z" podStartSLOduration=2.252050473 podStartE2EDuration="2.80018844s" totalImagesPullingTime="548.137967ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:33:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:33:41.799552327 +0000 UTC m=+492.225882918" watchObservedRunningTime="2026-09-15 11:33:41.80018844 +0000 UTC m=+492.226519096"
Sep 15 11:33:41.815764 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:41.815708    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6bbcb78597-k4k9b" podStartSLOduration=1.363126273 podStartE2EDuration="1.815690909s" totalImagesPullingTime="452.564636ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:33:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:33:41.813906121 +0000 UTC m=+492.240236757" watchObservedRunningTime="2026-09-15 11:33:41.815690909 +0000 UTC m=+492.242021505"
Sep 15 11:33:42.030685 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:42.030635    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-bpb8z"
Sep 15 11:33:42.069787 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:42.069753    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjkzj\" (UniqueName: \"kubernetes.io/projected/05b3aac6-ccf7-4f22-b91d-2b500d01b62b-kube-api-access-wjkzj\") pod \"05b3aac6-ccf7-4f22-b91d-2b500d01b62b\" (UID: \"05b3aac6-ccf7-4f22-b91d-2b500d01b62b\") "
Sep 15 11:33:42.071926 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:42.071891    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05b3aac6-ccf7-4f22-b91d-2b500d01b62b-kube-api-access-wjkzj" (OuterVolumeSpecName: "kube-api-access-wjkzj") pod "05b3aac6-ccf7-4f22-b91d-2b500d01b62b" (UID: "05b3aac6-ccf7-4f22-b91d-2b500d01b62b"). InnerVolumeSpecName "kube-api-access-wjkzj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:33:42.171149 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:42.171102    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjkzj\" (UniqueName: \"kubernetes.io/projected/05b3aac6-ccf7-4f22-b91d-2b500d01b62b-kube-api-access-wjkzj\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:33:42.795230 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:42.795198    2575 generic.go:356] "Generic (PLEG): container finished" podID="05b3aac6-ccf7-4f22-b91d-2b500d01b62b" containerID="4f8a0552242d164593ec5362b0a2b506a34251367ce67fc5c22b47eb78a1fc19" exitCode=0
Sep 15 11:33:42.795720 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:42.795240    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-bpb8z"
Sep 15 11:33:42.795720 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:42.795287    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-bpb8z" event={"ID":"05b3aac6-ccf7-4f22-b91d-2b500d01b62b","Type":"ContainerDied","Data":"4f8a0552242d164593ec5362b0a2b506a34251367ce67fc5c22b47eb78a1fc19"}
Sep 15 11:33:42.795720 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:42.795334    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-bpb8z" event={"ID":"05b3aac6-ccf7-4f22-b91d-2b500d01b62b","Type":"ContainerDied","Data":"f06c156241c62afff5615507945c8ffdf998563806b5d74a0833a79c685e0bac"}
Sep 15 11:33:42.795720 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:42.795358    2575 scope.go:117] "RemoveContainer" containerID="4f8a0552242d164593ec5362b0a2b506a34251367ce67fc5c22b47eb78a1fc19"
Sep 15 11:33:42.805856 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:42.805831    2575 scope.go:117] "RemoveContainer" containerID="4f8a0552242d164593ec5362b0a2b506a34251367ce67fc5c22b47eb78a1fc19"
Sep 15 11:33:42.806291 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:33:42.806266    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f8a0552242d164593ec5362b0a2b506a34251367ce67fc5c22b47eb78a1fc19\": container with ID starting with 4f8a0552242d164593ec5362b0a2b506a34251367ce67fc5c22b47eb78a1fc19 not found: ID does not exist" containerID="4f8a0552242d164593ec5362b0a2b506a34251367ce67fc5c22b47eb78a1fc19"
Sep 15 11:33:42.806407 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:42.806300    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f8a0552242d164593ec5362b0a2b506a34251367ce67fc5c22b47eb78a1fc19"} err="failed to get container status \"4f8a0552242d164593ec5362b0a2b506a34251367ce67fc5c22b47eb78a1fc19\": rpc error: code = NotFound desc = could not find container \"4f8a0552242d164593ec5362b0a2b506a34251367ce67fc5c22b47eb78a1fc19\": container with ID starting with 4f8a0552242d164593ec5362b0a2b506a34251367ce67fc5c22b47eb78a1fc19 not found: ID does not exist"
Sep 15 11:33:42.824844 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:42.824803    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-bpb8z"]
Sep 15 11:33:42.828263 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:42.828230    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-bpb8z"]
Sep 15 11:33:44.094098 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:33:44.094063    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05b3aac6-ccf7-4f22-b91d-2b500d01b62b" path="/var/lib/kubelet/pods/05b3aac6-ccf7-4f22-b91d-2b500d01b62b/volumes"
Sep 15 11:34:22.013520 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:34:22.013441    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-bp6jm"]
Sep 15 11:34:22.014003 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:34:22.013948    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05b3aac6-ccf7-4f22-b91d-2b500d01b62b" containerName="authorino"
Sep 15 11:34:22.014003 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:34:22.013964    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="05b3aac6-ccf7-4f22-b91d-2b500d01b62b" containerName="authorino"
Sep 15 11:34:22.014090 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:34:22.014032    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="05b3aac6-ccf7-4f22-b91d-2b500d01b62b" containerName="authorino"
Sep 15 11:34:22.017399 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:34:22.017381    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-bp6jm"
Sep 15 11:34:22.019821 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:34:22.019790    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 15 11:34:22.020036 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:34:22.019909    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-46fpx\""
Sep 15 11:34:22.029741 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:34:22.029714    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-bp6jm"]
Sep 15 11:34:22.043638 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:34:22.043605    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdrhq\" (UniqueName: \"kubernetes.io/projected/0f637e00-1499-422e-8d72-e7a5504bac92-kube-api-access-fdrhq\") pod \"payload-processing-5b54b7fbb7-bp6jm\" (UID: \"0f637e00-1499-422e-8d72-e7a5504bac92\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-bp6jm"
Sep 15 11:34:22.043817 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:34:22.043647    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f637e00-1499-422e-8d72-e7a5504bac92-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-bp6jm\" (UID: \"0f637e00-1499-422e-8d72-e7a5504bac92\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-bp6jm"
Sep 15 11:34:22.144469 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:34:22.144426    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdrhq\" (UniqueName: \"kubernetes.io/projected/0f637e00-1499-422e-8d72-e7a5504bac92-kube-api-access-fdrhq\") pod \"payload-processing-5b54b7fbb7-bp6jm\" (UID: \"0f637e00-1499-422e-8d72-e7a5504bac92\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-bp6jm"
Sep 15 11:34:22.144469 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:34:22.144475    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f637e00-1499-422e-8d72-e7a5504bac92-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-bp6jm\" (UID: \"0f637e00-1499-422e-8d72-e7a5504bac92\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-bp6jm"
Sep 15 11:34:22.145183 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:34:22.145159    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f637e00-1499-422e-8d72-e7a5504bac92-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-bp6jm\" (UID: \"0f637e00-1499-422e-8d72-e7a5504bac92\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-bp6jm"
Sep 15 11:34:22.156537 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:34:22.156503    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdrhq\" (UniqueName: \"kubernetes.io/projected/0f637e00-1499-422e-8d72-e7a5504bac92-kube-api-access-fdrhq\") pod \"payload-processing-5b54b7fbb7-bp6jm\" (UID: \"0f637e00-1499-422e-8d72-e7a5504bac92\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-bp6jm"
Sep 15 11:34:22.329839 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:34:22.329791    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-bp6jm"
Sep 15 11:34:22.606778 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:34:22.606753    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-bp6jm"]
Sep 15 11:34:22.609534 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:34:22.609499    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f637e00_1499_422e_8d72_e7a5504bac92.slice/crio-b375383db20531391375dce35f005b104c796b9ec76142a36071be30ae42152e WatchSource:0}: Error finding container b375383db20531391375dce35f005b104c796b9ec76142a36071be30ae42152e: Status 404 returned error can't find the container with id b375383db20531391375dce35f005b104c796b9ec76142a36071be30ae42152e
Sep 15 11:34:23.023697 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:34:23.022981    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-bp6jm" event={"ID":"0f637e00-1499-422e-8d72-e7a5504bac92","Type":"ContainerStarted","Data":"b375383db20531391375dce35f005b104c796b9ec76142a36071be30ae42152e"}
Sep 15 11:34:25.035514 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:34:25.035476    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-bp6jm" event={"ID":"0f637e00-1499-422e-8d72-e7a5504bac92","Type":"ContainerStarted","Data":"3a06b3c9e3bd6e4f3d13faf4e241a865c0d2b1f5c13b1d44698047cc84015947"}
Sep 15 11:34:25.035935 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:34:25.035539    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-bp6jm"
Sep 15 11:34:25.054226 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:34:25.054169    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-bp6jm" podStartSLOduration=2.6982062190000002 podStartE2EDuration="4.05414971s" totalImagesPullingTime="1.355943491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:34:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:34:25.053177066 +0000 UTC m=+535.479507662" watchObservedRunningTime="2026-09-15 11:34:25.05414971 +0000 UTC m=+535.480480307"
Sep 15 11:34:36.043978 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:34:36.043940    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-bp6jm"
Sep 15 11:35:40.354850 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:35:40.354804    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-kd44x"]
Sep 15 11:35:40.358597 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:35:40.358565    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kd44x"
Sep 15 11:35:40.361009 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:35:40.360981    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 15 11:35:40.361193 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:35:40.361012    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 15 11:35:40.361594 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:35:40.361544    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 15 11:35:40.361882 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:35:40.361866    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ghj57\""
Sep 15 11:35:40.369536 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:35:40.369506    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-kd44x"]
Sep 15 11:35:40.400751 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:35:40.400717    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06ddb44b-3f4f-43c0-b15a-f85c537eb290-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kd44x\" (UID: \"06ddb44b-3f4f-43c0-b15a-f85c537eb290\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kd44x"
Sep 15 11:35:40.400751 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:35:40.400752    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06ddb44b-3f4f-43c0-b15a-f85c537eb290-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kd44x\" (UID: \"06ddb44b-3f4f-43c0-b15a-f85c537eb290\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kd44x"
Sep 15 11:35:40.400986 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:35:40.400836    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06ddb44b-3f4f-43c0-b15a-f85c537eb290-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kd44x\" (UID: \"06ddb44b-3f4f-43c0-b15a-f85c537eb290\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kd44x"
Sep 15 11:35:40.400986 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:35:40.400884    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06ddb44b-3f4f-43c0-b15a-f85c537eb290-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kd44x\" (UID: \"06ddb44b-3f4f-43c0-b15a-f85c537eb290\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kd44x"
Sep 15 11:35:40.400986 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:35:40.400918    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06ddb44b-3f4f-43c0-b15a-f85c537eb290-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kd44x\" (UID: \"06ddb44b-3f4f-43c0-b15a-f85c537eb290\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kd44x"
Sep 15 11:35:40.400986 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:35:40.400970    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7qzr\" (UniqueName: \"kubernetes.io/projected/06ddb44b-3f4f-43c0-b15a-f85c537eb290-kube-api-access-m7qzr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kd44x\" (UID: \"06ddb44b-3f4f-43c0-b15a-f85c537eb290\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kd44x"
Sep 15 11:35:40.502140 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:35:40.502092    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06ddb44b-3f4f-43c0-b15a-f85c537eb290-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kd44x\" (UID: \"06ddb44b-3f4f-43c0-b15a-f85c537eb290\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kd44x"
Sep 15 11:35:40.502368 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:35:40.502159    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06ddb44b-3f4f-43c0-b15a-f85c537eb290-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kd44x\" (UID: \"06ddb44b-3f4f-43c0-b15a-f85c537eb290\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kd44x"
Sep 15 11:35:40.502368 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:35:40.502212    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7qzr\" (UniqueName: \"kubernetes.io/projected/06ddb44b-3f4f-43c0-b15a-f85c537eb290-kube-api-access-m7qzr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kd44x\" (UID: \"06ddb44b-3f4f-43c0-b15a-f85c537eb290\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kd44x"
Sep 15 11:35:40.502368 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:35:40.502314    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06ddb44b-3f4f-43c0-b15a-f85c537eb290-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kd44x\" (UID: \"06ddb44b-3f4f-43c0-b15a-f85c537eb290\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kd44x"
Sep 15 11:35:40.502368 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:35:40.502336    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06ddb44b-3f4f-43c0-b15a-f85c537eb290-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kd44x\" (UID: \"06ddb44b-3f4f-43c0-b15a-f85c537eb290\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kd44x"
Sep 15 11:35:40.502601 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:35:40.502378    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06ddb44b-3f4f-43c0-b15a-f85c537eb290-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kd44x\" (UID: \"06ddb44b-3f4f-43c0-b15a-f85c537eb290\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kd44x"
Sep 15 11:35:40.502601 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:35:40.502585    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06ddb44b-3f4f-43c0-b15a-f85c537eb290-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kd44x\" (UID: \"06ddb44b-3f4f-43c0-b15a-f85c537eb290\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kd44x"
Sep 15 11:35:40.502770 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:35:40.502615    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06ddb44b-3f4f-43c0-b15a-f85c537eb290-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kd44x\" (UID: \"06ddb44b-3f4f-43c0-b15a-f85c537eb290\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kd44x"
Sep 15 11:35:40.502770 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:35:40.502730    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06ddb44b-3f4f-43c0-b15a-f85c537eb290-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kd44x\" (UID: \"06ddb44b-3f4f-43c0-b15a-f85c537eb290\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kd44x"
Sep 15 11:35:40.504567 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:35:40.504538    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06ddb44b-3f4f-43c0-b15a-f85c537eb290-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kd44x\" (UID: \"06ddb44b-3f4f-43c0-b15a-f85c537eb290\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kd44x"
Sep 15 11:35:40.504961 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:35:40.504940    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06ddb44b-3f4f-43c0-b15a-f85c537eb290-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kd44x\" (UID: \"06ddb44b-3f4f-43c0-b15a-f85c537eb290\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kd44x"
Sep 15 11:35:40.510930 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:35:40.510905    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7qzr\" (UniqueName: \"kubernetes.io/projected/06ddb44b-3f4f-43c0-b15a-f85c537eb290-kube-api-access-m7qzr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kd44x\" (UID: \"06ddb44b-3f4f-43c0-b15a-f85c537eb290\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kd44x"
Sep 15 11:35:40.674025 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:35:40.673911    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kd44x"
Sep 15 11:35:40.953308 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:35:40.953278    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-kd44x"]
Sep 15 11:35:40.955502 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:35:40.955465    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06ddb44b_3f4f_43c0_b15a_f85c537eb290.slice/crio-144e1077323bbc122cd46067e416769dee69dcd038091d6833a5195baef4b565 WatchSource:0}: Error finding container 144e1077323bbc122cd46067e416769dee69dcd038091d6833a5195baef4b565: Status 404 returned error can't find the container with id 144e1077323bbc122cd46067e416769dee69dcd038091d6833a5195baef4b565
Sep 15 11:35:40.956985 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:35:40.956966    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 11:35:41.465423 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:35:41.465378    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kd44x" event={"ID":"06ddb44b-3f4f-43c0-b15a-f85c537eb290","Type":"ContainerStarted","Data":"144e1077323bbc122cd46067e416769dee69dcd038091d6833a5195baef4b565"}
Sep 15 11:35:42.473550 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:35:42.473508    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kd44x" event={"ID":"06ddb44b-3f4f-43c0-b15a-f85c537eb290","Type":"ContainerStarted","Data":"e9490ec9b301c65638eb2778cbefc38affc6908bd2a2b55def88cadb42ae010a"}
Sep 15 11:35:42.496678 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:35:42.493389    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kd44x" podStartSLOduration=1.499941174 podStartE2EDuration="2.493366025s" totalImagesPullingTime="993.424851ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:35:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:35:42.490476437 +0000 UTC m=+612.916807032" watchObservedRunningTime="2026-09-15 11:35:42.493366025 +0000 UTC m=+612.919696621"
Sep 15 11:35:50.674099 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:35:50.674056    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kd44x"
Sep 15 11:35:50.674718 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:35:50.674127    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kd44x"
Sep 15 11:35:50.687242 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:35:50.687212    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kd44x"
Sep 15 11:35:51.539792 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:35:51.539764    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kd44x"
Sep 15 11:36:02.754924 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:36:02.754837    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-wvp4r"]
Sep 15 11:36:02.759099 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:36:02.759071    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wvp4r"
Sep 15 11:36:02.761805 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:36:02.761774    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 15 11:36:02.770646 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:36:02.770606    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-wvp4r"]
Sep 15 11:36:02.916438 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:36:02.916386    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05bee46c-7d21-448e-a734-023e2ff2ad30-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wvp4r\" (UID: \"05bee46c-7d21-448e-a734-023e2ff2ad30\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wvp4r"
Sep 15 11:36:02.916696 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:36:02.916464    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05bee46c-7d21-448e-a734-023e2ff2ad30-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wvp4r\" (UID: \"05bee46c-7d21-448e-a734-023e2ff2ad30\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wvp4r"
Sep 15 11:36:02.916696 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:36:02.916508    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgsdw\" (UniqueName: \"kubernetes.io/projected/05bee46c-7d21-448e-a734-023e2ff2ad30-kube-api-access-hgsdw\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wvp4r\" (UID: \"05bee46c-7d21-448e-a734-023e2ff2ad30\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wvp4r"
Sep 15 11:36:02.916696 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:36:02.916546    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05bee46c-7d21-448e-a734-023e2ff2ad30-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wvp4r\" (UID: \"05bee46c-7d21-448e-a734-023e2ff2ad30\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wvp4r"
Sep 15 11:36:02.916696 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:36:02.916623    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05bee46c-7d21-448e-a734-023e2ff2ad30-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wvp4r\" (UID: \"05bee46c-7d21-448e-a734-023e2ff2ad30\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wvp4r"
Sep 15 11:36:02.916851 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:36:02.916715    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05bee46c-7d21-448e-a734-023e2ff2ad30-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wvp4r\" (UID: \"05bee46c-7d21-448e-a734-023e2ff2ad30\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wvp4r"
Sep 15 11:36:03.018285 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:36:03.018180    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05bee46c-7d21-448e-a734-023e2ff2ad30-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wvp4r\" (UID: \"05bee46c-7d21-448e-a734-023e2ff2ad30\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wvp4r"
Sep 15 11:36:03.018285 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:36:03.018233    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05bee46c-7d21-448e-a734-023e2ff2ad30-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wvp4r\" (UID: \"05bee46c-7d21-448e-a734-023e2ff2ad30\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wvp4r"
Sep 15 11:36:03.018285 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:36:03.018265    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgsdw\" (UniqueName: \"kubernetes.io/projected/05bee46c-7d21-448e-a734-023e2ff2ad30-kube-api-access-hgsdw\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wvp4r\" (UID: \"05bee46c-7d21-448e-a734-023e2ff2ad30\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wvp4r"
Sep 15 11:36:03.018579 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:36:03.018295    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05bee46c-7d21-448e-a734-023e2ff2ad30-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wvp4r\" (UID: \"05bee46c-7d21-448e-a734-023e2ff2ad30\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wvp4r"
Sep 15 11:36:03.018579 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:36:03.018319    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05bee46c-7d21-448e-a734-023e2ff2ad30-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wvp4r\" (UID: \"05bee46c-7d21-448e-a734-023e2ff2ad30\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wvp4r"
Sep 15 11:36:03.018579 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:36:03.018349    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05bee46c-7d21-448e-a734-023e2ff2ad30-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wvp4r\" (UID: \"05bee46c-7d21-448e-a734-023e2ff2ad30\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wvp4r"
Sep 15 11:36:03.018809 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:36:03.018744    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05bee46c-7d21-448e-a734-023e2ff2ad30-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wvp4r\" (UID: \"05bee46c-7d21-448e-a734-023e2ff2ad30\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wvp4r"
Sep 15 11:36:03.018809 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:36:03.018797    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05bee46c-7d21-448e-a734-023e2ff2ad30-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wvp4r\" (UID: \"05bee46c-7d21-448e-a734-023e2ff2ad30\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wvp4r"
Sep 15 11:36:03.018889 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:36:03.018868    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05bee46c-7d21-448e-a734-023e2ff2ad30-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wvp4r\" (UID: \"05bee46c-7d21-448e-a734-023e2ff2ad30\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wvp4r"
Sep 15 11:36:03.020692 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:36:03.020648    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05bee46c-7d21-448e-a734-023e2ff2ad30-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wvp4r\" (UID: \"05bee46c-7d21-448e-a734-023e2ff2ad30\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wvp4r"
Sep 15 11:36:03.020939 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:36:03.020921    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05bee46c-7d21-448e-a734-023e2ff2ad30-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wvp4r\" (UID: \"05bee46c-7d21-448e-a734-023e2ff2ad30\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wvp4r"
Sep 15 11:36:03.027616 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:36:03.027583    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgsdw\" (UniqueName: \"kubernetes.io/projected/05bee46c-7d21-448e-a734-023e2ff2ad30-kube-api-access-hgsdw\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wvp4r\" (UID: \"05bee46c-7d21-448e-a734-023e2ff2ad30\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wvp4r"
Sep 15 11:36:03.071703 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:36:03.071643    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wvp4r"
Sep 15 11:36:03.349269 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:36:03.349238    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-wvp4r"]
Sep 15 11:36:03.351912 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:36:03.351882    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05bee46c_7d21_448e_a734_023e2ff2ad30.slice/crio-4035c75e06a81dc44a6386a006d60ea63fcb1324bb5d8e3d1ebb6842885bfa8c WatchSource:0}: Error finding container 4035c75e06a81dc44a6386a006d60ea63fcb1324bb5d8e3d1ebb6842885bfa8c: Status 404 returned error can't find the container with id 4035c75e06a81dc44a6386a006d60ea63fcb1324bb5d8e3d1ebb6842885bfa8c
Sep 15 11:36:03.605312 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:36:03.605227    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wvp4r" event={"ID":"05bee46c-7d21-448e-a734-023e2ff2ad30","Type":"ContainerStarted","Data":"4035c75e06a81dc44a6386a006d60ea63fcb1324bb5d8e3d1ebb6842885bfa8c"}
Sep 15 11:36:04.615730 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:36:04.615690    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wvp4r" event={"ID":"05bee46c-7d21-448e-a734-023e2ff2ad30","Type":"ContainerStarted","Data":"50bacf5ea64b4ee366cf043da653f5b71e33fb1c02dcbdb70847555285c9ee7d"}
Sep 15 11:36:04.635948 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:36:04.635891    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wvp4r" podStartSLOduration=2.44439108 podStartE2EDuration="2.635871846s" totalImagesPullingTime="191.480766ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:36:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:36:04.633406482 +0000 UTC m=+635.059737079" watchObservedRunningTime="2026-09-15 11:36:04.635871846 +0000 UTC m=+635.062202442"
Sep 15 11:36:13.072128 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:36:13.072081    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wvp4r"
Sep 15 11:36:13.072598 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:36:13.072149    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wvp4r"
Sep 15 11:36:13.085021 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:36:13.084987    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wvp4r"
Sep 15 11:36:13.678332 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:36:13.678303    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wvp4r"
Sep 15 11:37:41.754132 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:37:41.754042    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-849f4c7b4d-wmg2z"]
Sep 15 11:37:41.757567 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:37:41.757544    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-849f4c7b4d-wmg2z"
Sep 15 11:37:41.762199 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:37:41.762169    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9hrn\" (UniqueName: \"kubernetes.io/projected/36d4e344-18df-40d7-b0d5-c7803d8f74c6-kube-api-access-x9hrn\") pod \"authorino-849f4c7b4d-wmg2z\" (UID: \"36d4e344-18df-40d7-b0d5-c7803d8f74c6\") " pod="kuadrant-system/authorino-849f4c7b4d-wmg2z"
Sep 15 11:37:41.762356 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:37:41.762206    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/36d4e344-18df-40d7-b0d5-c7803d8f74c6-tls-cert\") pod \"authorino-849f4c7b4d-wmg2z\" (UID: \"36d4e344-18df-40d7-b0d5-c7803d8f74c6\") " pod="kuadrant-system/authorino-849f4c7b4d-wmg2z"
Sep 15 11:37:41.769182 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:37:41.769145    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-849f4c7b4d-wmg2z"]
Sep 15 11:37:41.863435 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:37:41.863394    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9hrn\" (UniqueName: \"kubernetes.io/projected/36d4e344-18df-40d7-b0d5-c7803d8f74c6-kube-api-access-x9hrn\") pod \"authorino-849f4c7b4d-wmg2z\" (UID: \"36d4e344-18df-40d7-b0d5-c7803d8f74c6\") " pod="kuadrant-system/authorino-849f4c7b4d-wmg2z"
Sep 15 11:37:41.863435 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:37:41.863439    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/36d4e344-18df-40d7-b0d5-c7803d8f74c6-tls-cert\") pod \"authorino-849f4c7b4d-wmg2z\" (UID: \"36d4e344-18df-40d7-b0d5-c7803d8f74c6\") " pod="kuadrant-system/authorino-849f4c7b4d-wmg2z"
Sep 15 11:37:41.866002 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:37:41.865969    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/36d4e344-18df-40d7-b0d5-c7803d8f74c6-tls-cert\") pod \"authorino-849f4c7b4d-wmg2z\" (UID: \"36d4e344-18df-40d7-b0d5-c7803d8f74c6\") " pod="kuadrant-system/authorino-849f4c7b4d-wmg2z"
Sep 15 11:37:41.871856 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:37:41.871824    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9hrn\" (UniqueName: \"kubernetes.io/projected/36d4e344-18df-40d7-b0d5-c7803d8f74c6-kube-api-access-x9hrn\") pod \"authorino-849f4c7b4d-wmg2z\" (UID: \"36d4e344-18df-40d7-b0d5-c7803d8f74c6\") " pod="kuadrant-system/authorino-849f4c7b4d-wmg2z"
Sep 15 11:37:42.067974 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:37:42.067869    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-849f4c7b4d-wmg2z"
Sep 15 11:37:42.358854 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:37:42.358819    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-849f4c7b4d-wmg2z"]
Sep 15 11:37:42.359635 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:37:42.359609    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36d4e344_18df_40d7_b0d5_c7803d8f74c6.slice/crio-5a845bc2eecc099adef24a73aeef3bbf02aa37cc70492cc658fa91ff11c70fe6 WatchSource:0}: Error finding container 5a845bc2eecc099adef24a73aeef3bbf02aa37cc70492cc658fa91ff11c70fe6: Status 404 returned error can't find the container with id 5a845bc2eecc099adef24a73aeef3bbf02aa37cc70492cc658fa91ff11c70fe6
Sep 15 11:37:43.194416 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:37:43.194369    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-849f4c7b4d-wmg2z" event={"ID":"36d4e344-18df-40d7-b0d5-c7803d8f74c6","Type":"ContainerStarted","Data":"f9c9e079fadba4b12dccc1d07f6b89487652b15e5feb59a2e1621ea33bd8914f"}
Sep 15 11:37:43.195179 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:37:43.194434    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-849f4c7b4d-wmg2z" event={"ID":"36d4e344-18df-40d7-b0d5-c7803d8f74c6","Type":"ContainerStarted","Data":"5a845bc2eecc099adef24a73aeef3bbf02aa37cc70492cc658fa91ff11c70fe6"}
Sep 15 11:37:43.211299 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:37:43.211239    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-849f4c7b4d-wmg2z" podStartSLOduration=1.547490066 podStartE2EDuration="2.211219799s" totalImagesPullingTime="663.729733ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:37:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:37:43.21076345 +0000 UTC m=+733.637094046" watchObservedRunningTime="2026-09-15 11:37:43.211219799 +0000 UTC m=+733.637550396"
Sep 15 11:37:43.244883 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:37:43.244833    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6bbcb78597-k4k9b"]
Sep 15 11:37:43.245157 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:37:43.245101    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-6bbcb78597-k4k9b" podUID="8cd851fa-565b-45c2-a6bd-4c3a24574799" containerName="authorino" containerID="cri-o://021b8bd1a4987541eedd369386ef1045b4421d5f4e857a60429a3cc1bb13ed36" gracePeriod=30
Sep 15 11:37:43.511590 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:37:43.511553    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bbcb78597-k4k9b"
Sep 15 11:37:43.578232 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:37:43.578192    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8cd851fa-565b-45c2-a6bd-4c3a24574799-tls-cert\") pod \"8cd851fa-565b-45c2-a6bd-4c3a24574799\" (UID: \"8cd851fa-565b-45c2-a6bd-4c3a24574799\") "
Sep 15 11:37:43.578437 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:37:43.578295    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kfg7m\" (UniqueName: \"kubernetes.io/projected/8cd851fa-565b-45c2-a6bd-4c3a24574799-kube-api-access-kfg7m\") pod \"8cd851fa-565b-45c2-a6bd-4c3a24574799\" (UID: \"8cd851fa-565b-45c2-a6bd-4c3a24574799\") "
Sep 15 11:37:43.580434 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:37:43.580394    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cd851fa-565b-45c2-a6bd-4c3a24574799-kube-api-access-kfg7m" (OuterVolumeSpecName: "kube-api-access-kfg7m") pod "8cd851fa-565b-45c2-a6bd-4c3a24574799" (UID: "8cd851fa-565b-45c2-a6bd-4c3a24574799"). InnerVolumeSpecName "kube-api-access-kfg7m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:37:43.590179 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:37:43.590131    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cd851fa-565b-45c2-a6bd-4c3a24574799-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "8cd851fa-565b-45c2-a6bd-4c3a24574799" (UID: "8cd851fa-565b-45c2-a6bd-4c3a24574799"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:37:43.680180 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:37:43.680138    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kfg7m\" (UniqueName: \"kubernetes.io/projected/8cd851fa-565b-45c2-a6bd-4c3a24574799-kube-api-access-kfg7m\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:37:43.680180 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:37:43.680184    2575 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8cd851fa-565b-45c2-a6bd-4c3a24574799-tls-cert\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:37:44.202924 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:37:44.202881    2575 generic.go:356] "Generic (PLEG): container finished" podID="8cd851fa-565b-45c2-a6bd-4c3a24574799" containerID="021b8bd1a4987541eedd369386ef1045b4421d5f4e857a60429a3cc1bb13ed36" exitCode=0
Sep 15 11:37:44.202924 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:37:44.202925    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bbcb78597-k4k9b"
Sep 15 11:37:44.203495 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:37:44.202968    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6bbcb78597-k4k9b" event={"ID":"8cd851fa-565b-45c2-a6bd-4c3a24574799","Type":"ContainerDied","Data":"021b8bd1a4987541eedd369386ef1045b4421d5f4e857a60429a3cc1bb13ed36"}
Sep 15 11:37:44.203495 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:37:44.203017    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6bbcb78597-k4k9b" event={"ID":"8cd851fa-565b-45c2-a6bd-4c3a24574799","Type":"ContainerDied","Data":"1ad4c2241e6352f0c5069ad07ee46d681c9f040ca539c1d55edcd53f1127739c"}
Sep 15 11:37:44.203495 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:37:44.203036    2575 scope.go:117] "RemoveContainer" containerID="021b8bd1a4987541eedd369386ef1045b4421d5f4e857a60429a3cc1bb13ed36"
Sep 15 11:37:44.215560 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:37:44.215531    2575 scope.go:117] "RemoveContainer" containerID="021b8bd1a4987541eedd369386ef1045b4421d5f4e857a60429a3cc1bb13ed36"
Sep 15 11:37:44.216220 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:37:44.216200    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"021b8bd1a4987541eedd369386ef1045b4421d5f4e857a60429a3cc1bb13ed36\": container with ID starting with 021b8bd1a4987541eedd369386ef1045b4421d5f4e857a60429a3cc1bb13ed36 not found: ID does not exist" containerID="021b8bd1a4987541eedd369386ef1045b4421d5f4e857a60429a3cc1bb13ed36"
Sep 15 11:37:44.216345 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:37:44.216234    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"021b8bd1a4987541eedd369386ef1045b4421d5f4e857a60429a3cc1bb13ed36"} err="failed to get container status \"021b8bd1a4987541eedd369386ef1045b4421d5f4e857a60429a3cc1bb13ed36\": rpc error: code = NotFound desc = could not find container \"021b8bd1a4987541eedd369386ef1045b4421d5f4e857a60429a3cc1bb13ed36\": container with ID starting with 021b8bd1a4987541eedd369386ef1045b4421d5f4e857a60429a3cc1bb13ed36 not found: ID does not exist"
Sep 15 11:37:44.234287 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:37:44.234248    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6bbcb78597-k4k9b"]
Sep 15 11:37:44.243469 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:37:44.243433    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6bbcb78597-k4k9b"]
Sep 15 11:37:46.093975 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:37:46.093937    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cd851fa-565b-45c2-a6bd-4c3a24574799" path="/var/lib/kubelet/pods/8cd851fa-565b-45c2-a6bd-4c3a24574799/volumes"
Sep 15 11:38:03.311664 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:03.311608    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"]
Sep 15 11:38:03.312114 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:03.312057    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cd851fa-565b-45c2-a6bd-4c3a24574799" containerName="authorino"
Sep 15 11:38:03.312114 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:03.312071    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cd851fa-565b-45c2-a6bd-4c3a24574799" containerName="authorino"
Sep 15 11:38:03.312192 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:03.312147    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cd851fa-565b-45c2-a6bd-4c3a24574799" containerName="authorino"
Sep 15 11:38:03.314851 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:03.314829    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"
Sep 15 11:38:03.317252 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:03.317228    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-9fc4b9-openshift-default-dockercfg-knvv8\""
Sep 15 11:38:03.328411 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:03.328379    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"]
Sep 15 11:38:03.370283 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:03.370244    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p2jx\" (UniqueName: \"kubernetes.io/projected/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-kube-api-access-7p2jx\") pod \"e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8\" (UID: \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\") " pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"
Sep 15 11:38:03.370484 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:03.370307    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-istio-data\") pod \"e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8\" (UID: \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\") " pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"
Sep 15 11:38:03.370484 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:03.370384    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-credential-socket\") pod \"e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8\" (UID: \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\") " pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"
Sep 15 11:38:03.370484 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:03.370415    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-istio-token\") pod \"e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8\" (UID: \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\") " pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"
Sep 15 11:38:03.370484 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:03.370451    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-istio-envoy\") pod \"e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8\" (UID: \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\") " pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"
Sep 15 11:38:03.370757 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:03.370485    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-workload-socket\") pod \"e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8\" (UID: \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\") " pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"
Sep 15 11:38:03.370757 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:03.370526    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-istio-podinfo\") pod \"e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8\" (UID: \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\") " pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"
Sep 15 11:38:03.370757 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:03.370625    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-workload-certs\") pod \"e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8\" (UID: \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\") " pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"
Sep 15 11:38:03.370757 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:03.370648    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-istiod-ca-cert\") pod \"e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8\" (UID: \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\") " pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"
Sep 15 11:38:03.471472 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:03.471434    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-workload-certs\") pod \"e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8\" (UID: \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\") " pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"
Sep 15 11:38:03.471472 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:03.471477    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-istiod-ca-cert\") pod \"e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8\" (UID: \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\") " pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"
Sep 15 11:38:03.471765 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:03.471524    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p2jx\" (UniqueName: \"kubernetes.io/projected/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-kube-api-access-7p2jx\") pod \"e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8\" (UID: \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\") " pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"
Sep 15 11:38:03.471765 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:03.471599    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-istio-data\") pod \"e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8\" (UID: \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\") " pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"
Sep 15 11:38:03.471765 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:03.471630    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-credential-socket\") pod \"e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8\" (UID: \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\") " pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"
Sep 15 11:38:03.471765 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:03.471646    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-istio-token\") pod \"e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8\" (UID: \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\") " pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"
Sep 15 11:38:03.471765 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:03.471696    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-istio-envoy\") pod \"e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8\" (UID: \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\") " pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"
Sep 15 11:38:03.471765 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:03.471740    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-workload-socket\") pod \"e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8\" (UID: \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\") " pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"
Sep 15 11:38:03.472072 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:03.471792    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-istio-podinfo\") pod \"e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8\" (UID: \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\") " pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"
Sep 15 11:38:03.472072 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:03.471915    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-workload-certs\") pod \"e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8\" (UID: \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\") " pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"
Sep 15 11:38:03.472225 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:03.472139    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-istio-data\") pod \"e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8\" (UID: \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\") " pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"
Sep 15 11:38:03.472398 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:03.472377    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-credential-socket\") pod \"e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8\" (UID: \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\") " pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"
Sep 15 11:38:03.472485 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:03.472379    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-istiod-ca-cert\") pod \"e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8\" (UID: \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\") " pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"
Sep 15 11:38:03.472600 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:03.472579    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-workload-socket\") pod \"e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8\" (UID: \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\") " pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"
Sep 15 11:38:03.474753 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:03.474725    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-istio-envoy\") pod \"e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8\" (UID: \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\") " pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"
Sep 15 11:38:03.474995 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:03.474973    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-istio-podinfo\") pod \"e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8\" (UID: \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\") " pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"
Sep 15 11:38:03.492115 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:03.492079    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p2jx\" (UniqueName: \"kubernetes.io/projected/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-kube-api-access-7p2jx\") pod \"e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8\" (UID: \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\") " pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"
Sep 15 11:38:03.492540 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:03.492515    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-istio-token\") pod \"e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8\" (UID: \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\") " pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"
Sep 15 11:38:03.628012 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:03.627887    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"
Sep 15 11:38:03.913497 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:03.913463    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"]
Sep 15 11:38:03.914863 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:38:03.914834    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod981d2e3c_8232_4a0f_bcf3_c13ad35d2007.slice/crio-da2b2140f02647e88ff89b089da4002c9d141a8c8170e8d869ea4106b6e8708a WatchSource:0}: Error finding container da2b2140f02647e88ff89b089da4002c9d141a8c8170e8d869ea4106b6e8708a: Status 404 returned error can't find the container with id da2b2140f02647e88ff89b089da4002c9d141a8c8170e8d869ea4106b6e8708a
Sep 15 11:38:03.917253 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:03.917220    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:38:03.917333 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:03.917290    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:38:03.917333 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:03.917316    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:38:04.330253 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:04.330176    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8" event={"ID":"981d2e3c-8232-4a0f-bcf3-c13ad35d2007","Type":"ContainerStarted","Data":"9e3a819e244601eccab364d9b8528d3f2ea5aa924e1d5e3ed8930b23f9e7e075"}
Sep 15 11:38:04.330745 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:04.330255    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8" event={"ID":"981d2e3c-8232-4a0f-bcf3-c13ad35d2007","Type":"ContainerStarted","Data":"da2b2140f02647e88ff89b089da4002c9d141a8c8170e8d869ea4106b6e8708a"}
Sep 15 11:38:04.361762 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:04.361688    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8" podStartSLOduration=1.361642068 podStartE2EDuration="1.361642068s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:04.36003986 +0000 UTC m=+754.786370458" watchObservedRunningTime="2026-09-15 11:38:04.361642068 +0000 UTC m=+754.787972666"
Sep 15 11:38:04.628692 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:04.628547    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"
Sep 15 11:38:04.633878 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:04.633848    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"
Sep 15 11:38:05.336593 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:05.336562    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"
Sep 15 11:38:05.337625 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:05.337598    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"
Sep 15 11:38:10.659514 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:10.659475    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-6e996c-95fc4785d-5dt6z"]
Sep 15 11:38:10.663466 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:10.663437    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-6e996c-95fc4785d-5dt6z"
Sep 15 11:38:10.666016 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:10.665990    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-6e996c\""
Sep 15 11:38:10.687762 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:10.687728    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-6e996c-95fc4785d-5dt6z"]
Sep 15 11:38:10.747222 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:10.747189    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/594ad813-675e-4fdb-a380-dba18fb562ca-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-6e996c-95fc4785d-5dt6z\" (UID: \"594ad813-675e-4fdb-a380-dba18fb562ca\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-6e996c-95fc4785d-5dt6z"
Sep 15 11:38:10.747222 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:10.747222    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdzx5\" (UniqueName: \"kubernetes.io/projected/594ad813-675e-4fdb-a380-dba18fb562ca-kube-api-access-gdzx5\") pod \"payload-pre-processing-e2e-worker-w0-6e996c-95fc4785d-5dt6z\" (UID: \"594ad813-675e-4fdb-a380-dba18fb562ca\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-6e996c-95fc4785d-5dt6z"
Sep 15 11:38:10.848063 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:10.848024    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/594ad813-675e-4fdb-a380-dba18fb562ca-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-6e996c-95fc4785d-5dt6z\" (UID: \"594ad813-675e-4fdb-a380-dba18fb562ca\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-6e996c-95fc4785d-5dt6z"
Sep 15 11:38:10.848063 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:10.848066    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdzx5\" (UniqueName: \"kubernetes.io/projected/594ad813-675e-4fdb-a380-dba18fb562ca-kube-api-access-gdzx5\") pod \"payload-pre-processing-e2e-worker-w0-6e996c-95fc4785d-5dt6z\" (UID: \"594ad813-675e-4fdb-a380-dba18fb562ca\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-6e996c-95fc4785d-5dt6z"
Sep 15 11:38:10.848885 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:10.848864    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/594ad813-675e-4fdb-a380-dba18fb562ca-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-6e996c-95fc4785d-5dt6z\" (UID: \"594ad813-675e-4fdb-a380-dba18fb562ca\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-6e996c-95fc4785d-5dt6z"
Sep 15 11:38:10.856741 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:10.856718    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdzx5\" (UniqueName: \"kubernetes.io/projected/594ad813-675e-4fdb-a380-dba18fb562ca-kube-api-access-gdzx5\") pod \"payload-pre-processing-e2e-worker-w0-6e996c-95fc4785d-5dt6z\" (UID: \"594ad813-675e-4fdb-a380-dba18fb562ca\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-6e996c-95fc4785d-5dt6z"
Sep 15 11:38:10.975162 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:10.975054    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-6e996c-95fc4785d-5dt6z"
Sep 15 11:38:11.044090 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.044035    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8fbdd-86cb944585-8cn2b"]
Sep 15 11:38:11.049160 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.049132    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8fbdd-86cb944585-8cn2b"
Sep 15 11:38:11.052075 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.051700    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-b8fbdd-serving-cert\""
Sep 15 11:38:11.052075 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.051765    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-bjt69\""
Sep 15 11:38:11.052075 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.051764    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 11:38:11.052075 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.051823    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 11:38:11.052417 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.052208    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 15 11:38:11.061540 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.061232    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8fbdd-86cb944585-8cn2b"]
Sep 15 11:38:11.150665 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.150627    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24f4cf43-5dd9-4a3d-bf08-882f2940bec1-metrics-certs\") pod \"maas-api-e2e-worker-w4-b8fbdd-86cb944585-8cn2b\" (UID: \"24f4cf43-5dd9-4a3d-bf08-882f2940bec1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8fbdd-86cb944585-8cn2b"
Sep 15 11:38:11.150853 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.150737    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24f4cf43-5dd9-4a3d-bf08-882f2940bec1-maas-api-tls\") pod \"maas-api-e2e-worker-w4-b8fbdd-86cb944585-8cn2b\" (UID: \"24f4cf43-5dd9-4a3d-bf08-882f2940bec1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8fbdd-86cb944585-8cn2b"
Sep 15 11:38:11.150853 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.150807    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24f4cf43-5dd9-4a3d-bf08-882f2940bec1-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-b8fbdd-86cb944585-8cn2b\" (UID: \"24f4cf43-5dd9-4a3d-bf08-882f2940bec1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8fbdd-86cb944585-8cn2b"
Sep 15 11:38:11.150853 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.150851    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvlvd\" (UniqueName: \"kubernetes.io/projected/24f4cf43-5dd9-4a3d-bf08-882f2940bec1-kube-api-access-dvlvd\") pod \"maas-api-e2e-worker-w4-b8fbdd-86cb944585-8cn2b\" (UID: \"24f4cf43-5dd9-4a3d-bf08-882f2940bec1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8fbdd-86cb944585-8cn2b"
Sep 15 11:38:11.253590 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.252432    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvlvd\" (UniqueName: \"kubernetes.io/projected/24f4cf43-5dd9-4a3d-bf08-882f2940bec1-kube-api-access-dvlvd\") pod \"maas-api-e2e-worker-w4-b8fbdd-86cb944585-8cn2b\" (UID: \"24f4cf43-5dd9-4a3d-bf08-882f2940bec1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8fbdd-86cb944585-8cn2b"
Sep 15 11:38:11.253590 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.252593    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24f4cf43-5dd9-4a3d-bf08-882f2940bec1-metrics-certs\") pod \"maas-api-e2e-worker-w4-b8fbdd-86cb944585-8cn2b\" (UID: \"24f4cf43-5dd9-4a3d-bf08-882f2940bec1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8fbdd-86cb944585-8cn2b"
Sep 15 11:38:11.253590 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.252714    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24f4cf43-5dd9-4a3d-bf08-882f2940bec1-maas-api-tls\") pod \"maas-api-e2e-worker-w4-b8fbdd-86cb944585-8cn2b\" (UID: \"24f4cf43-5dd9-4a3d-bf08-882f2940bec1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8fbdd-86cb944585-8cn2b"
Sep 15 11:38:11.253590 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.252810    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24f4cf43-5dd9-4a3d-bf08-882f2940bec1-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-b8fbdd-86cb944585-8cn2b\" (UID: \"24f4cf43-5dd9-4a3d-bf08-882f2940bec1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8fbdd-86cb944585-8cn2b"
Sep 15 11:38:11.254005 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.253979    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24f4cf43-5dd9-4a3d-bf08-882f2940bec1-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-b8fbdd-86cb944585-8cn2b\" (UID: \"24f4cf43-5dd9-4a3d-bf08-882f2940bec1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8fbdd-86cb944585-8cn2b"
Sep 15 11:38:11.254425 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.254395    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-6e996c-95fc4785d-5dt6z"]
Sep 15 11:38:11.257818 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.257059    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24f4cf43-5dd9-4a3d-bf08-882f2940bec1-maas-api-tls\") pod \"maas-api-e2e-worker-w4-b8fbdd-86cb944585-8cn2b\" (UID: \"24f4cf43-5dd9-4a3d-bf08-882f2940bec1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8fbdd-86cb944585-8cn2b"
Sep 15 11:38:11.258494 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.258439    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24f4cf43-5dd9-4a3d-bf08-882f2940bec1-metrics-certs\") pod \"maas-api-e2e-worker-w4-b8fbdd-86cb944585-8cn2b\" (UID: \"24f4cf43-5dd9-4a3d-bf08-882f2940bec1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8fbdd-86cb944585-8cn2b"
Sep 15 11:38:11.262427 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.262077    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvlvd\" (UniqueName: \"kubernetes.io/projected/24f4cf43-5dd9-4a3d-bf08-882f2940bec1-kube-api-access-dvlvd\") pod \"maas-api-e2e-worker-w4-b8fbdd-86cb944585-8cn2b\" (UID: \"24f4cf43-5dd9-4a3d-bf08-882f2940bec1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8fbdd-86cb944585-8cn2b"
Sep 15 11:38:11.366599 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.366564    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8fbdd-86cb944585-8cn2b"
Sep 15 11:38:11.374451 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.374406    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-6e996c-95fc4785d-5dt6z" event={"ID":"594ad813-675e-4fdb-a380-dba18fb562ca","Type":"ContainerStarted","Data":"35313b315335f1c1d2c3bf216eea425d4712a1e14c7e84cd76a903026090ae94"}
Sep 15 11:38:11.374615 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.374474    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-6e996c-95fc4785d-5dt6z"
Sep 15 11:38:11.374615 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.374497    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-6e996c-95fc4785d-5dt6z" event={"ID":"594ad813-675e-4fdb-a380-dba18fb562ca","Type":"ContainerStarted","Data":"d7b2be65548be9034399953d8c7b235bab6e0f4cbb666c76e9f226e176ed9d7e"}
Sep 15 11:38:11.393256 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.393193    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-6e996c-95fc4785d-5dt6z" podStartSLOduration=1.393172699 podStartE2EDuration="1.393172699s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:11.392099546 +0000 UTC m=+761.818430141" watchObservedRunningTime="2026-09-15 11:38:11.393172699 +0000 UTC m=+761.819503296"
Sep 15 11:38:11.587785 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.587746    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"]
Sep 15 11:38:11.592617 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.592583    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"
Sep 15 11:38:11.595649 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.595618    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-4d6dbb-openshift-default-dockercfg-pw2v5\""
Sep 15 11:38:11.625897 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.625842    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"]
Sep 15 11:38:11.662600 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.662573    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8fbdd-86cb944585-8cn2b"]
Sep 15 11:38:11.664069 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:38:11.664042    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24f4cf43_5dd9_4a3d_bf08_882f2940bec1.slice/crio-fc88f290df2844085629f915e7bcfa6d2d3da9b6e049688a6a4dd54468c389f2 WatchSource:0}: Error finding container fc88f290df2844085629f915e7bcfa6d2d3da9b6e049688a6a4dd54468c389f2: Status 404 returned error can't find the container with id fc88f290df2844085629f915e7bcfa6d2d3da9b6e049688a6a4dd54468c389f2
Sep 15 11:38:11.758205 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.758166    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-istio-data\") pod \"e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96\" (UID: \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\") " pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"
Sep 15 11:38:11.758370 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.758218    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-credential-socket\") pod \"e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96\" (UID: \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\") " pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"
Sep 15 11:38:11.758370 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.758307    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-istiod-ca-cert\") pod \"e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96\" (UID: \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\") " pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"
Sep 15 11:38:11.758475 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.758409    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-istio-envoy\") pod \"e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96\" (UID: \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\") " pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"
Sep 15 11:38:11.758475 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.758445    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwn7h\" (UniqueName: \"kubernetes.io/projected/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-kube-api-access-bwn7h\") pod \"e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96\" (UID: \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\") " pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"
Sep 15 11:38:11.758554 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.758474    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-workload-socket\") pod \"e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96\" (UID: \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\") " pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"
Sep 15 11:38:11.758554 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.758494    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-workload-certs\") pod \"e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96\" (UID: \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\") " pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"
Sep 15 11:38:11.758554 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.758528    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-istio-token\") pod \"e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96\" (UID: \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\") " pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"
Sep 15 11:38:11.758693 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.758597    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-istio-podinfo\") pod \"e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96\" (UID: \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\") " pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"
Sep 15 11:38:11.859505 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.859400    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-istiod-ca-cert\") pod \"e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96\" (UID: \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\") " pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"
Sep 15 11:38:11.859505 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.859499    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-istio-envoy\") pod \"e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96\" (UID: \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\") " pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"
Sep 15 11:38:11.859762 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.859534    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwn7h\" (UniqueName: \"kubernetes.io/projected/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-kube-api-access-bwn7h\") pod \"e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96\" (UID: \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\") " pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"
Sep 15 11:38:11.859762 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.859565    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-workload-socket\") pod \"e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96\" (UID: \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\") " pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"
Sep 15 11:38:11.859762 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.859590    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-workload-certs\") pod \"e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96\" (UID: \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\") " pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"
Sep 15 11:38:11.859762 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.859636    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-istio-token\") pod \"e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96\" (UID: \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\") " pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"
Sep 15 11:38:11.859989 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.859818    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-istio-podinfo\") pod \"e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96\" (UID: \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\") " pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"
Sep 15 11:38:11.859989 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.859891    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-istio-data\") pod \"e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96\" (UID: \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\") " pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"
Sep 15 11:38:11.859989 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.859929    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-credential-socket\") pod \"e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96\" (UID: \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\") " pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"
Sep 15 11:38:11.859989 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.859954    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-workload-socket\") pod \"e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96\" (UID: \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\") " pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"
Sep 15 11:38:11.860271 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.860245    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-istiod-ca-cert\") pod \"e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96\" (UID: \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\") " pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"
Sep 15 11:38:11.860362 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.860287    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-istio-data\") pod \"e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96\" (UID: \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\") " pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"
Sep 15 11:38:11.860412 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.860369    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-workload-certs\") pod \"e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96\" (UID: \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\") " pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"
Sep 15 11:38:11.860471 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.860438    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-credential-socket\") pod \"e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96\" (UID: \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\") " pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"
Sep 15 11:38:11.862081 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.862047    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-istio-envoy\") pod \"e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96\" (UID: \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\") " pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"
Sep 15 11:38:11.862236 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.862219    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-istio-podinfo\") pod \"e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96\" (UID: \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\") " pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"
Sep 15 11:38:11.874245 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.874211    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-istio-token\") pod \"e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96\" (UID: \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\") " pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"
Sep 15 11:38:11.874428 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.874410    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwn7h\" (UniqueName: \"kubernetes.io/projected/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-kube-api-access-bwn7h\") pod \"e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96\" (UID: \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\") " pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"
Sep 15 11:38:11.906709 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:11.906666    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"
Sep 15 11:38:12.200523 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:12.200425    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"]
Sep 15 11:38:12.202047 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:38:12.202012    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podceb86645_1f0a_47e6_b9c0_f14e350d3ada.slice/crio-087097f320e2bb37608bbcfff686baf705d0b5e0745229c08aa60075591c71ed WatchSource:0}: Error finding container 087097f320e2bb37608bbcfff686baf705d0b5e0745229c08aa60075591c71ed: Status 404 returned error can't find the container with id 087097f320e2bb37608bbcfff686baf705d0b5e0745229c08aa60075591c71ed
Sep 15 11:38:12.205103 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:12.205058    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:38:12.205218 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:12.205163    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:38:12.205218 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:12.205210    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:38:12.388116 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:12.388008    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8fbdd-86cb944585-8cn2b" event={"ID":"24f4cf43-5dd9-4a3d-bf08-882f2940bec1","Type":"ContainerStarted","Data":"fc88f290df2844085629f915e7bcfa6d2d3da9b6e049688a6a4dd54468c389f2"}
Sep 15 11:38:12.392016 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:12.391875    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96" event={"ID":"ceb86645-1f0a-47e6-b9c0-f14e350d3ada","Type":"ContainerStarted","Data":"d019031e4e4a452ca6215fe29466372760f71aec095f3db0e942ef4b8d24a96b"}
Sep 15 11:38:12.392016 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:12.391943    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96" event={"ID":"ceb86645-1f0a-47e6-b9c0-f14e350d3ada","Type":"ContainerStarted","Data":"087097f320e2bb37608bbcfff686baf705d0b5e0745229c08aa60075591c71ed"}
Sep 15 11:38:12.415766 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:12.414631    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96" podStartSLOduration=1.414609132 podStartE2EDuration="1.414609132s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:12.413452212 +0000 UTC m=+762.839782809" watchObservedRunningTime="2026-09-15 11:38:12.414609132 +0000 UTC m=+762.840939731"
Sep 15 11:38:12.907426 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:12.907380    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"
Sep 15 11:38:13.522577 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:13.522537    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"]
Sep 15 11:38:13.534110 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:13.534079    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"
Sep 15 11:38:13.537408 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:13.537377    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f193f9fb-openshift-default-dockercfg-flzz6\""
Sep 15 11:38:13.547926 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:13.547894    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"]
Sep 15 11:38:13.682353 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:13.682318    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e15d189-a921-45e1-8e03-004a66de6f89-istiod-ca-cert\") pod \"e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq\" (UID: \"6e15d189-a921-45e1-8e03-004a66de6f89\") " pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"
Sep 15 11:38:13.682353 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:13.682357    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e15d189-a921-45e1-8e03-004a66de6f89-istio-podinfo\") pod \"e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq\" (UID: \"6e15d189-a921-45e1-8e03-004a66de6f89\") " pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"
Sep 15 11:38:13.682589 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:13.682386    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e15d189-a921-45e1-8e03-004a66de6f89-workload-certs\") pod \"e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq\" (UID: \"6e15d189-a921-45e1-8e03-004a66de6f89\") " pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"
Sep 15 11:38:13.682589 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:13.682489    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e15d189-a921-45e1-8e03-004a66de6f89-istio-token\") pod \"e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq\" (UID: \"6e15d189-a921-45e1-8e03-004a66de6f89\") " pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"
Sep 15 11:38:13.682589 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:13.682539    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e15d189-a921-45e1-8e03-004a66de6f89-istio-envoy\") pod \"e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq\" (UID: \"6e15d189-a921-45e1-8e03-004a66de6f89\") " pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"
Sep 15 11:38:13.682589 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:13.682560    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e15d189-a921-45e1-8e03-004a66de6f89-workload-socket\") pod \"e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq\" (UID: \"6e15d189-a921-45e1-8e03-004a66de6f89\") " pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"
Sep 15 11:38:13.682589 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:13.682583    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e15d189-a921-45e1-8e03-004a66de6f89-istio-data\") pod \"e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq\" (UID: \"6e15d189-a921-45e1-8e03-004a66de6f89\") " pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"
Sep 15 11:38:13.682793 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:13.682709    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9pdj\" (UniqueName: \"kubernetes.io/projected/6e15d189-a921-45e1-8e03-004a66de6f89-kube-api-access-z9pdj\") pod \"e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq\" (UID: \"6e15d189-a921-45e1-8e03-004a66de6f89\") " pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"
Sep 15 11:38:13.682793 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:13.682731    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e15d189-a921-45e1-8e03-004a66de6f89-credential-socket\") pod \"e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq\" (UID: \"6e15d189-a921-45e1-8e03-004a66de6f89\") " pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"
Sep 15 11:38:13.784384 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:13.784285    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9pdj\" (UniqueName: \"kubernetes.io/projected/6e15d189-a921-45e1-8e03-004a66de6f89-kube-api-access-z9pdj\") pod \"e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq\" (UID: \"6e15d189-a921-45e1-8e03-004a66de6f89\") " pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"
Sep 15 11:38:13.784384 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:13.784324    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e15d189-a921-45e1-8e03-004a66de6f89-credential-socket\") pod \"e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq\" (UID: \"6e15d189-a921-45e1-8e03-004a66de6f89\") " pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"
Sep 15 11:38:13.784384 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:13.784372    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e15d189-a921-45e1-8e03-004a66de6f89-istiod-ca-cert\") pod \"e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq\" (UID: \"6e15d189-a921-45e1-8e03-004a66de6f89\") " pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"
Sep 15 11:38:13.784787 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:13.784392    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e15d189-a921-45e1-8e03-004a66de6f89-istio-podinfo\") pod \"e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq\" (UID: \"6e15d189-a921-45e1-8e03-004a66de6f89\") " pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"
Sep 15 11:38:13.784787 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:13.784413    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e15d189-a921-45e1-8e03-004a66de6f89-workload-certs\") pod \"e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq\" (UID: \"6e15d189-a921-45e1-8e03-004a66de6f89\") " pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"
Sep 15 11:38:13.784787 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:13.784490    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e15d189-a921-45e1-8e03-004a66de6f89-istio-token\") pod \"e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq\" (UID: \"6e15d189-a921-45e1-8e03-004a66de6f89\") " pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"
Sep 15 11:38:13.784787 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:13.784540    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e15d189-a921-45e1-8e03-004a66de6f89-istio-envoy\") pod \"e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq\" (UID: \"6e15d189-a921-45e1-8e03-004a66de6f89\") " pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"
Sep 15 11:38:13.784787 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:13.784567    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e15d189-a921-45e1-8e03-004a66de6f89-workload-socket\") pod \"e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq\" (UID: \"6e15d189-a921-45e1-8e03-004a66de6f89\") " pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"
Sep 15 11:38:13.784787 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:13.784594    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e15d189-a921-45e1-8e03-004a66de6f89-istio-data\") pod \"e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq\" (UID: \"6e15d189-a921-45e1-8e03-004a66de6f89\") " pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"
Sep 15 11:38:13.785113 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:13.784891    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e15d189-a921-45e1-8e03-004a66de6f89-workload-certs\") pod \"e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq\" (UID: \"6e15d189-a921-45e1-8e03-004a66de6f89\") " pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"
Sep 15 11:38:13.785113 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:13.785104    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e15d189-a921-45e1-8e03-004a66de6f89-credential-socket\") pod \"e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq\" (UID: \"6e15d189-a921-45e1-8e03-004a66de6f89\") " pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"
Sep 15 11:38:13.785232 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:13.785158    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e15d189-a921-45e1-8e03-004a66de6f89-workload-socket\") pod \"e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq\" (UID: \"6e15d189-a921-45e1-8e03-004a66de6f89\") " pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"
Sep 15 11:38:13.785297 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:13.785276    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e15d189-a921-45e1-8e03-004a66de6f89-istio-data\") pod \"e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq\" (UID: \"6e15d189-a921-45e1-8e03-004a66de6f89\") " pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"
Sep 15 11:38:13.785491 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:13.785461    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e15d189-a921-45e1-8e03-004a66de6f89-istiod-ca-cert\") pod \"e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq\" (UID: \"6e15d189-a921-45e1-8e03-004a66de6f89\") " pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"
Sep 15 11:38:13.787269 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:13.787246    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e15d189-a921-45e1-8e03-004a66de6f89-istio-envoy\") pod \"e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq\" (UID: \"6e15d189-a921-45e1-8e03-004a66de6f89\") " pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"
Sep 15 11:38:13.787466 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:13.787446    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e15d189-a921-45e1-8e03-004a66de6f89-istio-podinfo\") pod \"e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq\" (UID: \"6e15d189-a921-45e1-8e03-004a66de6f89\") " pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"
Sep 15 11:38:13.800297 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:13.800266    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9pdj\" (UniqueName: \"kubernetes.io/projected/6e15d189-a921-45e1-8e03-004a66de6f89-kube-api-access-z9pdj\") pod \"e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq\" (UID: \"6e15d189-a921-45e1-8e03-004a66de6f89\") " pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"
Sep 15 11:38:13.800454 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:13.800419    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e15d189-a921-45e1-8e03-004a66de6f89-istio-token\") pod \"e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq\" (UID: \"6e15d189-a921-45e1-8e03-004a66de6f89\") " pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"
Sep 15 11:38:13.850414 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:13.850370    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"
Sep 15 11:38:13.914644 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:13.914613    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"
Sep 15 11:38:14.409564 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:14.409451    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8fbdd-86cb944585-8cn2b" event={"ID":"24f4cf43-5dd9-4a3d-bf08-882f2940bec1","Type":"ContainerStarted","Data":"aafca81e2424eb95f0e24379847fbf2f781ebb8e726da68ce5b66bf3722690f5"}
Sep 15 11:38:14.409564 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:14.409549    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"
Sep 15 11:38:14.409875 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:14.409775    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8fbdd-86cb944585-8cn2b"
Sep 15 11:38:14.410953 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:14.410929    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"
Sep 15 11:38:14.445778 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:14.445748    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"]
Sep 15 11:38:14.447338 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:38:14.447309    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e15d189_a921_45e1_8e03_004a66de6f89.slice/crio-b1672259bd57fa5d908e4a986888fcd08c6a0e22cf236e7fd80d72a28f2b9573 WatchSource:0}: Error finding container b1672259bd57fa5d908e4a986888fcd08c6a0e22cf236e7fd80d72a28f2b9573: Status 404 returned error can't find the container with id b1672259bd57fa5d908e4a986888fcd08c6a0e22cf236e7fd80d72a28f2b9573
Sep 15 11:38:14.449736 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:14.449700    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:38:14.449836 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:14.449771    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:38:14.449836 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:14.449805    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:38:14.465601 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:14.465540    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8fbdd-86cb944585-8cn2b" podStartSLOduration=0.940543143 podStartE2EDuration="3.465514391s" totalImagesPullingTime="2.524971248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:14.462111912 +0000 UTC m=+764.888442513" watchObservedRunningTime="2026-09-15 11:38:14.465514391 +0000 UTC m=+764.891844990"
Sep 15 11:38:15.417057 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:15.417016    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq" event={"ID":"6e15d189-a921-45e1-8e03-004a66de6f89","Type":"ContainerStarted","Data":"5a560bf37651abf3748d5d5cf5f1301f2e9d089741c9328b2f8ce415e632b2d0"}
Sep 15 11:38:15.417563 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:15.417078    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq" event={"ID":"6e15d189-a921-45e1-8e03-004a66de6f89","Type":"ContainerStarted","Data":"b1672259bd57fa5d908e4a986888fcd08c6a0e22cf236e7fd80d72a28f2b9573"}
Sep 15 11:38:15.520469 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:15.520411    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq" podStartSLOduration=2.520392539 podStartE2EDuration="2.520392539s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:15.51816272 +0000 UTC m=+765.944493316" watchObservedRunningTime="2026-09-15 11:38:15.520392539 +0000 UTC m=+765.946723134"
Sep 15 11:38:15.851131 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:15.851093    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"
Sep 15 11:38:15.856664 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:15.856621    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"
Sep 15 11:38:16.425151 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:16.425117    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"
Sep 15 11:38:16.426144 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:16.426122    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"
Sep 15 11:38:20.429138 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:20.429104    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8fbdd-86cb944585-8cn2b"
Sep 15 11:38:21.701302 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:21.701261    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"]
Sep 15 11:38:21.705452 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:21.705431    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"
Sep 15 11:38:21.709441 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:21.709414    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-78522e-openshift-default-dockercfg-5t9hn\""
Sep 15 11:38:21.727680 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:21.722143    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"]
Sep 15 11:38:21.788090 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:21.788052    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e9272d5-231d-425b-b15a-5fe8b64dec7f-istio-token\") pod \"e2e-inf-b-78522e-openshift-default-6789554c58-h2795\" (UID: \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\") " pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"
Sep 15 11:38:21.788320 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:21.788098    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e9272d5-231d-425b-b15a-5fe8b64dec7f-credential-socket\") pod \"e2e-inf-b-78522e-openshift-default-6789554c58-h2795\" (UID: \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\") " pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"
Sep 15 11:38:21.788320 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:21.788163    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e9272d5-231d-425b-b15a-5fe8b64dec7f-istiod-ca-cert\") pod \"e2e-inf-b-78522e-openshift-default-6789554c58-h2795\" (UID: \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\") " pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"
Sep 15 11:38:21.788320 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:21.788216    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e9272d5-231d-425b-b15a-5fe8b64dec7f-istio-envoy\") pod \"e2e-inf-b-78522e-openshift-default-6789554c58-h2795\" (UID: \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\") " pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"
Sep 15 11:38:21.788320 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:21.788241    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e9272d5-231d-425b-b15a-5fe8b64dec7f-workload-socket\") pod \"e2e-inf-b-78522e-openshift-default-6789554c58-h2795\" (UID: \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\") " pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"
Sep 15 11:38:21.788320 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:21.788285    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e9272d5-231d-425b-b15a-5fe8b64dec7f-istio-podinfo\") pod \"e2e-inf-b-78522e-openshift-default-6789554c58-h2795\" (UID: \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\") " pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"
Sep 15 11:38:21.788320 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:21.788309    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw6vs\" (UniqueName: \"kubernetes.io/projected/4e9272d5-231d-425b-b15a-5fe8b64dec7f-kube-api-access-kw6vs\") pod \"e2e-inf-b-78522e-openshift-default-6789554c58-h2795\" (UID: \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\") " pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"
Sep 15 11:38:21.788543 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:21.788347    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e9272d5-231d-425b-b15a-5fe8b64dec7f-workload-certs\") pod \"e2e-inf-b-78522e-openshift-default-6789554c58-h2795\" (UID: \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\") " pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"
Sep 15 11:38:21.788543 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:21.788437    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e9272d5-231d-425b-b15a-5fe8b64dec7f-istio-data\") pod \"e2e-inf-b-78522e-openshift-default-6789554c58-h2795\" (UID: \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\") " pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"
Sep 15 11:38:21.890055 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:21.890017    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e9272d5-231d-425b-b15a-5fe8b64dec7f-istio-token\") pod \"e2e-inf-b-78522e-openshift-default-6789554c58-h2795\" (UID: \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\") " pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"
Sep 15 11:38:21.890243 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:21.890067    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e9272d5-231d-425b-b15a-5fe8b64dec7f-credential-socket\") pod \"e2e-inf-b-78522e-openshift-default-6789554c58-h2795\" (UID: \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\") " pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"
Sep 15 11:38:21.890243 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:21.890112    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e9272d5-231d-425b-b15a-5fe8b64dec7f-istiod-ca-cert\") pod \"e2e-inf-b-78522e-openshift-default-6789554c58-h2795\" (UID: \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\") " pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"
Sep 15 11:38:21.890243 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:21.890163    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e9272d5-231d-425b-b15a-5fe8b64dec7f-istio-envoy\") pod \"e2e-inf-b-78522e-openshift-default-6789554c58-h2795\" (UID: \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\") " pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"
Sep 15 11:38:21.890243 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:21.890189    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e9272d5-231d-425b-b15a-5fe8b64dec7f-workload-socket\") pod \"e2e-inf-b-78522e-openshift-default-6789554c58-h2795\" (UID: \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\") " pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"
Sep 15 11:38:21.890243 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:21.890236    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e9272d5-231d-425b-b15a-5fe8b64dec7f-istio-podinfo\") pod \"e2e-inf-b-78522e-openshift-default-6789554c58-h2795\" (UID: \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\") " pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"
Sep 15 11:38:21.890519 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:21.890259    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw6vs\" (UniqueName: \"kubernetes.io/projected/4e9272d5-231d-425b-b15a-5fe8b64dec7f-kube-api-access-kw6vs\") pod \"e2e-inf-b-78522e-openshift-default-6789554c58-h2795\" (UID: \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\") " pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"
Sep 15 11:38:21.890519 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:21.890304    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e9272d5-231d-425b-b15a-5fe8b64dec7f-workload-certs\") pod \"e2e-inf-b-78522e-openshift-default-6789554c58-h2795\" (UID: \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\") " pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"
Sep 15 11:38:21.890519 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:21.890360    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e9272d5-231d-425b-b15a-5fe8b64dec7f-istio-data\") pod \"e2e-inf-b-78522e-openshift-default-6789554c58-h2795\" (UID: \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\") " pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"
Sep 15 11:38:21.890722 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:21.890606    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e9272d5-231d-425b-b15a-5fe8b64dec7f-credential-socket\") pod \"e2e-inf-b-78522e-openshift-default-6789554c58-h2795\" (UID: \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\") " pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"
Sep 15 11:38:21.890792 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:21.890751    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e9272d5-231d-425b-b15a-5fe8b64dec7f-istio-data\") pod \"e2e-inf-b-78522e-openshift-default-6789554c58-h2795\" (UID: \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\") " pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"
Sep 15 11:38:21.890792 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:21.890762    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e9272d5-231d-425b-b15a-5fe8b64dec7f-workload-socket\") pod \"e2e-inf-b-78522e-openshift-default-6789554c58-h2795\" (UID: \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\") " pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"
Sep 15 11:38:21.890873 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:21.890856    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e9272d5-231d-425b-b15a-5fe8b64dec7f-workload-certs\") pod \"e2e-inf-b-78522e-openshift-default-6789554c58-h2795\" (UID: \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\") " pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"
Sep 15 11:38:21.890993 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:21.890975    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e9272d5-231d-425b-b15a-5fe8b64dec7f-istiod-ca-cert\") pod \"e2e-inf-b-78522e-openshift-default-6789554c58-h2795\" (UID: \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\") " pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"
Sep 15 11:38:21.892606 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:21.892583    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e9272d5-231d-425b-b15a-5fe8b64dec7f-istio-envoy\") pod \"e2e-inf-b-78522e-openshift-default-6789554c58-h2795\" (UID: \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\") " pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"
Sep 15 11:38:21.892896 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:21.892869    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e9272d5-231d-425b-b15a-5fe8b64dec7f-istio-podinfo\") pod \"e2e-inf-b-78522e-openshift-default-6789554c58-h2795\" (UID: \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\") " pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"
Sep 15 11:38:21.900207 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:21.900175    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e9272d5-231d-425b-b15a-5fe8b64dec7f-istio-token\") pod \"e2e-inf-b-78522e-openshift-default-6789554c58-h2795\" (UID: \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\") " pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"
Sep 15 11:38:21.900476 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:21.900457    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw6vs\" (UniqueName: \"kubernetes.io/projected/4e9272d5-231d-425b-b15a-5fe8b64dec7f-kube-api-access-kw6vs\") pod \"e2e-inf-b-78522e-openshift-default-6789554c58-h2795\" (UID: \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\") " pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"
Sep 15 11:38:22.016947 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:22.016840    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"
Sep 15 11:38:22.337817 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:22.337761    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"]
Sep 15 11:38:22.351783 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:22.351739    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:38:22.351894 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:22.351840    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:38:22.351894 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:22.351881    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:38:22.395715 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:22.394865    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-6e996c-95fc4785d-5dt6z"
Sep 15 11:38:22.485752 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:22.485699    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795" event={"ID":"4e9272d5-231d-425b-b15a-5fe8b64dec7f","Type":"ContainerStarted","Data":"d5684ce5b73cd69af2a2f8556eb0444388e86dbb45a207ed8121e4b0cfd430ec"}
Sep 15 11:38:22.485947 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:22.485770    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795" event={"ID":"4e9272d5-231d-425b-b15a-5fe8b64dec7f","Type":"ContainerStarted","Data":"3bcbd83cd9773722531679cb790fe326d52d6b55ad728cb1bd649d7f7725a924"}
Sep 15 11:38:22.506913 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:22.506843    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795" podStartSLOduration=1.5068248560000002 podStartE2EDuration="1.506824856s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:22.504890654 +0000 UTC m=+772.931221250" watchObservedRunningTime="2026-09-15 11:38:22.506824856 +0000 UTC m=+772.933155452"
Sep 15 11:38:23.017443 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:23.017338    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"
Sep 15 11:38:23.023316 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:23.023277    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"
Sep 15 11:38:23.493003 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:23.492955    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"
Sep 15 11:38:23.494139 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:23.494114    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"
Sep 15 11:38:26.517630 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:26.517500    2575 generic.go:356] "Generic (PLEG): container finished" podID="981d2e3c-8232-4a0f-bcf3-c13ad35d2007" containerID="9e3a819e244601eccab364d9b8528d3f2ea5aa924e1d5e3ed8930b23f9e7e075" exitCode=0
Sep 15 11:38:26.517630 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:26.517574    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8" event={"ID":"981d2e3c-8232-4a0f-bcf3-c13ad35d2007","Type":"ContainerDied","Data":"9e3a819e244601eccab364d9b8528d3f2ea5aa924e1d5e3ed8930b23f9e7e075"}
Sep 15 11:38:26.518277 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:26.518224    2575 scope.go:117] "RemoveContainer" containerID="9e3a819e244601eccab364d9b8528d3f2ea5aa924e1d5e3ed8930b23f9e7e075"
Sep 15 11:38:26.519579 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:26.519546    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:38:26.519696 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:26.519642    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:38:26.519744 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:26.519728    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:38:27.526510 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:27.526465    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8" event={"ID":"981d2e3c-8232-4a0f-bcf3-c13ad35d2007","Type":"ContainerStarted","Data":"b807b2e5f9b65fdf263120361fe73d73c33f31a0107f09d0ca216bcec736b618"}
Sep 15 11:38:27.628226 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:27.628184    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"
Sep 15 11:38:27.628440 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:27.628418    2575 patch_prober.go:28] interesting pod/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 15 11:38:27.628491 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:27.628471    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8" podUID="981d2e3c-8232-4a0f-bcf3-c13ad35d2007" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 15 11:38:28.628967 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:28.628921    2575 patch_prober.go:28] interesting pod/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 15 11:38:28.629577 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:28.629542    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8" podUID="981d2e3c-8232-4a0f-bcf3-c13ad35d2007" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 15 11:38:29.628829 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:29.628782    2575 patch_prober.go:28] interesting pod/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 15 11:38:29.629181 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:29.629145    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8" podUID="981d2e3c-8232-4a0f-bcf3-c13ad35d2007" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 15 11:38:30.628741 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:30.628697    2575 patch_prober.go:28] interesting pod/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 15 11:38:30.628956 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:30.628774    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8" podUID="981d2e3c-8232-4a0f-bcf3-c13ad35d2007" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 15 11:38:31.629686 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:31.629131    2575 patch_prober.go:28] interesting pod/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 15 11:38:31.629686 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:31.629202    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8" podUID="981d2e3c-8232-4a0f-bcf3-c13ad35d2007" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 15 11:38:32.628866 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:32.628816    2575 patch_prober.go:28] interesting pod/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 15 11:38:32.629111 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:32.628895    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8" podUID="981d2e3c-8232-4a0f-bcf3-c13ad35d2007" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 15 11:38:33.629468 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:33.629427    2575 patch_prober.go:28] interesting pod/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 15 11:38:33.630600 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:33.630155    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8" podUID="981d2e3c-8232-4a0f-bcf3-c13ad35d2007" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 15 11:38:34.651362 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:34.651318    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"
Sep 15 11:38:34.652891 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:34.652804    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"
Sep 15 11:38:34.660730 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:34.660616    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"
Sep 15 11:38:37.359980 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:37.359938    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f193f9fb-nnzg2"]
Sep 15 11:38:37.364691 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:37.364645    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f193f9fb-nnzg2"
Sep 15 11:38:37.367136 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:37.367105    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rbxjk\""
Sep 15 11:38:37.381103 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:37.381058    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f193f9fb-nnzg2"]
Sep 15 11:38:37.499626 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:37.499575    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ce16963-6238-45c9-bc4d-46efc2cd26e7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f193f9fb-nnzg2\" (UID: \"9ce16963-6238-45c9-bc4d-46efc2cd26e7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f193f9fb-nnzg2"
Sep 15 11:38:37.600628 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:37.600581    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ce16963-6238-45c9-bc4d-46efc2cd26e7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f193f9fb-nnzg2\" (UID: \"9ce16963-6238-45c9-bc4d-46efc2cd26e7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f193f9fb-nnzg2"
Sep 15 11:38:37.601251 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:37.601227    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ce16963-6238-45c9-bc4d-46efc2cd26e7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f193f9fb-nnzg2\" (UID: \"9ce16963-6238-45c9-bc4d-46efc2cd26e7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f193f9fb-nnzg2"
Sep 15 11:38:37.677730 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:37.677623    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f193f9fb-nnzg2"
Sep 15 11:38:37.970365 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:37.970321    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f193f9fb-nnzg2"]
Sep 15 11:38:37.970992 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:38:37.970955    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ce16963_6238_45c9_bc4d_46efc2cd26e7.slice/crio-fc1d3939558e38eb5790617bf4aad97fec7e1d134e8112b7d3b4ab39f694d7dd WatchSource:0}: Error finding container fc1d3939558e38eb5790617bf4aad97fec7e1d134e8112b7d3b4ab39f694d7dd: Status 404 returned error can't find the container with id fc1d3939558e38eb5790617bf4aad97fec7e1d134e8112b7d3b4ab39f694d7dd
Sep 15 11:38:38.634839 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:38.634801    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f193f9fb-nnzg2" event={"ID":"9ce16963-6238-45c9-bc4d-46efc2cd26e7","Type":"ContainerStarted","Data":"fc1d3939558e38eb5790617bf4aad97fec7e1d134e8112b7d3b4ab39f694d7dd"}
Sep 15 11:38:39.644218 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:39.644181    2575 generic.go:356] "Generic (PLEG): container finished" podID="6e15d189-a921-45e1-8e03-004a66de6f89" containerID="5a560bf37651abf3748d5d5cf5f1301f2e9d089741c9328b2f8ce415e632b2d0" exitCode=0
Sep 15 11:38:39.644782 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:39.644259    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq" event={"ID":"6e15d189-a921-45e1-8e03-004a66de6f89","Type":"ContainerDied","Data":"5a560bf37651abf3748d5d5cf5f1301f2e9d089741c9328b2f8ce415e632b2d0"}
Sep 15 11:38:39.644930 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:39.644907    2575 scope.go:117] "RemoveContainer" containerID="5a560bf37651abf3748d5d5cf5f1301f2e9d089741c9328b2f8ce415e632b2d0"
Sep 15 11:38:39.646912 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:39.646886    2575 generic.go:356] "Generic (PLEG): container finished" podID="ceb86645-1f0a-47e6-b9c0-f14e350d3ada" containerID="d019031e4e4a452ca6215fe29466372760f71aec095f3db0e942ef4b8d24a96b" exitCode=0
Sep 15 11:38:39.647043 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:39.646947    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96" event={"ID":"ceb86645-1f0a-47e6-b9c0-f14e350d3ada","Type":"ContainerDied","Data":"d019031e4e4a452ca6215fe29466372760f71aec095f3db0e942ef4b8d24a96b"}
Sep 15 11:38:39.647362 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:39.647345    2575 scope.go:117] "RemoveContainer" containerID="d019031e4e4a452ca6215fe29466372760f71aec095f3db0e942ef4b8d24a96b"
Sep 15 11:38:40.385757 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:40.385695    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:38:40.385941 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:40.385801    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:38:40.385941 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:40.385840    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:38:40.385941 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:40.385721    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:38:40.385941 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:40.385936    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:38:40.386099 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:40.386000    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:38:40.659509 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:40.659460    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96" event={"ID":"ceb86645-1f0a-47e6-b9c0-f14e350d3ada","Type":"ContainerStarted","Data":"2b12df40fb0f6abf42fabe4fa77a6a7889c2fc9e299c04a1786fd3b5668395fa"}
Sep 15 11:38:40.662584 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:40.662549    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq" event={"ID":"6e15d189-a921-45e1-8e03-004a66de6f89","Type":"ContainerStarted","Data":"36a9bb541645a35da2bf040ad68fc232c49b4d5652a8f55fd38e86e1cc4367ca"}
Sep 15 11:38:40.850934 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:40.850867    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"
Sep 15 11:38:40.906874 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:40.906788    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"
Sep 15 11:38:41.676332 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:41.676225    2575 generic.go:356] "Generic (PLEG): container finished" podID="9ce16963-6238-45c9-bc4d-46efc2cd26e7" containerID="119a729661b719cbe02f22f8ab582e15243ce227741e785b919c9a3cd2d45545" exitCode=0
Sep 15 11:38:41.676862 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:41.676561    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f193f9fb-nnzg2" event={"ID":"9ce16963-6238-45c9-bc4d-46efc2cd26e7","Type":"ContainerDied","Data":"119a729661b719cbe02f22f8ab582e15243ce227741e785b919c9a3cd2d45545"}
Sep 15 11:38:41.853408 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:41.853358    2575 patch_prober.go:28] interesting pod/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 15 11:38:41.853762 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:41.853729    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq" podUID="6e15d189-a921-45e1-8e03-004a66de6f89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 15 11:38:41.908690 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:41.908634    2575 patch_prober.go:28] interesting pod/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 15 11:38:41.908879 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:41.908729    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96" podUID="ceb86645-1f0a-47e6-b9c0-f14e350d3ada" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 15 11:38:42.559479 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:42.559438    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-b8fbdd/simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d"]
Sep 15 11:38:42.563849 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:42.563818    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-b8fbdd/simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d"
Sep 15 11:38:42.568634 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:42.568595    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-b8fbdd\"/\"simulator-w4-b8fbdd-kserve-self-signed-certs\""
Sep 15 11:38:42.568923 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:42.568899    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-b8fbdd\"/\"openshift-service-ca.crt\""
Sep 15 11:38:42.569172 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:42.569151    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-b8fbdd\"/\"kube-root-ca.crt\""
Sep 15 11:38:42.569405 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:42.569384    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-b8fbdd\"/\"default-dockercfg-62nm7\""
Sep 15 11:38:42.587475 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:42.587406    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-b8fbdd/simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d"]
Sep 15 11:38:42.664905 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:42.664363    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b85d5566-9d5e-4497-bf9e-3c847157c7ae-tls-certs\") pod \"simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d\" (UID: \"b85d5566-9d5e-4497-bf9e-3c847157c7ae\") " pod="e2e-models-e2e-worker-w4-b8fbdd/simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d"
Sep 15 11:38:42.664905 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:42.664464    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b85d5566-9d5e-4497-bf9e-3c847157c7ae-dshm\") pod \"simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d\" (UID: \"b85d5566-9d5e-4497-bf9e-3c847157c7ae\") " pod="e2e-models-e2e-worker-w4-b8fbdd/simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d"
Sep 15 11:38:42.664905 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:42.664525    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b85d5566-9d5e-4497-bf9e-3c847157c7ae-model-cache\") pod \"simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d\" (UID: \"b85d5566-9d5e-4497-bf9e-3c847157c7ae\") " pod="e2e-models-e2e-worker-w4-b8fbdd/simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d"
Sep 15 11:38:42.664905 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:42.664564    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b85d5566-9d5e-4497-bf9e-3c847157c7ae-tmp-dir\") pod \"simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d\" (UID: \"b85d5566-9d5e-4497-bf9e-3c847157c7ae\") " pod="e2e-models-e2e-worker-w4-b8fbdd/simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d"
Sep 15 11:38:42.664905 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:42.664623    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b85d5566-9d5e-4497-bf9e-3c847157c7ae-home\") pod \"simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d\" (UID: \"b85d5566-9d5e-4497-bf9e-3c847157c7ae\") " pod="e2e-models-e2e-worker-w4-b8fbdd/simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d"
Sep 15 11:38:42.664905 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:42.664728    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgs8d\" (UniqueName: \"kubernetes.io/projected/b85d5566-9d5e-4497-bf9e-3c847157c7ae-kube-api-access-mgs8d\") pod \"simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d\" (UID: \"b85d5566-9d5e-4497-bf9e-3c847157c7ae\") " pod="e2e-models-e2e-worker-w4-b8fbdd/simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d"
Sep 15 11:38:42.770396 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:42.770348    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b85d5566-9d5e-4497-bf9e-3c847157c7ae-model-cache\") pod \"simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d\" (UID: \"b85d5566-9d5e-4497-bf9e-3c847157c7ae\") " pod="e2e-models-e2e-worker-w4-b8fbdd/simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d"
Sep 15 11:38:42.771057 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:42.771025    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b85d5566-9d5e-4497-bf9e-3c847157c7ae-tmp-dir\") pod \"simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d\" (UID: \"b85d5566-9d5e-4497-bf9e-3c847157c7ae\") " pod="e2e-models-e2e-worker-w4-b8fbdd/simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d"
Sep 15 11:38:42.771250 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:42.771222    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b85d5566-9d5e-4497-bf9e-3c847157c7ae-home\") pod \"simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d\" (UID: \"b85d5566-9d5e-4497-bf9e-3c847157c7ae\") " pod="e2e-models-e2e-worker-w4-b8fbdd/simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d"
Sep 15 11:38:42.771432 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:42.771415    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgs8d\" (UniqueName: \"kubernetes.io/projected/b85d5566-9d5e-4497-bf9e-3c847157c7ae-kube-api-access-mgs8d\") pod \"simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d\" (UID: \"b85d5566-9d5e-4497-bf9e-3c847157c7ae\") " pod="e2e-models-e2e-worker-w4-b8fbdd/simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d"
Sep 15 11:38:42.771597 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:42.771582    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b85d5566-9d5e-4497-bf9e-3c847157c7ae-tls-certs\") pod \"simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d\" (UID: \"b85d5566-9d5e-4497-bf9e-3c847157c7ae\") " pod="e2e-models-e2e-worker-w4-b8fbdd/simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d"
Sep 15 11:38:42.771785 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:42.771767    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b85d5566-9d5e-4497-bf9e-3c847157c7ae-dshm\") pod \"simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d\" (UID: \"b85d5566-9d5e-4497-bf9e-3c847157c7ae\") " pod="e2e-models-e2e-worker-w4-b8fbdd/simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d"
Sep 15 11:38:42.772774 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:42.772738    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b85d5566-9d5e-4497-bf9e-3c847157c7ae-home\") pod \"simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d\" (UID: \"b85d5566-9d5e-4497-bf9e-3c847157c7ae\") " pod="e2e-models-e2e-worker-w4-b8fbdd/simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d"
Sep 15 11:38:42.773186 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:42.773165    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b85d5566-9d5e-4497-bf9e-3c847157c7ae-model-cache\") pod \"simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d\" (UID: \"b85d5566-9d5e-4497-bf9e-3c847157c7ae\") " pod="e2e-models-e2e-worker-w4-b8fbdd/simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d"
Sep 15 11:38:42.773566 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:42.773539    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b85d5566-9d5e-4497-bf9e-3c847157c7ae-tmp-dir\") pod \"simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d\" (UID: \"b85d5566-9d5e-4497-bf9e-3c847157c7ae\") " pod="e2e-models-e2e-worker-w4-b8fbdd/simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d"
Sep 15 11:38:42.782572 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:42.782429    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b85d5566-9d5e-4497-bf9e-3c847157c7ae-dshm\") pod \"simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d\" (UID: \"b85d5566-9d5e-4497-bf9e-3c847157c7ae\") " pod="e2e-models-e2e-worker-w4-b8fbdd/simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d"
Sep 15 11:38:42.782572 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:42.782535    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b85d5566-9d5e-4497-bf9e-3c847157c7ae-tls-certs\") pod \"simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d\" (UID: \"b85d5566-9d5e-4497-bf9e-3c847157c7ae\") " pod="e2e-models-e2e-worker-w4-b8fbdd/simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d"
Sep 15 11:38:42.788680 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:42.786348    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgs8d\" (UniqueName: \"kubernetes.io/projected/b85d5566-9d5e-4497-bf9e-3c847157c7ae-kube-api-access-mgs8d\") pod \"simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d\" (UID: \"b85d5566-9d5e-4497-bf9e-3c847157c7ae\") " pod="e2e-models-e2e-worker-w4-b8fbdd/simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d"
Sep 15 11:38:42.850912 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:42.850858    2575 patch_prober.go:28] interesting pod/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 15 11:38:42.851223 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:42.851173    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq" podUID="6e15d189-a921-45e1-8e03-004a66de6f89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 15 11:38:42.890683 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:42.886046    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-b8fbdd/simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d"
Sep 15 11:38:42.911042 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:42.910371    2575 patch_prober.go:28] interesting pod/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 15 11:38:42.911042 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:42.910466    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96" podUID="ceb86645-1f0a-47e6-b9c0-f14e350d3ada" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 15 11:38:43.135029 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:43.134445    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f193f9fb-nnzg2"
Sep 15 11:38:43.304686 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:43.302084    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ce16963-6238-45c9-bc4d-46efc2cd26e7-maas-api-service-ca\") pod \"9ce16963-6238-45c9-bc4d-46efc2cd26e7\" (UID: \"9ce16963-6238-45c9-bc4d-46efc2cd26e7\") "
Sep 15 11:38:43.304686 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:43.303040    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ce16963-6238-45c9-bc4d-46efc2cd26e7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9ce16963-6238-45c9-bc4d-46efc2cd26e7" (UID: "9ce16963-6238-45c9-bc4d-46efc2cd26e7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:38:43.405551 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:43.405439    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ce16963-6238-45c9-bc4d-46efc2cd26e7-maas-api-service-ca\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:38:43.474801 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:43.474748    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-b8fbdd/simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d"]
Sep 15 11:38:43.702170 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:43.702141    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f193f9fb-nnzg2"
Sep 15 11:38:43.702359 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:43.702134    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f193f9fb-nnzg2" event={"ID":"9ce16963-6238-45c9-bc4d-46efc2cd26e7","Type":"ContainerDied","Data":"fc1d3939558e38eb5790617bf4aad97fec7e1d134e8112b7d3b4ab39f694d7dd"}
Sep 15 11:38:43.702359 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:43.702313    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fc1d3939558e38eb5790617bf4aad97fec7e1d134e8112b7d3b4ab39f694d7dd"
Sep 15 11:38:43.705233 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:43.705198    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-b8fbdd/simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d" event={"ID":"b85d5566-9d5e-4497-bf9e-3c847157c7ae","Type":"ContainerStarted","Data":"7add0a32a50ab1cf718000322c50882ae1fc1caf058e97d0034b82237760d3a2"}
Sep 15 11:38:43.860298 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:43.859823    2575 patch_prober.go:28] interesting pod/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 15 11:38:43.860298 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:43.859892    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq" podUID="6e15d189-a921-45e1-8e03-004a66de6f89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 15 11:38:43.907247 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:43.907204    2575 patch_prober.go:28] interesting pod/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 15 11:38:43.907444 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:43.907266    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96" podUID="ceb86645-1f0a-47e6-b9c0-f14e350d3ada" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 15 11:38:44.409991 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:44.409951    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"
Sep 15 11:38:44.713929 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:44.713816    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-b8fbdd/simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d" event={"ID":"b85d5566-9d5e-4497-bf9e-3c847157c7ae","Type":"ContainerStarted","Data":"814bf556dd7f8f7f3ccb27ad85e02bb6b4fff499315ce9501ffde14c3497907e"}
Sep 15 11:38:44.735063 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:44.734988    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-b8fbdd/simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d" podStartSLOduration=2.734964737 podStartE2EDuration="2.734964737s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:44.732481871 +0000 UTC m=+795.158812480" watchObservedRunningTime="2026-09-15 11:38:44.734964737 +0000 UTC m=+795.161295334"
Sep 15 11:38:44.851132 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:44.851092    2575 patch_prober.go:28] interesting pod/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 15 11:38:44.851444 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:44.851409    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq" podUID="6e15d189-a921-45e1-8e03-004a66de6f89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 15 11:38:44.907591 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:44.907541    2575 patch_prober.go:28] interesting pod/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 15 11:38:44.908116 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:44.907847    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96" podUID="ceb86645-1f0a-47e6-b9c0-f14e350d3ada" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 15 11:38:45.852025 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:45.851972    2575 patch_prober.go:28] interesting pod/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 15 11:38:45.852263 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:45.852062    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq" podUID="6e15d189-a921-45e1-8e03-004a66de6f89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 15 11:38:45.908190 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:45.908150    2575 patch_prober.go:28] interesting pod/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 15 11:38:45.908579 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:45.908208    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96" podUID="ceb86645-1f0a-47e6-b9c0-f14e350d3ada" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 15 11:38:46.425845 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:46.425797    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"
Sep 15 11:38:46.851489 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:46.851432    2575 patch_prober.go:28] interesting pod/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 15 11:38:46.851744 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:46.851517    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq" podUID="6e15d189-a921-45e1-8e03-004a66de6f89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 15 11:38:46.907260 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:46.907216    2575 patch_prober.go:28] interesting pod/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 15 11:38:46.907430 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:46.907276    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96" podUID="ceb86645-1f0a-47e6-b9c0-f14e350d3ada" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 15 11:38:47.855929 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:47.855893    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"
Sep 15 11:38:47.857590 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:47.857557    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"
Sep 15 11:38:47.912126 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:47.912092    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"
Sep 15 11:38:47.913726 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:47.913647    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"
Sep 15 11:38:50.766485 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:50.766451    2575 generic.go:356] "Generic (PLEG): container finished" podID="4e9272d5-231d-425b-b15a-5fe8b64dec7f" containerID="d5684ce5b73cd69af2a2f8556eb0444388e86dbb45a207ed8121e4b0cfd430ec" exitCode=0
Sep 15 11:38:50.767008 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:50.766527    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795" event={"ID":"4e9272d5-231d-425b-b15a-5fe8b64dec7f","Type":"ContainerDied","Data":"d5684ce5b73cd69af2a2f8556eb0444388e86dbb45a207ed8121e4b0cfd430ec"}
Sep 15 11:38:50.767065 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:50.767017    2575 scope.go:117] "RemoveContainer" containerID="d5684ce5b73cd69af2a2f8556eb0444388e86dbb45a207ed8121e4b0cfd430ec"
Sep 15 11:38:50.768433 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:50.768404    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:38:50.768523 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:50.768489    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:38:50.768563 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:50.768521    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:38:51.494930 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:51.494889    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f193f9fb-nnzg2"]
Sep 15 11:38:51.498474 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:51.498442    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f193f9fb-nnzg2"]
Sep 15 11:38:51.648679 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:51.648607    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"]
Sep 15 11:38:51.654756 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:51.648890    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq" podUID="6e15d189-a921-45e1-8e03-004a66de6f89" containerName="istio-proxy" containerID="cri-o://36a9bb541645a35da2bf040ad68fc232c49b4d5652a8f55fd38e86e1cc4367ca" gracePeriod=30
Sep 15 11:38:51.780815 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:51.780648    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795" event={"ID":"4e9272d5-231d-425b-b15a-5fe8b64dec7f","Type":"ContainerStarted","Data":"0c650a23d3dc0b96b152ea8d88b299de29097c5e38c13c8529165af41d7e2d2b"}
Sep 15 11:38:52.017491 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:52.017402    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"
Sep 15 11:38:52.018858 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:52.018824    2575 patch_prober.go:28] interesting pod/e2e-inf-b-78522e-openshift-default-6789554c58-h2795 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 15 11:38:52.019000 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:52.018883    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795" podUID="4e9272d5-231d-425b-b15a-5fe8b64dec7f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 15 11:38:52.094053 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:52.094019    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ce16963-6238-45c9-bc4d-46efc2cd26e7" path="/var/lib/kubelet/pods/9ce16963-6238-45c9-bc4d-46efc2cd26e7/volumes"
Sep 15 11:38:52.889757 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:52.889690    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-b8fbdd/simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d"
Sep 15 11:38:52.889757 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:52.889755    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-b8fbdd/simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d"
Sep 15 11:38:52.903245 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:52.903205    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-b8fbdd/simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d"
Sep 15 11:38:53.018298 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:53.018254    2575 patch_prober.go:28] interesting pod/e2e-inf-b-78522e-openshift-default-6789554c58-h2795 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 15 11:38:53.018501 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:53.018324    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795" podUID="4e9272d5-231d-425b-b15a-5fe8b64dec7f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 15 11:38:53.493797 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:53.493754    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"
Sep 15 11:38:53.809049 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:53.808954    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-b8fbdd/simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d"
Sep 15 11:38:54.017849 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:54.017811    2575 patch_prober.go:28] interesting pod/e2e-inf-b-78522e-openshift-default-6789554c58-h2795 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 15 11:38:54.018234 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:54.017895    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795" podUID="4e9272d5-231d-425b-b15a-5fe8b64dec7f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 15 11:38:55.018128 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:55.018086    2575 patch_prober.go:28] interesting pod/e2e-inf-b-78522e-openshift-default-6789554c58-h2795 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 15 11:38:55.018537 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:55.018147    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795" podUID="4e9272d5-231d-425b-b15a-5fe8b64dec7f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 15 11:38:56.017609 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:56.017571    2575 patch_prober.go:28] interesting pod/e2e-inf-b-78522e-openshift-default-6789554c58-h2795 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 15 11:38:56.017802 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:56.017645    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795" podUID="4e9272d5-231d-425b-b15a-5fe8b64dec7f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 15 11:38:57.017528 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.017490    2575 patch_prober.go:28] interesting pod/e2e-inf-b-78522e-openshift-default-6789554c58-h2795 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 15 11:38:57.018000 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.017569    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795" podUID="4e9272d5-231d-425b-b15a-5fe8b64dec7f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 15 11:38:57.044994 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.044959    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"
Sep 15 11:38:57.079087 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.079056    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e15d189-a921-45e1-8e03-004a66de6f89-credential-socket\") pod \"6e15d189-a921-45e1-8e03-004a66de6f89\" (UID: \"6e15d189-a921-45e1-8e03-004a66de6f89\") "
Sep 15 11:38:57.079295 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.079114    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e15d189-a921-45e1-8e03-004a66de6f89-istio-token\") pod \"6e15d189-a921-45e1-8e03-004a66de6f89\" (UID: \"6e15d189-a921-45e1-8e03-004a66de6f89\") "
Sep 15 11:38:57.079295 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.079141    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e15d189-a921-45e1-8e03-004a66de6f89-istio-data\") pod \"6e15d189-a921-45e1-8e03-004a66de6f89\" (UID: \"6e15d189-a921-45e1-8e03-004a66de6f89\") "
Sep 15 11:38:57.079295 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.079165    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e15d189-a921-45e1-8e03-004a66de6f89-workload-certs\") pod \"6e15d189-a921-45e1-8e03-004a66de6f89\" (UID: \"6e15d189-a921-45e1-8e03-004a66de6f89\") "
Sep 15 11:38:57.079295 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.079223    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e15d189-a921-45e1-8e03-004a66de6f89-istio-podinfo\") pod \"6e15d189-a921-45e1-8e03-004a66de6f89\" (UID: \"6e15d189-a921-45e1-8e03-004a66de6f89\") "
Sep 15 11:38:57.079295 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.079259    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e15d189-a921-45e1-8e03-004a66de6f89-istiod-ca-cert\") pod \"6e15d189-a921-45e1-8e03-004a66de6f89\" (UID: \"6e15d189-a921-45e1-8e03-004a66de6f89\") "
Sep 15 11:38:57.079295 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.079285    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e15d189-a921-45e1-8e03-004a66de6f89-istio-envoy\") pod \"6e15d189-a921-45e1-8e03-004a66de6f89\" (UID: \"6e15d189-a921-45e1-8e03-004a66de6f89\") "
Sep 15 11:38:57.079706 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.079355    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9pdj\" (UniqueName: \"kubernetes.io/projected/6e15d189-a921-45e1-8e03-004a66de6f89-kube-api-access-z9pdj\") pod \"6e15d189-a921-45e1-8e03-004a66de6f89\" (UID: \"6e15d189-a921-45e1-8e03-004a66de6f89\") "
Sep 15 11:38:57.079706 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.079403    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e15d189-a921-45e1-8e03-004a66de6f89-workload-socket\") pod \"6e15d189-a921-45e1-8e03-004a66de6f89\" (UID: \"6e15d189-a921-45e1-8e03-004a66de6f89\") "
Sep 15 11:38:57.079706 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.079433    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e15d189-a921-45e1-8e03-004a66de6f89-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6e15d189-a921-45e1-8e03-004a66de6f89" (UID: "6e15d189-a921-45e1-8e03-004a66de6f89"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:38:57.079706 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.079628    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e15d189-a921-45e1-8e03-004a66de6f89-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6e15d189-a921-45e1-8e03-004a66de6f89" (UID: "6e15d189-a921-45e1-8e03-004a66de6f89"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:38:57.079948 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.079844    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e15d189-a921-45e1-8e03-004a66de6f89-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6e15d189-a921-45e1-8e03-004a66de6f89" (UID: "6e15d189-a921-45e1-8e03-004a66de6f89"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:38:57.080336 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.080054    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e15d189-a921-45e1-8e03-004a66de6f89-workload-socket\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:38:57.080336 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.080067    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e15d189-a921-45e1-8e03-004a66de6f89-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6e15d189-a921-45e1-8e03-004a66de6f89" (UID: "6e15d189-a921-45e1-8e03-004a66de6f89"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:38:57.080336 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.080085    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e15d189-a921-45e1-8e03-004a66de6f89-credential-socket\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:38:57.080336 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.080102    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e15d189-a921-45e1-8e03-004a66de6f89-workload-certs\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:38:57.080802 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.080770    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e15d189-a921-45e1-8e03-004a66de6f89-istio-data" (OuterVolumeSpecName: "istio-data") pod "6e15d189-a921-45e1-8e03-004a66de6f89" (UID: "6e15d189-a921-45e1-8e03-004a66de6f89"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:38:57.082271 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.082230    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e15d189-a921-45e1-8e03-004a66de6f89-istio-token" (OuterVolumeSpecName: "istio-token") pod "6e15d189-a921-45e1-8e03-004a66de6f89" (UID: "6e15d189-a921-45e1-8e03-004a66de6f89"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:38:57.082433 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.082300    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e15d189-a921-45e1-8e03-004a66de6f89-kube-api-access-z9pdj" (OuterVolumeSpecName: "kube-api-access-z9pdj") pod "6e15d189-a921-45e1-8e03-004a66de6f89" (UID: "6e15d189-a921-45e1-8e03-004a66de6f89"). InnerVolumeSpecName "kube-api-access-z9pdj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:38:57.082433 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.082389    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e15d189-a921-45e1-8e03-004a66de6f89-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6e15d189-a921-45e1-8e03-004a66de6f89" (UID: "6e15d189-a921-45e1-8e03-004a66de6f89"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:38:57.083520 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.083430    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6e15d189-a921-45e1-8e03-004a66de6f89-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6e15d189-a921-45e1-8e03-004a66de6f89" (UID: "6e15d189-a921-45e1-8e03-004a66de6f89"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 11:38:57.181165 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.181110    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e15d189-a921-45e1-8e03-004a66de6f89-istio-token\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:38:57.181165 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.181162    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e15d189-a921-45e1-8e03-004a66de6f89-istio-data\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:38:57.181165 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.181178    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e15d189-a921-45e1-8e03-004a66de6f89-istio-podinfo\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:38:57.181431 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.181192    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e15d189-a921-45e1-8e03-004a66de6f89-istiod-ca-cert\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:38:57.181431 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.181206    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e15d189-a921-45e1-8e03-004a66de6f89-istio-envoy\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:38:57.181431 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.181220    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9pdj\" (UniqueName: \"kubernetes.io/projected/6e15d189-a921-45e1-8e03-004a66de6f89-kube-api-access-z9pdj\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:38:57.683618 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.683580    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw"]
Sep 15 11:38:57.684068 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.684055    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e15d189-a921-45e1-8e03-004a66de6f89" containerName="istio-proxy"
Sep 15 11:38:57.684117 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.684070    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e15d189-a921-45e1-8e03-004a66de6f89" containerName="istio-proxy"
Sep 15 11:38:57.684117 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.684082    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ce16963-6238-45c9-bc4d-46efc2cd26e7" containerName="revoke-keys"
Sep 15 11:38:57.684117 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.684088    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ce16963-6238-45c9-bc4d-46efc2cd26e7" containerName="revoke-keys"
Sep 15 11:38:57.684117 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.684105    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e15d189-a921-45e1-8e03-004a66de6f89" containerName="istio-proxy"
Sep 15 11:38:57.684117 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.684110    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e15d189-a921-45e1-8e03-004a66de6f89" containerName="istio-proxy"
Sep 15 11:38:57.684270 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.684183    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e15d189-a921-45e1-8e03-004a66de6f89" containerName="istio-proxy"
Sep 15 11:38:57.684270 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.684190    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ce16963-6238-45c9-bc4d-46efc2cd26e7" containerName="revoke-keys"
Sep 15 11:38:57.684270 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.684198    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e15d189-a921-45e1-8e03-004a66de6f89" containerName="istio-proxy"
Sep 15 11:38:57.686746 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.686730    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw"
Sep 15 11:38:57.689498 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.689474    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-07a6c076-serving-cert\""
Sep 15 11:38:57.708761 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.708723    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw"]
Sep 15 11:38:57.788523 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.788480    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/927465c8-bcd3-4997-9c8b-ed09fef0b1d3-openshift-service-ca\") pod \"maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw\" (UID: \"927465c8-bcd3-4997-9c8b-ed09fef0b1d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw"
Sep 15 11:38:57.788787 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.788569    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcd8c\" (UniqueName: \"kubernetes.io/projected/927465c8-bcd3-4997-9c8b-ed09fef0b1d3-kube-api-access-vcd8c\") pod \"maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw\" (UID: \"927465c8-bcd3-4997-9c8b-ed09fef0b1d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw"
Sep 15 11:38:57.788787 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.788645    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/927465c8-bcd3-4997-9c8b-ed09fef0b1d3-maas-api-tls\") pod \"maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw\" (UID: \"927465c8-bcd3-4997-9c8b-ed09fef0b1d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw"
Sep 15 11:38:57.788787 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.788714    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/927465c8-bcd3-4997-9c8b-ed09fef0b1d3-metrics-certs\") pod \"maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw\" (UID: \"927465c8-bcd3-4997-9c8b-ed09fef0b1d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw"
Sep 15 11:38:57.826421 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.826384    2575 generic.go:356] "Generic (PLEG): container finished" podID="6e15d189-a921-45e1-8e03-004a66de6f89" containerID="36a9bb541645a35da2bf040ad68fc232c49b4d5652a8f55fd38e86e1cc4367ca" exitCode=0
Sep 15 11:38:57.826603 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.826429    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"
Sep 15 11:38:57.826603 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.826471    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq" event={"ID":"6e15d189-a921-45e1-8e03-004a66de6f89","Type":"ContainerDied","Data":"36a9bb541645a35da2bf040ad68fc232c49b4d5652a8f55fd38e86e1cc4367ca"}
Sep 15 11:38:57.826603 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.826528    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq" event={"ID":"6e15d189-a921-45e1-8e03-004a66de6f89","Type":"ContainerDied","Data":"b1672259bd57fa5d908e4a986888fcd08c6a0e22cf236e7fd80d72a28f2b9573"}
Sep 15 11:38:57.826603 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.826558    2575 scope.go:117] "RemoveContainer" containerID="36a9bb541645a35da2bf040ad68fc232c49b4d5652a8f55fd38e86e1cc4367ca"
Sep 15 11:38:57.837455 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.837433    2575 scope.go:117] "RemoveContainer" containerID="5a560bf37651abf3748d5d5cf5f1301f2e9d089741c9328b2f8ce415e632b2d0"
Sep 15 11:38:57.847604 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.847578    2575 scope.go:117] "RemoveContainer" containerID="36a9bb541645a35da2bf040ad68fc232c49b4d5652a8f55fd38e86e1cc4367ca"
Sep 15 11:38:57.848123 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:38:57.848093    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36a9bb541645a35da2bf040ad68fc232c49b4d5652a8f55fd38e86e1cc4367ca\": container with ID starting with 36a9bb541645a35da2bf040ad68fc232c49b4d5652a8f55fd38e86e1cc4367ca not found: ID does not exist" containerID="36a9bb541645a35da2bf040ad68fc232c49b4d5652a8f55fd38e86e1cc4367ca"
Sep 15 11:38:57.848380 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.848249    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36a9bb541645a35da2bf040ad68fc232c49b4d5652a8f55fd38e86e1cc4367ca"} err="failed to get container status \"36a9bb541645a35da2bf040ad68fc232c49b4d5652a8f55fd38e86e1cc4367ca\": rpc error: code = NotFound desc = could not find container \"36a9bb541645a35da2bf040ad68fc232c49b4d5652a8f55fd38e86e1cc4367ca\": container with ID starting with 36a9bb541645a35da2bf040ad68fc232c49b4d5652a8f55fd38e86e1cc4367ca not found: ID does not exist"
Sep 15 11:38:57.848380 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.848300    2575 scope.go:117] "RemoveContainer" containerID="5a560bf37651abf3748d5d5cf5f1301f2e9d089741c9328b2f8ce415e632b2d0"
Sep 15 11:38:57.848965 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:38:57.848935    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a560bf37651abf3748d5d5cf5f1301f2e9d089741c9328b2f8ce415e632b2d0\": container with ID starting with 5a560bf37651abf3748d5d5cf5f1301f2e9d089741c9328b2f8ce415e632b2d0 not found: ID does not exist" containerID="5a560bf37651abf3748d5d5cf5f1301f2e9d089741c9328b2f8ce415e632b2d0"
Sep 15 11:38:57.849067 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.848975    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a560bf37651abf3748d5d5cf5f1301f2e9d089741c9328b2f8ce415e632b2d0"} err="failed to get container status \"5a560bf37651abf3748d5d5cf5f1301f2e9d089741c9328b2f8ce415e632b2d0\": rpc error: code = NotFound desc = could not find container \"5a560bf37651abf3748d5d5cf5f1301f2e9d089741c9328b2f8ce415e632b2d0\": container with ID starting with 5a560bf37651abf3748d5d5cf5f1301f2e9d089741c9328b2f8ce415e632b2d0 not found: ID does not exist"
Sep 15 11:38:57.851112 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.851089    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"]
Sep 15 11:38:57.854103 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.854078    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq"]
Sep 15 11:38:57.890084 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.890047    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/927465c8-bcd3-4997-9c8b-ed09fef0b1d3-openshift-service-ca\") pod \"maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw\" (UID: \"927465c8-bcd3-4997-9c8b-ed09fef0b1d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw"
Sep 15 11:38:57.890250 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.890099    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcd8c\" (UniqueName: \"kubernetes.io/projected/927465c8-bcd3-4997-9c8b-ed09fef0b1d3-kube-api-access-vcd8c\") pod \"maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw\" (UID: \"927465c8-bcd3-4997-9c8b-ed09fef0b1d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw"
Sep 15 11:38:57.890250 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.890231    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/927465c8-bcd3-4997-9c8b-ed09fef0b1d3-maas-api-tls\") pod \"maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw\" (UID: \"927465c8-bcd3-4997-9c8b-ed09fef0b1d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw"
Sep 15 11:38:57.890395 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.890280    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/927465c8-bcd3-4997-9c8b-ed09fef0b1d3-metrics-certs\") pod \"maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw\" (UID: \"927465c8-bcd3-4997-9c8b-ed09fef0b1d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw"
Sep 15 11:38:57.890395 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:38:57.890372    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-07a6c076-serving-cert: secret "maas-api-e2e-migrate-07a6c076-serving-cert" not found
Sep 15 11:38:57.890496 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:38:57.890459    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/927465c8-bcd3-4997-9c8b-ed09fef0b1d3-maas-api-tls podName:927465c8-bcd3-4997-9c8b-ed09fef0b1d3 nodeName:}" failed. No retries permitted until 2026-09-15 11:38:58.390436648 +0000 UTC m=+808.816767222 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/927465c8-bcd3-4997-9c8b-ed09fef0b1d3-maas-api-tls") pod "maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw" (UID: "927465c8-bcd3-4997-9c8b-ed09fef0b1d3") : secret "maas-api-e2e-migrate-07a6c076-serving-cert" not found
Sep 15 11:38:57.890939 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.890916    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/927465c8-bcd3-4997-9c8b-ed09fef0b1d3-openshift-service-ca\") pod \"maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw\" (UID: \"927465c8-bcd3-4997-9c8b-ed09fef0b1d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw"
Sep 15 11:38:57.892742 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.892721    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/927465c8-bcd3-4997-9c8b-ed09fef0b1d3-metrics-certs\") pod \"maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw\" (UID: \"927465c8-bcd3-4997-9c8b-ed09fef0b1d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw"
Sep 15 11:38:57.901281 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:57.901248    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcd8c\" (UniqueName: \"kubernetes.io/projected/927465c8-bcd3-4997-9c8b-ed09fef0b1d3-kube-api-access-vcd8c\") pod \"maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw\" (UID: \"927465c8-bcd3-4997-9c8b-ed09fef0b1d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw"
Sep 15 11:38:58.023054 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:58.022966    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"
Sep 15 11:38:58.024145 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:58.024122    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"
Sep 15 11:38:58.096313 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:58.096270    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e15d189-a921-45e1-8e03-004a66de6f89" path="/var/lib/kubelet/pods/6e15d189-a921-45e1-8e03-004a66de6f89/volumes"
Sep 15 11:38:58.395977 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:58.395937    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/927465c8-bcd3-4997-9c8b-ed09fef0b1d3-maas-api-tls\") pod \"maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw\" (UID: \"927465c8-bcd3-4997-9c8b-ed09fef0b1d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw"
Sep 15 11:38:58.398746 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:58.398703    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/927465c8-bcd3-4997-9c8b-ed09fef0b1d3-maas-api-tls\") pod \"maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw\" (UID: \"927465c8-bcd3-4997-9c8b-ed09fef0b1d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw"
Sep 15 11:38:58.597898 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:58.597857    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw"
Sep 15 11:38:58.878136 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:58.878103    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw"]
Sep 15 11:38:58.879026 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:38:58.878994    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod927465c8_bcd3_4997_9c8b_ed09fef0b1d3.slice/crio-5f61494526cba8f7000aab6f8d4fb7ebfef36cca5c3c2d319e5dbc615a325b95 WatchSource:0}: Error finding container 5f61494526cba8f7000aab6f8d4fb7ebfef36cca5c3c2d319e5dbc615a325b95: Status 404 returned error can't find the container with id 5f61494526cba8f7000aab6f8d4fb7ebfef36cca5c3c2d319e5dbc615a325b95
Sep 15 11:38:59.842714 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:59.842588    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw" event={"ID":"927465c8-bcd3-4997-9c8b-ed09fef0b1d3","Type":"ContainerStarted","Data":"37a17dcbab218b38b2b1f8cca13ca33349739bdceaf1a9d23c9ca02c58a5e0e5"}
Sep 15 11:38:59.842714 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:59.842649    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw" event={"ID":"927465c8-bcd3-4997-9c8b-ed09fef0b1d3","Type":"ContainerStarted","Data":"5f61494526cba8f7000aab6f8d4fb7ebfef36cca5c3c2d319e5dbc615a325b95"}
Sep 15 11:38:59.843146 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:59.842720    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw"
Sep 15 11:38:59.865040 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:38:59.864959    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw" podStartSLOduration=2.170012501 podStartE2EDuration="2.864937378s" totalImagesPullingTime="694.924877ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:59.863433963 +0000 UTC m=+810.289764560" watchObservedRunningTime="2026-09-15 11:38:59.864937378 +0000 UTC m=+810.291267975"
Sep 15 11:39:05.854984 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:05.854952    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw"
Sep 15 11:39:20.498566 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:20.498521    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-07a6c076-c7chk"]
Sep 15 11:39:20.505880 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:20.505851    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-07a6c076-c7chk"
Sep 15 11:39:20.509436 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:20.509408    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rbxjk\""
Sep 15 11:39:20.523446 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:20.523408    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-07a6c076-c7chk"]
Sep 15 11:39:20.536998 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:20.536959    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9552c09b-27a3-4717-a69d-526eda41c0e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-07a6c076-c7chk\" (UID: \"9552c09b-27a3-4717-a69d-526eda41c0e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-07a6c076-c7chk"
Sep 15 11:39:20.637950 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:20.637905    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9552c09b-27a3-4717-a69d-526eda41c0e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-07a6c076-c7chk\" (UID: \"9552c09b-27a3-4717-a69d-526eda41c0e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-07a6c076-c7chk"
Sep 15 11:39:20.638538 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:20.638517    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9552c09b-27a3-4717-a69d-526eda41c0e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-07a6c076-c7chk\" (UID: \"9552c09b-27a3-4717-a69d-526eda41c0e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-07a6c076-c7chk"
Sep 15 11:39:20.816781 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:20.816650    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-07a6c076-c7chk"
Sep 15 11:39:21.093352 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:21.093311    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-07a6c076-c7chk"]
Sep 15 11:39:21.094557 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:39:21.094524    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9552c09b_27a3_4717_a69d_526eda41c0e6.slice/crio-3fa924fece728992428a9a17de62b351be13794b82d44efd0e847f5f0558906e WatchSource:0}: Error finding container 3fa924fece728992428a9a17de62b351be13794b82d44efd0e847f5f0558906e: Status 404 returned error can't find the container with id 3fa924fece728992428a9a17de62b351be13794b82d44efd0e847f5f0558906e
Sep 15 11:39:21.996696 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:21.996647    2575 generic.go:356] "Generic (PLEG): container finished" podID="9552c09b-27a3-4717-a69d-526eda41c0e6" containerID="846fb547e8649fa9ae6d45f48df93ca86ee25efa1413995ec30314df0f073227" exitCode=0
Sep 15 11:39:21.997092 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:21.996700    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-07a6c076-c7chk" event={"ID":"9552c09b-27a3-4717-a69d-526eda41c0e6","Type":"ContainerDied","Data":"846fb547e8649fa9ae6d45f48df93ca86ee25efa1413995ec30314df0f073227"}
Sep 15 11:39:21.997092 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:21.996767    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-07a6c076-c7chk" event={"ID":"9552c09b-27a3-4717-a69d-526eda41c0e6","Type":"ContainerStarted","Data":"3fa924fece728992428a9a17de62b351be13794b82d44efd0e847f5f0558906e"}
Sep 15 11:39:23.149524 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:23.149497    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-07a6c076-c7chk"
Sep 15 11:39:23.161506 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:23.161476    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9552c09b-27a3-4717-a69d-526eda41c0e6-maas-api-service-ca\") pod \"9552c09b-27a3-4717-a69d-526eda41c0e6\" (UID: \"9552c09b-27a3-4717-a69d-526eda41c0e6\") "
Sep 15 11:39:23.161962 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:23.161938    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9552c09b-27a3-4717-a69d-526eda41c0e6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9552c09b-27a3-4717-a69d-526eda41c0e6" (UID: "9552c09b-27a3-4717-a69d-526eda41c0e6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:39:23.162090 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:23.162072    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9552c09b-27a3-4717-a69d-526eda41c0e6-maas-api-service-ca\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:39:24.010549 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:24.010517    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-07a6c076-c7chk"
Sep 15 11:39:24.010789 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:24.010561    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-07a6c076-c7chk" event={"ID":"9552c09b-27a3-4717-a69d-526eda41c0e6","Type":"ContainerDied","Data":"3fa924fece728992428a9a17de62b351be13794b82d44efd0e847f5f0558906e"}
Sep 15 11:39:24.010789 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:24.010609    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3fa924fece728992428a9a17de62b351be13794b82d44efd0e847f5f0558906e"
Sep 15 11:39:26.859032 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:26.858992    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw"]
Sep 15 11:39:26.859539 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:26.859248    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw" podUID="927465c8-bcd3-4997-9c8b-ed09fef0b1d3" containerName="maas-api" containerID="cri-o://37a17dcbab218b38b2b1f8cca13ca33349739bdceaf1a9d23c9ca02c58a5e0e5" gracePeriod=30
Sep 15 11:39:27.030751 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:27.030703    2575 generic.go:356] "Generic (PLEG): container finished" podID="927465c8-bcd3-4997-9c8b-ed09fef0b1d3" containerID="37a17dcbab218b38b2b1f8cca13ca33349739bdceaf1a9d23c9ca02c58a5e0e5" exitCode=0
Sep 15 11:39:27.031107 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:27.031001    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw" event={"ID":"927465c8-bcd3-4997-9c8b-ed09fef0b1d3","Type":"ContainerDied","Data":"37a17dcbab218b38b2b1f8cca13ca33349739bdceaf1a9d23c9ca02c58a5e0e5"}
Sep 15 11:39:27.098888 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:27.098853    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-07a6c076-c7chk"]
Sep 15 11:39:27.105467 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:27.105436    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-07a6c076-c7chk"]
Sep 15 11:39:27.120439 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:27.120371    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw"
Sep 15 11:39:27.206538 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:27.206500    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcd8c\" (UniqueName: \"kubernetes.io/projected/927465c8-bcd3-4997-9c8b-ed09fef0b1d3-kube-api-access-vcd8c\") pod \"927465c8-bcd3-4997-9c8b-ed09fef0b1d3\" (UID: \"927465c8-bcd3-4997-9c8b-ed09fef0b1d3\") "
Sep 15 11:39:27.206767 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:27.206618    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/927465c8-bcd3-4997-9c8b-ed09fef0b1d3-metrics-certs\") pod \"927465c8-bcd3-4997-9c8b-ed09fef0b1d3\" (UID: \"927465c8-bcd3-4997-9c8b-ed09fef0b1d3\") "
Sep 15 11:39:27.206767 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:27.206682    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/927465c8-bcd3-4997-9c8b-ed09fef0b1d3-openshift-service-ca\") pod \"927465c8-bcd3-4997-9c8b-ed09fef0b1d3\" (UID: \"927465c8-bcd3-4997-9c8b-ed09fef0b1d3\") "
Sep 15 11:39:27.206862 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:27.206763    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/927465c8-bcd3-4997-9c8b-ed09fef0b1d3-maas-api-tls\") pod \"927465c8-bcd3-4997-9c8b-ed09fef0b1d3\" (UID: \"927465c8-bcd3-4997-9c8b-ed09fef0b1d3\") "
Sep 15 11:39:27.207936 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:27.207904    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/927465c8-bcd3-4997-9c8b-ed09fef0b1d3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "927465c8-bcd3-4997-9c8b-ed09fef0b1d3" (UID: "927465c8-bcd3-4997-9c8b-ed09fef0b1d3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:39:27.210898 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:27.210411    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/927465c8-bcd3-4997-9c8b-ed09fef0b1d3-kube-api-access-vcd8c" (OuterVolumeSpecName: "kube-api-access-vcd8c") pod "927465c8-bcd3-4997-9c8b-ed09fef0b1d3" (UID: "927465c8-bcd3-4997-9c8b-ed09fef0b1d3"). InnerVolumeSpecName "kube-api-access-vcd8c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:39:27.212564 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:27.212524    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/927465c8-bcd3-4997-9c8b-ed09fef0b1d3-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "927465c8-bcd3-4997-9c8b-ed09fef0b1d3" (UID: "927465c8-bcd3-4997-9c8b-ed09fef0b1d3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:39:27.212994 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:27.212950    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/927465c8-bcd3-4997-9c8b-ed09fef0b1d3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "927465c8-bcd3-4997-9c8b-ed09fef0b1d3" (UID: "927465c8-bcd3-4997-9c8b-ed09fef0b1d3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:39:27.308720 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:27.308677    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcd8c\" (UniqueName: \"kubernetes.io/projected/927465c8-bcd3-4997-9c8b-ed09fef0b1d3-kube-api-access-vcd8c\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:39:27.308720 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:27.308715    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/927465c8-bcd3-4997-9c8b-ed09fef0b1d3-metrics-certs\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:39:27.308720 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:27.308725    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/927465c8-bcd3-4997-9c8b-ed09fef0b1d3-openshift-service-ca\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:39:27.308720 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:27.308733    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/927465c8-bcd3-4997-9c8b-ed09fef0b1d3-maas-api-tls\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:39:28.041151 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:28.041117    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw"
Sep 15 11:39:28.041556 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:28.041144    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw" event={"ID":"927465c8-bcd3-4997-9c8b-ed09fef0b1d3","Type":"ContainerDied","Data":"5f61494526cba8f7000aab6f8d4fb7ebfef36cca5c3c2d319e5dbc615a325b95"}
Sep 15 11:39:28.041556 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:28.041216    2575 scope.go:117] "RemoveContainer" containerID="37a17dcbab218b38b2b1f8cca13ca33349739bdceaf1a9d23c9ca02c58a5e0e5"
Sep 15 11:39:28.070107 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:28.070066    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw"]
Sep 15 11:39:28.075868 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:28.075836    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-07a6c076-547c4dc5d4-qtqsw"]
Sep 15 11:39:28.094752 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:28.094713    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="927465c8-bcd3-4997-9c8b-ed09fef0b1d3" path="/var/lib/kubelet/pods/927465c8-bcd3-4997-9c8b-ed09fef0b1d3/volumes"
Sep 15 11:39:28.095195 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:28.095173    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9552c09b-27a3-4717-a69d-526eda41c0e6" path="/var/lib/kubelet/pods/9552c09b-27a3-4717-a69d-526eda41c0e6/volumes"
Sep 15 11:39:30.431520 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:30.431476    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-autores-4d6dbb/autores-model-4d6dbb-kserve-75f4445c99-2dnw7"]
Sep 15 11:39:30.432005 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:30.431989    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9552c09b-27a3-4717-a69d-526eda41c0e6" containerName="revoke-keys"
Sep 15 11:39:30.432050 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:30.432006    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9552c09b-27a3-4717-a69d-526eda41c0e6" containerName="revoke-keys"
Sep 15 11:39:30.432050 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:30.432039    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="927465c8-bcd3-4997-9c8b-ed09fef0b1d3" containerName="maas-api"
Sep 15 11:39:30.432050 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:30.432046    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="927465c8-bcd3-4997-9c8b-ed09fef0b1d3" containerName="maas-api"
Sep 15 11:39:30.432142 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:30.432115    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9552c09b-27a3-4717-a69d-526eda41c0e6" containerName="revoke-keys"
Sep 15 11:39:30.432142 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:30.432124    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="927465c8-bcd3-4997-9c8b-ed09fef0b1d3" containerName="maas-api"
Sep 15 11:39:30.436522 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:30.436501    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-4d6dbb/autores-model-4d6dbb-kserve-75f4445c99-2dnw7"
Sep 15 11:39:30.439942 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:30.439917    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-4d6dbb\"/\"autores-model-4d6dbb-kserve-self-signed-certs\""
Sep 15 11:39:30.440110 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:30.439916    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-4d6dbb\"/\"kube-root-ca.crt\""
Sep 15 11:39:30.440110 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:30.439918    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-4d6dbb\"/\"default-dockercfg-sbdrx\""
Sep 15 11:39:30.440328 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:30.440314    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-4d6dbb\"/\"openshift-service-ca.crt\""
Sep 15 11:39:30.446385 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:30.446359    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-4d6dbb/autores-model-4d6dbb-kserve-75f4445c99-2dnw7"]
Sep 15 11:39:30.547780 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:30.547741    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/412d72ba-13cf-4dac-9265-e75ad7509835-tls-certs\") pod \"autores-model-4d6dbb-kserve-75f4445c99-2dnw7\" (UID: \"412d72ba-13cf-4dac-9265-e75ad7509835\") " pod="ai-tenant-e2e-autores-4d6dbb/autores-model-4d6dbb-kserve-75f4445c99-2dnw7"
Sep 15 11:39:30.547780 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:30.547786    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz7lk\" (UniqueName: \"kubernetes.io/projected/412d72ba-13cf-4dac-9265-e75ad7509835-kube-api-access-tz7lk\") pod \"autores-model-4d6dbb-kserve-75f4445c99-2dnw7\" (UID: \"412d72ba-13cf-4dac-9265-e75ad7509835\") " pod="ai-tenant-e2e-autores-4d6dbb/autores-model-4d6dbb-kserve-75f4445c99-2dnw7"
Sep 15 11:39:30.548044 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:30.547858    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/412d72ba-13cf-4dac-9265-e75ad7509835-tmp-dir\") pod \"autores-model-4d6dbb-kserve-75f4445c99-2dnw7\" (UID: \"412d72ba-13cf-4dac-9265-e75ad7509835\") " pod="ai-tenant-e2e-autores-4d6dbb/autores-model-4d6dbb-kserve-75f4445c99-2dnw7"
Sep 15 11:39:30.548044 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:30.547916    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/412d72ba-13cf-4dac-9265-e75ad7509835-dshm\") pod \"autores-model-4d6dbb-kserve-75f4445c99-2dnw7\" (UID: \"412d72ba-13cf-4dac-9265-e75ad7509835\") " pod="ai-tenant-e2e-autores-4d6dbb/autores-model-4d6dbb-kserve-75f4445c99-2dnw7"
Sep 15 11:39:30.548044 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:30.547970    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/412d72ba-13cf-4dac-9265-e75ad7509835-model-cache\") pod \"autores-model-4d6dbb-kserve-75f4445c99-2dnw7\" (UID: \"412d72ba-13cf-4dac-9265-e75ad7509835\") " pod="ai-tenant-e2e-autores-4d6dbb/autores-model-4d6dbb-kserve-75f4445c99-2dnw7"
Sep 15 11:39:30.548044 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:30.547989    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/412d72ba-13cf-4dac-9265-e75ad7509835-home\") pod \"autores-model-4d6dbb-kserve-75f4445c99-2dnw7\" (UID: \"412d72ba-13cf-4dac-9265-e75ad7509835\") " pod="ai-tenant-e2e-autores-4d6dbb/autores-model-4d6dbb-kserve-75f4445c99-2dnw7"
Sep 15 11:39:30.649593 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:30.649550    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/412d72ba-13cf-4dac-9265-e75ad7509835-model-cache\") pod \"autores-model-4d6dbb-kserve-75f4445c99-2dnw7\" (UID: \"412d72ba-13cf-4dac-9265-e75ad7509835\") " pod="ai-tenant-e2e-autores-4d6dbb/autores-model-4d6dbb-kserve-75f4445c99-2dnw7"
Sep 15 11:39:30.649855 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:30.649600    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/412d72ba-13cf-4dac-9265-e75ad7509835-home\") pod \"autores-model-4d6dbb-kserve-75f4445c99-2dnw7\" (UID: \"412d72ba-13cf-4dac-9265-e75ad7509835\") " pod="ai-tenant-e2e-autores-4d6dbb/autores-model-4d6dbb-kserve-75f4445c99-2dnw7"
Sep 15 11:39:30.649855 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:30.649769    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/412d72ba-13cf-4dac-9265-e75ad7509835-tls-certs\") pod \"autores-model-4d6dbb-kserve-75f4445c99-2dnw7\" (UID: \"412d72ba-13cf-4dac-9265-e75ad7509835\") " pod="ai-tenant-e2e-autores-4d6dbb/autores-model-4d6dbb-kserve-75f4445c99-2dnw7"
Sep 15 11:39:30.649855 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:30.649809    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz7lk\" (UniqueName: \"kubernetes.io/projected/412d72ba-13cf-4dac-9265-e75ad7509835-kube-api-access-tz7lk\") pod \"autores-model-4d6dbb-kserve-75f4445c99-2dnw7\" (UID: \"412d72ba-13cf-4dac-9265-e75ad7509835\") " pod="ai-tenant-e2e-autores-4d6dbb/autores-model-4d6dbb-kserve-75f4445c99-2dnw7"
Sep 15 11:39:30.649855 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:30.649849    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/412d72ba-13cf-4dac-9265-e75ad7509835-tmp-dir\") pod \"autores-model-4d6dbb-kserve-75f4445c99-2dnw7\" (UID: \"412d72ba-13cf-4dac-9265-e75ad7509835\") " pod="ai-tenant-e2e-autores-4d6dbb/autores-model-4d6dbb-kserve-75f4445c99-2dnw7"
Sep 15 11:39:30.650079 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:30.649880    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/412d72ba-13cf-4dac-9265-e75ad7509835-dshm\") pod \"autores-model-4d6dbb-kserve-75f4445c99-2dnw7\" (UID: \"412d72ba-13cf-4dac-9265-e75ad7509835\") " pod="ai-tenant-e2e-autores-4d6dbb/autores-model-4d6dbb-kserve-75f4445c99-2dnw7"
Sep 15 11:39:30.650141 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:30.650075    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/412d72ba-13cf-4dac-9265-e75ad7509835-model-cache\") pod \"autores-model-4d6dbb-kserve-75f4445c99-2dnw7\" (UID: \"412d72ba-13cf-4dac-9265-e75ad7509835\") " pod="ai-tenant-e2e-autores-4d6dbb/autores-model-4d6dbb-kserve-75f4445c99-2dnw7"
Sep 15 11:39:30.650141 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:30.650108    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/412d72ba-13cf-4dac-9265-e75ad7509835-home\") pod \"autores-model-4d6dbb-kserve-75f4445c99-2dnw7\" (UID: \"412d72ba-13cf-4dac-9265-e75ad7509835\") " pod="ai-tenant-e2e-autores-4d6dbb/autores-model-4d6dbb-kserve-75f4445c99-2dnw7"
Sep 15 11:39:30.650327 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:30.650307    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/412d72ba-13cf-4dac-9265-e75ad7509835-tmp-dir\") pod \"autores-model-4d6dbb-kserve-75f4445c99-2dnw7\" (UID: \"412d72ba-13cf-4dac-9265-e75ad7509835\") " pod="ai-tenant-e2e-autores-4d6dbb/autores-model-4d6dbb-kserve-75f4445c99-2dnw7"
Sep 15 11:39:30.652818 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:30.652777    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/412d72ba-13cf-4dac-9265-e75ad7509835-dshm\") pod \"autores-model-4d6dbb-kserve-75f4445c99-2dnw7\" (UID: \"412d72ba-13cf-4dac-9265-e75ad7509835\") " pod="ai-tenant-e2e-autores-4d6dbb/autores-model-4d6dbb-kserve-75f4445c99-2dnw7"
Sep 15 11:39:30.653037 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:30.653016    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/412d72ba-13cf-4dac-9265-e75ad7509835-tls-certs\") pod \"autores-model-4d6dbb-kserve-75f4445c99-2dnw7\" (UID: \"412d72ba-13cf-4dac-9265-e75ad7509835\") " pod="ai-tenant-e2e-autores-4d6dbb/autores-model-4d6dbb-kserve-75f4445c99-2dnw7"
Sep 15 11:39:30.660508 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:30.660474    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz7lk\" (UniqueName: \"kubernetes.io/projected/412d72ba-13cf-4dac-9265-e75ad7509835-kube-api-access-tz7lk\") pod \"autores-model-4d6dbb-kserve-75f4445c99-2dnw7\" (UID: \"412d72ba-13cf-4dac-9265-e75ad7509835\") " pod="ai-tenant-e2e-autores-4d6dbb/autores-model-4d6dbb-kserve-75f4445c99-2dnw7"
Sep 15 11:39:30.748025 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:30.747922    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-4d6dbb/autores-model-4d6dbb-kserve-75f4445c99-2dnw7"
Sep 15 11:39:31.034194 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:31.034160    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-4d6dbb/autores-model-4d6dbb-kserve-75f4445c99-2dnw7"]
Sep 15 11:39:31.035974 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:39:31.035935    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod412d72ba_13cf_4dac_9265_e75ad7509835.slice/crio-9c38328ead978b0fbef883f4ce0a3659eaff633bca766ae9ab4d56722ccb91d4 WatchSource:0}: Error finding container 9c38328ead978b0fbef883f4ce0a3659eaff633bca766ae9ab4d56722ccb91d4: Status 404 returned error can't find the container with id 9c38328ead978b0fbef883f4ce0a3659eaff633bca766ae9ab4d56722ccb91d4
Sep 15 11:39:31.063099 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:31.063064    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-4d6dbb/autores-model-4d6dbb-kserve-75f4445c99-2dnw7" event={"ID":"412d72ba-13cf-4dac-9265-e75ad7509835","Type":"ContainerStarted","Data":"9c38328ead978b0fbef883f4ce0a3659eaff633bca766ae9ab4d56722ccb91d4"}
Sep 15 11:39:32.071907 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:32.071865    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-4d6dbb/autores-model-4d6dbb-kserve-75f4445c99-2dnw7" event={"ID":"412d72ba-13cf-4dac-9265-e75ad7509835","Type":"ContainerStarted","Data":"35d45e32f0321c43dc293155f152ce6a2c6badca6adbc8458c9133ae88a66db3"}
Sep 15 11:39:32.100385 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:32.100336    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-autores-4d6dbb/autores-model-4d6dbb-kserve-75f4445c99-2dnw7" podStartSLOduration=2.100318789 podStartE2EDuration="2.100318789s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:39:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:39:32.098870875 +0000 UTC m=+842.525201472" watchObservedRunningTime="2026-09-15 11:39:32.100318789 +0000 UTC m=+842.526649385"
Sep 15 11:39:32.767667 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:32.767616    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm"]
Sep 15 11:39:32.771524 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:32.771489    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm"
Sep 15 11:39:32.774322 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:32.774292    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-9b1cbda7-serving-cert\""
Sep 15 11:39:32.791936 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:32.791898    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm"]
Sep 15 11:39:32.876937 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:32.876300    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a2fe7ab-d6ba-4740-98d6-982e2d3734a3-openshift-service-ca\") pod \"maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm\" (UID: \"5a2fe7ab-d6ba-4740-98d6-982e2d3734a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm"
Sep 15 11:39:32.876937 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:32.876370    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a2fe7ab-d6ba-4740-98d6-982e2d3734a3-maas-api-tls\") pod \"maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm\" (UID: \"5a2fe7ab-d6ba-4740-98d6-982e2d3734a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm"
Sep 15 11:39:32.877212 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:32.876991    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7p8r\" (UniqueName: \"kubernetes.io/projected/5a2fe7ab-d6ba-4740-98d6-982e2d3734a3-kube-api-access-z7p8r\") pod \"maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm\" (UID: \"5a2fe7ab-d6ba-4740-98d6-982e2d3734a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm"
Sep 15 11:39:32.877212 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:32.877034    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a2fe7ab-d6ba-4740-98d6-982e2d3734a3-metrics-certs\") pod \"maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm\" (UID: \"5a2fe7ab-d6ba-4740-98d6-982e2d3734a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm"
Sep 15 11:39:32.978420 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:32.978373    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a2fe7ab-d6ba-4740-98d6-982e2d3734a3-maas-api-tls\") pod \"maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm\" (UID: \"5a2fe7ab-d6ba-4740-98d6-982e2d3734a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm"
Sep 15 11:39:32.978644 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:32.978493    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7p8r\" (UniqueName: \"kubernetes.io/projected/5a2fe7ab-d6ba-4740-98d6-982e2d3734a3-kube-api-access-z7p8r\") pod \"maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm\" (UID: \"5a2fe7ab-d6ba-4740-98d6-982e2d3734a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm"
Sep 15 11:39:32.978644 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:32.978519    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a2fe7ab-d6ba-4740-98d6-982e2d3734a3-metrics-certs\") pod \"maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm\" (UID: \"5a2fe7ab-d6ba-4740-98d6-982e2d3734a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm"
Sep 15 11:39:32.978644 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:39:32.978537    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-9b1cbda7-serving-cert: secret "maas-api-e2e-ait-9b1cbda7-serving-cert" not found
Sep 15 11:39:32.978644 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:32.978589    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a2fe7ab-d6ba-4740-98d6-982e2d3734a3-openshift-service-ca\") pod \"maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm\" (UID: \"5a2fe7ab-d6ba-4740-98d6-982e2d3734a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm"
Sep 15 11:39:32.978644 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:39:32.978608    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a2fe7ab-d6ba-4740-98d6-982e2d3734a3-maas-api-tls podName:5a2fe7ab-d6ba-4740-98d6-982e2d3734a3 nodeName:}" failed. No retries permitted until 2026-09-15 11:39:33.478589302 +0000 UTC m=+843.904919877 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5a2fe7ab-d6ba-4740-98d6-982e2d3734a3-maas-api-tls") pod "maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm" (UID: "5a2fe7ab-d6ba-4740-98d6-982e2d3734a3") : secret "maas-api-e2e-ait-9b1cbda7-serving-cert" not found
Sep 15 11:39:32.979308 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:32.979284    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a2fe7ab-d6ba-4740-98d6-982e2d3734a3-openshift-service-ca\") pod \"maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm\" (UID: \"5a2fe7ab-d6ba-4740-98d6-982e2d3734a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm"
Sep 15 11:39:32.981303 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:32.981262    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a2fe7ab-d6ba-4740-98d6-982e2d3734a3-metrics-certs\") pod \"maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm\" (UID: \"5a2fe7ab-d6ba-4740-98d6-982e2d3734a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm"
Sep 15 11:39:32.989575 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:32.989540    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7p8r\" (UniqueName: \"kubernetes.io/projected/5a2fe7ab-d6ba-4740-98d6-982e2d3734a3-kube-api-access-z7p8r\") pod \"maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm\" (UID: \"5a2fe7ab-d6ba-4740-98d6-982e2d3734a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm"
Sep 15 11:39:33.484307 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:33.484265    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a2fe7ab-d6ba-4740-98d6-982e2d3734a3-maas-api-tls\") pod \"maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm\" (UID: \"5a2fe7ab-d6ba-4740-98d6-982e2d3734a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm"
Sep 15 11:39:33.486925 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:33.486894    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a2fe7ab-d6ba-4740-98d6-982e2d3734a3-maas-api-tls\") pod \"maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm\" (UID: \"5a2fe7ab-d6ba-4740-98d6-982e2d3734a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm"
Sep 15 11:39:33.690830 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:33.690792    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm"
Sep 15 11:39:33.985685 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:33.985636    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm"]
Sep 15 11:39:33.986826 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:39:33.986793    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a2fe7ab_d6ba_4740_98d6_982e2d3734a3.slice/crio-362e24059ae0d7496a775526c0d7c9be626e82ae51396f8cb4b0293130241564 WatchSource:0}: Error finding container 362e24059ae0d7496a775526c0d7c9be626e82ae51396f8cb4b0293130241564: Status 404 returned error can't find the container with id 362e24059ae0d7496a775526c0d7c9be626e82ae51396f8cb4b0293130241564
Sep 15 11:39:34.094791 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:34.094753    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm" event={"ID":"5a2fe7ab-d6ba-4740-98d6-982e2d3734a3","Type":"ContainerStarted","Data":"362e24059ae0d7496a775526c0d7c9be626e82ae51396f8cb4b0293130241564"}
Sep 15 11:39:35.097169 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:35.097133    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm" event={"ID":"5a2fe7ab-d6ba-4740-98d6-982e2d3734a3","Type":"ContainerStarted","Data":"5d246225ae47734bcae4047abc67945521a3b2b5e251ce6539a31b634ef99549"}
Sep 15 11:39:35.097736 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:35.097219    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm"
Sep 15 11:39:35.118059 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:35.117990    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm" podStartSLOduration=2.537603874 podStartE2EDuration="3.117963575s" totalImagesPullingTime="580.359701ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:39:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:39:35.116585482 +0000 UTC m=+845.542916081" watchObservedRunningTime="2026-09-15 11:39:35.117963575 +0000 UTC m=+845.544294176"
Sep 15 11:39:40.748555 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:40.748515    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-autores-4d6dbb/autores-model-4d6dbb-kserve-75f4445c99-2dnw7"
Sep 15 11:39:40.749038 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:40.748764    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-autores-4d6dbb/autores-model-4d6dbb-kserve-75f4445c99-2dnw7"
Sep 15 11:39:40.762056 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:40.762024    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-autores-4d6dbb/autores-model-4d6dbb-kserve-75f4445c99-2dnw7"
Sep 15 11:39:41.109920 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:41.109891    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm"
Sep 15 11:39:41.156228 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:39:41.156190    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-autores-4d6dbb/autores-model-4d6dbb-kserve-75f4445c99-2dnw7"
Sep 15 11:40:02.257823 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:02.257788    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4d6dbb-bnfvt"]
Sep 15 11:40:02.261596 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:02.261578    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4d6dbb-bnfvt"
Sep 15 11:40:02.263599 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:02.263578    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rbxjk\""
Sep 15 11:40:02.270451 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:02.269991    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4d6dbb-bnfvt"]
Sep 15 11:40:02.289756 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:02.289709    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d687a379-8413-4f2f-b98e-4cfce890b61e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-4d6dbb-bnfvt\" (UID: \"d687a379-8413-4f2f-b98e-4cfce890b61e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4d6dbb-bnfvt"
Sep 15 11:40:02.390494 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:02.390451    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d687a379-8413-4f2f-b98e-4cfce890b61e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-4d6dbb-bnfvt\" (UID: \"d687a379-8413-4f2f-b98e-4cfce890b61e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4d6dbb-bnfvt"
Sep 15 11:40:02.391132 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:02.391113    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d687a379-8413-4f2f-b98e-4cfce890b61e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-4d6dbb-bnfvt\" (UID: \"d687a379-8413-4f2f-b98e-4cfce890b61e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4d6dbb-bnfvt"
Sep 15 11:40:02.574802 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:02.574759    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4d6dbb-bnfvt"
Sep 15 11:40:02.850301 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:02.850270    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4d6dbb-bnfvt"]
Sep 15 11:40:02.852018 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:40:02.851985    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd687a379_8413_4f2f_b98e_4cfce890b61e.slice/crio-505be31a83d7600984694f6f96dd72b88b460239c5429a59e54af6937d6b95ca WatchSource:0}: Error finding container 505be31a83d7600984694f6f96dd72b88b460239c5429a59e54af6937d6b95ca: Status 404 returned error can't find the container with id 505be31a83d7600984694f6f96dd72b88b460239c5429a59e54af6937d6b95ca
Sep 15 11:40:03.292141 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:03.292098    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4d6dbb-bnfvt" event={"ID":"d687a379-8413-4f2f-b98e-4cfce890b61e","Type":"ContainerStarted","Data":"636ffe4d37621e468c9bea50409072ddf0769030c7b98a8d84667c4f37e71fd2"}
Sep 15 11:40:03.292780 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:03.292173    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4d6dbb-bnfvt" event={"ID":"d687a379-8413-4f2f-b98e-4cfce890b61e","Type":"ContainerStarted","Data":"505be31a83d7600984694f6f96dd72b88b460239c5429a59e54af6937d6b95ca"}
Sep 15 11:40:03.308603 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:03.308539    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4d6dbb-bnfvt" podStartSLOduration=1.30851916 podStartE2EDuration="1.30851916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:40:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:40:03.307335769 +0000 UTC m=+873.733666366" watchObservedRunningTime="2026-09-15 11:40:03.30851916 +0000 UTC m=+873.734849756"
Sep 15 11:40:04.300984 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:04.300946    2575 generic.go:356] "Generic (PLEG): container finished" podID="d687a379-8413-4f2f-b98e-4cfce890b61e" containerID="636ffe4d37621e468c9bea50409072ddf0769030c7b98a8d84667c4f37e71fd2" exitCode=0
Sep 15 11:40:04.301403 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:04.301034    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4d6dbb-bnfvt" event={"ID":"d687a379-8413-4f2f-b98e-4cfce890b61e","Type":"ContainerDied","Data":"636ffe4d37621e468c9bea50409072ddf0769030c7b98a8d84667c4f37e71fd2"}
Sep 15 11:40:05.451819 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:05.451785    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4d6dbb-bnfvt"
Sep 15 11:40:05.526912 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:05.526865    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d687a379-8413-4f2f-b98e-4cfce890b61e-maas-api-service-ca\") pod \"d687a379-8413-4f2f-b98e-4cfce890b61e\" (UID: \"d687a379-8413-4f2f-b98e-4cfce890b61e\") "
Sep 15 11:40:05.527247 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:05.527220    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d687a379-8413-4f2f-b98e-4cfce890b61e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d687a379-8413-4f2f-b98e-4cfce890b61e" (UID: "d687a379-8413-4f2f-b98e-4cfce890b61e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:40:05.628004 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:05.627955    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d687a379-8413-4f2f-b98e-4cfce890b61e-maas-api-service-ca\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:40:06.316372 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:06.316343    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4d6dbb-bnfvt"
Sep 15 11:40:06.316555 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:06.316382    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4d6dbb-bnfvt" event={"ID":"d687a379-8413-4f2f-b98e-4cfce890b61e","Type":"ContainerDied","Data":"505be31a83d7600984694f6f96dd72b88b460239c5429a59e54af6937d6b95ca"}
Sep 15 11:40:06.316555 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:06.316436    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="505be31a83d7600984694f6f96dd72b88b460239c5429a59e54af6937d6b95ca"
Sep 15 11:40:12.820202 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:12.820159    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm"]
Sep 15 11:40:12.820784 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:12.820410    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm" podUID="5a2fe7ab-d6ba-4740-98d6-982e2d3734a3" containerName="maas-api" containerID="cri-o://5d246225ae47734bcae4047abc67945521a3b2b5e251ce6539a31b634ef99549" gracePeriod=30
Sep 15 11:40:12.942333 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:12.942295    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4d6dbb-bnfvt"]
Sep 15 11:40:12.948964 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:12.948922    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4d6dbb-bnfvt"]
Sep 15 11:40:13.101178 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:13.101150    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm"
Sep 15 11:40:13.213494 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:13.213453    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a2fe7ab-d6ba-4740-98d6-982e2d3734a3-openshift-service-ca\") pod \"5a2fe7ab-d6ba-4740-98d6-982e2d3734a3\" (UID: \"5a2fe7ab-d6ba-4740-98d6-982e2d3734a3\") "
Sep 15 11:40:13.213763 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:13.213562    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7p8r\" (UniqueName: \"kubernetes.io/projected/5a2fe7ab-d6ba-4740-98d6-982e2d3734a3-kube-api-access-z7p8r\") pod \"5a2fe7ab-d6ba-4740-98d6-982e2d3734a3\" (UID: \"5a2fe7ab-d6ba-4740-98d6-982e2d3734a3\") "
Sep 15 11:40:13.213763 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:13.213714    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a2fe7ab-d6ba-4740-98d6-982e2d3734a3-maas-api-tls\") pod \"5a2fe7ab-d6ba-4740-98d6-982e2d3734a3\" (UID: \"5a2fe7ab-d6ba-4740-98d6-982e2d3734a3\") "
Sep 15 11:40:13.213895 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:13.213784    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a2fe7ab-d6ba-4740-98d6-982e2d3734a3-metrics-certs\") pod \"5a2fe7ab-d6ba-4740-98d6-982e2d3734a3\" (UID: \"5a2fe7ab-d6ba-4740-98d6-982e2d3734a3\") "
Sep 15 11:40:13.214139 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:13.214108    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a2fe7ab-d6ba-4740-98d6-982e2d3734a3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5a2fe7ab-d6ba-4740-98d6-982e2d3734a3" (UID: "5a2fe7ab-d6ba-4740-98d6-982e2d3734a3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:40:13.214551 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:13.214496    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a2fe7ab-d6ba-4740-98d6-982e2d3734a3-openshift-service-ca\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:40:13.216466 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:13.216435    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a2fe7ab-d6ba-4740-98d6-982e2d3734a3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5a2fe7ab-d6ba-4740-98d6-982e2d3734a3" (UID: "5a2fe7ab-d6ba-4740-98d6-982e2d3734a3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:40:13.216715 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:13.216649    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a2fe7ab-d6ba-4740-98d6-982e2d3734a3-kube-api-access-z7p8r" (OuterVolumeSpecName: "kube-api-access-z7p8r") pod "5a2fe7ab-d6ba-4740-98d6-982e2d3734a3" (UID: "5a2fe7ab-d6ba-4740-98d6-982e2d3734a3"). InnerVolumeSpecName "kube-api-access-z7p8r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:40:13.217216 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:13.217187    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a2fe7ab-d6ba-4740-98d6-982e2d3734a3-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5a2fe7ab-d6ba-4740-98d6-982e2d3734a3" (UID: "5a2fe7ab-d6ba-4740-98d6-982e2d3734a3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:40:13.315480 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:13.315444    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7p8r\" (UniqueName: \"kubernetes.io/projected/5a2fe7ab-d6ba-4740-98d6-982e2d3734a3-kube-api-access-z7p8r\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:40:13.315480 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:13.315478    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a2fe7ab-d6ba-4740-98d6-982e2d3734a3-maas-api-tls\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:40:13.315480 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:13.315487    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a2fe7ab-d6ba-4740-98d6-982e2d3734a3-metrics-certs\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:40:13.371021 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:13.370913    2575 generic.go:356] "Generic (PLEG): container finished" podID="5a2fe7ab-d6ba-4740-98d6-982e2d3734a3" containerID="5d246225ae47734bcae4047abc67945521a3b2b5e251ce6539a31b634ef99549" exitCode=0
Sep 15 11:40:13.371021 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:13.370969    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm"
Sep 15 11:40:13.371021 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:13.370997    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm" event={"ID":"5a2fe7ab-d6ba-4740-98d6-982e2d3734a3","Type":"ContainerDied","Data":"5d246225ae47734bcae4047abc67945521a3b2b5e251ce6539a31b634ef99549"}
Sep 15 11:40:13.371308 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:13.371047    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm" event={"ID":"5a2fe7ab-d6ba-4740-98d6-982e2d3734a3","Type":"ContainerDied","Data":"362e24059ae0d7496a775526c0d7c9be626e82ae51396f8cb4b0293130241564"}
Sep 15 11:40:13.371308 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:13.371072    2575 scope.go:117] "RemoveContainer" containerID="5d246225ae47734bcae4047abc67945521a3b2b5e251ce6539a31b634ef99549"
Sep 15 11:40:13.382145 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:13.382117    2575 scope.go:117] "RemoveContainer" containerID="5d246225ae47734bcae4047abc67945521a3b2b5e251ce6539a31b634ef99549"
Sep 15 11:40:13.382519 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:40:13.382494    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d246225ae47734bcae4047abc67945521a3b2b5e251ce6539a31b634ef99549\": container with ID starting with 5d246225ae47734bcae4047abc67945521a3b2b5e251ce6539a31b634ef99549 not found: ID does not exist" containerID="5d246225ae47734bcae4047abc67945521a3b2b5e251ce6539a31b634ef99549"
Sep 15 11:40:13.382587 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:13.382534    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d246225ae47734bcae4047abc67945521a3b2b5e251ce6539a31b634ef99549"} err="failed to get container status \"5d246225ae47734bcae4047abc67945521a3b2b5e251ce6539a31b634ef99549\": rpc error: code = NotFound desc = could not find container \"5d246225ae47734bcae4047abc67945521a3b2b5e251ce6539a31b634ef99549\": container with ID starting with 5d246225ae47734bcae4047abc67945521a3b2b5e251ce6539a31b634ef99549 not found: ID does not exist"
Sep 15 11:40:13.393484 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:13.393440    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm"]
Sep 15 11:40:13.401151 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:13.401112    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9b1cbda7-94c65f444-zwvmm"]
Sep 15 11:40:14.094462 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:14.094426    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a2fe7ab-d6ba-4740-98d6-982e2d3734a3" path="/var/lib/kubelet/pods/5a2fe7ab-d6ba-4740-98d6-982e2d3734a3/volumes"
Sep 15 11:40:14.094876 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:14.094824    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d687a379-8413-4f2f-b98e-4cfce890b61e" path="/var/lib/kubelet/pods/d687a379-8413-4f2f-b98e-4cfce890b61e/volumes"
Sep 15 11:40:18.291083 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:18.291045    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-4d6dbb/autores-model-4d6dbb-kserve-75f4445c99-2dnw7"]
Sep 15 11:40:25.834218 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:25.834125    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-9fc4b9/test-model-9fc4b9-kserve-76c4469b8c-bbtwr"]
Sep 15 11:40:25.834647 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:25.834625    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a2fe7ab-d6ba-4740-98d6-982e2d3734a3" containerName="maas-api"
Sep 15 11:40:25.834647 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:25.834644    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a2fe7ab-d6ba-4740-98d6-982e2d3734a3" containerName="maas-api"
Sep 15 11:40:25.834821 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:25.834685    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d687a379-8413-4f2f-b98e-4cfce890b61e" containerName="revoke-keys"
Sep 15 11:40:25.834821 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:25.834694    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d687a379-8413-4f2f-b98e-4cfce890b61e" containerName="revoke-keys"
Sep 15 11:40:25.834821 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:25.834810    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a2fe7ab-d6ba-4740-98d6-982e2d3734a3" containerName="maas-api"
Sep 15 11:40:25.834922 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:25.834826    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d687a379-8413-4f2f-b98e-4cfce890b61e" containerName="revoke-keys"
Sep 15 11:40:25.839790 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:25.839763    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-9fc4b9/test-model-9fc4b9-kserve-76c4469b8c-bbtwr"
Sep 15 11:40:25.842945 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:25.842912    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-9fc4b9\"/\"default-dockercfg-bdgjp\""
Sep 15 11:40:25.843177 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:25.842976    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-9fc4b9\"/\"kube-root-ca.crt\""
Sep 15 11:40:25.843177 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:25.842984    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-9fc4b9\"/\"openshift-service-ca.crt\""
Sep 15 11:40:25.843177 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:25.842975    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-9fc4b9\"/\"test-model-9fc4b9-kserve-self-signed-certs\""
Sep 15 11:40:25.848082 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:25.848047    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-9fc4b9/test-model-9fc4b9-kserve-76c4469b8c-bbtwr"]
Sep 15 11:40:25.851607 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:25.851572    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/817afd82-9ae4-43ae-8ade-b3bf74be97c6-dshm\") pod \"test-model-9fc4b9-kserve-76c4469b8c-bbtwr\" (UID: \"817afd82-9ae4-43ae-8ade-b3bf74be97c6\") " pod="ai-tenant-e2e-inf-a-9fc4b9/test-model-9fc4b9-kserve-76c4469b8c-bbtwr"
Sep 15 11:40:25.851772 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:25.851700    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/817afd82-9ae4-43ae-8ade-b3bf74be97c6-tls-certs\") pod \"test-model-9fc4b9-kserve-76c4469b8c-bbtwr\" (UID: \"817afd82-9ae4-43ae-8ade-b3bf74be97c6\") " pod="ai-tenant-e2e-inf-a-9fc4b9/test-model-9fc4b9-kserve-76c4469b8c-bbtwr"
Sep 15 11:40:25.851772 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:25.851761    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/817afd82-9ae4-43ae-8ade-b3bf74be97c6-tmp-dir\") pod \"test-model-9fc4b9-kserve-76c4469b8c-bbtwr\" (UID: \"817afd82-9ae4-43ae-8ade-b3bf74be97c6\") " pod="ai-tenant-e2e-inf-a-9fc4b9/test-model-9fc4b9-kserve-76c4469b8c-bbtwr"
Sep 15 11:40:25.851907 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:25.851832    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/817afd82-9ae4-43ae-8ade-b3bf74be97c6-home\") pod \"test-model-9fc4b9-kserve-76c4469b8c-bbtwr\" (UID: \"817afd82-9ae4-43ae-8ade-b3bf74be97c6\") " pod="ai-tenant-e2e-inf-a-9fc4b9/test-model-9fc4b9-kserve-76c4469b8c-bbtwr"
Sep 15 11:40:25.851907 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:25.851866    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/817afd82-9ae4-43ae-8ade-b3bf74be97c6-model-cache\") pod \"test-model-9fc4b9-kserve-76c4469b8c-bbtwr\" (UID: \"817afd82-9ae4-43ae-8ade-b3bf74be97c6\") " pod="ai-tenant-e2e-inf-a-9fc4b9/test-model-9fc4b9-kserve-76c4469b8c-bbtwr"
Sep 15 11:40:25.851907 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:25.851899    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m92m7\" (UniqueName: \"kubernetes.io/projected/817afd82-9ae4-43ae-8ade-b3bf74be97c6-kube-api-access-m92m7\") pod \"test-model-9fc4b9-kserve-76c4469b8c-bbtwr\" (UID: \"817afd82-9ae4-43ae-8ade-b3bf74be97c6\") " pod="ai-tenant-e2e-inf-a-9fc4b9/test-model-9fc4b9-kserve-76c4469b8c-bbtwr"
Sep 15 11:40:25.953247 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:25.953203    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/817afd82-9ae4-43ae-8ade-b3bf74be97c6-tls-certs\") pod \"test-model-9fc4b9-kserve-76c4469b8c-bbtwr\" (UID: \"817afd82-9ae4-43ae-8ade-b3bf74be97c6\") " pod="ai-tenant-e2e-inf-a-9fc4b9/test-model-9fc4b9-kserve-76c4469b8c-bbtwr"
Sep 15 11:40:25.953466 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:25.953259    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/817afd82-9ae4-43ae-8ade-b3bf74be97c6-tmp-dir\") pod \"test-model-9fc4b9-kserve-76c4469b8c-bbtwr\" (UID: \"817afd82-9ae4-43ae-8ade-b3bf74be97c6\") " pod="ai-tenant-e2e-inf-a-9fc4b9/test-model-9fc4b9-kserve-76c4469b8c-bbtwr"
Sep 15 11:40:25.953466 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:25.953291    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/817afd82-9ae4-43ae-8ade-b3bf74be97c6-home\") pod \"test-model-9fc4b9-kserve-76c4469b8c-bbtwr\" (UID: \"817afd82-9ae4-43ae-8ade-b3bf74be97c6\") " pod="ai-tenant-e2e-inf-a-9fc4b9/test-model-9fc4b9-kserve-76c4469b8c-bbtwr"
Sep 15 11:40:25.953466 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:25.953313    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/817afd82-9ae4-43ae-8ade-b3bf74be97c6-model-cache\") pod \"test-model-9fc4b9-kserve-76c4469b8c-bbtwr\" (UID: \"817afd82-9ae4-43ae-8ade-b3bf74be97c6\") " pod="ai-tenant-e2e-inf-a-9fc4b9/test-model-9fc4b9-kserve-76c4469b8c-bbtwr"
Sep 15 11:40:25.953466 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:25.953336    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m92m7\" (UniqueName: \"kubernetes.io/projected/817afd82-9ae4-43ae-8ade-b3bf74be97c6-kube-api-access-m92m7\") pod \"test-model-9fc4b9-kserve-76c4469b8c-bbtwr\" (UID: \"817afd82-9ae4-43ae-8ade-b3bf74be97c6\") " pod="ai-tenant-e2e-inf-a-9fc4b9/test-model-9fc4b9-kserve-76c4469b8c-bbtwr"
Sep 15 11:40:25.953466 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:25.953418    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/817afd82-9ae4-43ae-8ade-b3bf74be97c6-dshm\") pod \"test-model-9fc4b9-kserve-76c4469b8c-bbtwr\" (UID: \"817afd82-9ae4-43ae-8ade-b3bf74be97c6\") " pod="ai-tenant-e2e-inf-a-9fc4b9/test-model-9fc4b9-kserve-76c4469b8c-bbtwr"
Sep 15 11:40:25.953816 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:25.953789    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/817afd82-9ae4-43ae-8ade-b3bf74be97c6-home\") pod \"test-model-9fc4b9-kserve-76c4469b8c-bbtwr\" (UID: \"817afd82-9ae4-43ae-8ade-b3bf74be97c6\") " pod="ai-tenant-e2e-inf-a-9fc4b9/test-model-9fc4b9-kserve-76c4469b8c-bbtwr"
Sep 15 11:40:25.953891 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:25.953832    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/817afd82-9ae4-43ae-8ade-b3bf74be97c6-model-cache\") pod \"test-model-9fc4b9-kserve-76c4469b8c-bbtwr\" (UID: \"817afd82-9ae4-43ae-8ade-b3bf74be97c6\") " pod="ai-tenant-e2e-inf-a-9fc4b9/test-model-9fc4b9-kserve-76c4469b8c-bbtwr"
Sep 15 11:40:25.953891 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:25.953859    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/817afd82-9ae4-43ae-8ade-b3bf74be97c6-tmp-dir\") pod \"test-model-9fc4b9-kserve-76c4469b8c-bbtwr\" (UID: \"817afd82-9ae4-43ae-8ade-b3bf74be97c6\") " pod="ai-tenant-e2e-inf-a-9fc4b9/test-model-9fc4b9-kserve-76c4469b8c-bbtwr"
Sep 15 11:40:25.955741 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:25.955719    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/817afd82-9ae4-43ae-8ade-b3bf74be97c6-dshm\") pod \"test-model-9fc4b9-kserve-76c4469b8c-bbtwr\" (UID: \"817afd82-9ae4-43ae-8ade-b3bf74be97c6\") " pod="ai-tenant-e2e-inf-a-9fc4b9/test-model-9fc4b9-kserve-76c4469b8c-bbtwr"
Sep 15 11:40:25.956017 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:25.955997    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/817afd82-9ae4-43ae-8ade-b3bf74be97c6-tls-certs\") pod \"test-model-9fc4b9-kserve-76c4469b8c-bbtwr\" (UID: \"817afd82-9ae4-43ae-8ade-b3bf74be97c6\") " pod="ai-tenant-e2e-inf-a-9fc4b9/test-model-9fc4b9-kserve-76c4469b8c-bbtwr"
Sep 15 11:40:25.962044 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:25.962018    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m92m7\" (UniqueName: \"kubernetes.io/projected/817afd82-9ae4-43ae-8ade-b3bf74be97c6-kube-api-access-m92m7\") pod \"test-model-9fc4b9-kserve-76c4469b8c-bbtwr\" (UID: \"817afd82-9ae4-43ae-8ade-b3bf74be97c6\") " pod="ai-tenant-e2e-inf-a-9fc4b9/test-model-9fc4b9-kserve-76c4469b8c-bbtwr"
Sep 15 11:40:26.180821 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:26.180719    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-9fc4b9/test-model-9fc4b9-kserve-76c4469b8c-bbtwr"
Sep 15 11:40:26.459177 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:26.459145    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-9fc4b9/test-model-9fc4b9-kserve-76c4469b8c-bbtwr"]
Sep 15 11:40:26.460987 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:40:26.460955    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod817afd82_9ae4_43ae_8ade_b3bf74be97c6.slice/crio-a321667ee7e896c4aac3885d69580fc4cba298770df52f452541eb553c225cab WatchSource:0}: Error finding container a321667ee7e896c4aac3885d69580fc4cba298770df52f452541eb553c225cab: Status 404 returned error can't find the container with id a321667ee7e896c4aac3885d69580fc4cba298770df52f452541eb553c225cab
Sep 15 11:40:27.463326 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:27.463266    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-9fc4b9/test-model-9fc4b9-kserve-76c4469b8c-bbtwr" event={"ID":"817afd82-9ae4-43ae-8ade-b3bf74be97c6","Type":"ContainerStarted","Data":"5022a007e495fe304ed18aa0263b2d6451dc858750709a8cafd4ff08d4f24c6b"}
Sep 15 11:40:27.463784 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:27.463334    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-9fc4b9/test-model-9fc4b9-kserve-76c4469b8c-bbtwr" event={"ID":"817afd82-9ae4-43ae-8ade-b3bf74be97c6","Type":"ContainerStarted","Data":"a321667ee7e896c4aac3885d69580fc4cba298770df52f452541eb553c225cab"}
Sep 15 11:40:27.480076 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:27.480008    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-9fc4b9/test-model-9fc4b9-kserve-76c4469b8c-bbtwr" podStartSLOduration=2.479980582 podStartE2EDuration="2.479980582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:40:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:40:27.479762038 +0000 UTC m=+897.906092635" watchObservedRunningTime="2026-09-15 11:40:27.479980582 +0000 UTC m=+897.906311179"
Sep 15 11:40:33.312782 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:33.312738    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-autores-4d6dbb/autores-model-4d6dbb-kserve-75f4445c99-2dnw7" podUID="412d72ba-13cf-4dac-9265-e75ad7509835" containerName="main" containerID="cri-o://35d45e32f0321c43dc293155f152ce6a2c6badca6adbc8458c9133ae88a66db3" gracePeriod=45
Sep 15 11:40:33.512131 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:33.512090    2575 generic.go:356] "Generic (PLEG): container finished" podID="412d72ba-13cf-4dac-9265-e75ad7509835" containerID="35d45e32f0321c43dc293155f152ce6a2c6badca6adbc8458c9133ae88a66db3" exitCode=0
Sep 15 11:40:33.512322 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:33.512148    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-4d6dbb/autores-model-4d6dbb-kserve-75f4445c99-2dnw7" event={"ID":"412d72ba-13cf-4dac-9265-e75ad7509835","Type":"ContainerDied","Data":"35d45e32f0321c43dc293155f152ce6a2c6badca6adbc8458c9133ae88a66db3"}
Sep 15 11:40:33.608355 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:33.608323    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-4d6dbb/autores-model-4d6dbb-kserve-75f4445c99-2dnw7"
Sep 15 11:40:33.750017 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:33.749982    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tz7lk\" (UniqueName: \"kubernetes.io/projected/412d72ba-13cf-4dac-9265-e75ad7509835-kube-api-access-tz7lk\") pod \"412d72ba-13cf-4dac-9265-e75ad7509835\" (UID: \"412d72ba-13cf-4dac-9265-e75ad7509835\") "
Sep 15 11:40:33.750178 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:33.750048    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/412d72ba-13cf-4dac-9265-e75ad7509835-tls-certs\") pod \"412d72ba-13cf-4dac-9265-e75ad7509835\" (UID: \"412d72ba-13cf-4dac-9265-e75ad7509835\") "
Sep 15 11:40:33.750178 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:33.750147    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/412d72ba-13cf-4dac-9265-e75ad7509835-tmp-dir\") pod \"412d72ba-13cf-4dac-9265-e75ad7509835\" (UID: \"412d72ba-13cf-4dac-9265-e75ad7509835\") "
Sep 15 11:40:33.750293 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:33.750201    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/412d72ba-13cf-4dac-9265-e75ad7509835-dshm\") pod \"412d72ba-13cf-4dac-9265-e75ad7509835\" (UID: \"412d72ba-13cf-4dac-9265-e75ad7509835\") "
Sep 15 11:40:33.750293 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:33.750284    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/412d72ba-13cf-4dac-9265-e75ad7509835-home\") pod \"412d72ba-13cf-4dac-9265-e75ad7509835\" (UID: \"412d72ba-13cf-4dac-9265-e75ad7509835\") "
Sep 15 11:40:33.750410 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:33.750314    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/412d72ba-13cf-4dac-9265-e75ad7509835-model-cache\") pod \"412d72ba-13cf-4dac-9265-e75ad7509835\" (UID: \"412d72ba-13cf-4dac-9265-e75ad7509835\") "
Sep 15 11:40:33.750465 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:33.750419    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/412d72ba-13cf-4dac-9265-e75ad7509835-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "412d72ba-13cf-4dac-9265-e75ad7509835" (UID: "412d72ba-13cf-4dac-9265-e75ad7509835"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:40:33.750568 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:33.750533    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/412d72ba-13cf-4dac-9265-e75ad7509835-home" (OuterVolumeSpecName: "home") pod "412d72ba-13cf-4dac-9265-e75ad7509835" (UID: "412d72ba-13cf-4dac-9265-e75ad7509835"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:40:33.750718 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:33.750698    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/412d72ba-13cf-4dac-9265-e75ad7509835-model-cache" (OuterVolumeSpecName: "model-cache") pod "412d72ba-13cf-4dac-9265-e75ad7509835" (UID: "412d72ba-13cf-4dac-9265-e75ad7509835"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:40:33.750806 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:33.750785    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/412d72ba-13cf-4dac-9265-e75ad7509835-home\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:40:33.750884 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:33.750809    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/412d72ba-13cf-4dac-9265-e75ad7509835-model-cache\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:40:33.750884 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:33.750843    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/412d72ba-13cf-4dac-9265-e75ad7509835-tmp-dir\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:40:33.752557 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:33.752525    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/412d72ba-13cf-4dac-9265-e75ad7509835-kube-api-access-tz7lk" (OuterVolumeSpecName: "kube-api-access-tz7lk") pod "412d72ba-13cf-4dac-9265-e75ad7509835" (UID: "412d72ba-13cf-4dac-9265-e75ad7509835"). InnerVolumeSpecName "kube-api-access-tz7lk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:40:33.752695 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:33.752585    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/412d72ba-13cf-4dac-9265-e75ad7509835-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "412d72ba-13cf-4dac-9265-e75ad7509835" (UID: "412d72ba-13cf-4dac-9265-e75ad7509835"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:40:33.752695 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:33.752611    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/412d72ba-13cf-4dac-9265-e75ad7509835-dshm" (OuterVolumeSpecName: "dshm") pod "412d72ba-13cf-4dac-9265-e75ad7509835" (UID: "412d72ba-13cf-4dac-9265-e75ad7509835"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:40:33.851624 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:33.851535    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/412d72ba-13cf-4dac-9265-e75ad7509835-dshm\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:40:33.851624 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:33.851569    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tz7lk\" (UniqueName: \"kubernetes.io/projected/412d72ba-13cf-4dac-9265-e75ad7509835-kube-api-access-tz7lk\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:40:33.851624 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:33.851580    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/412d72ba-13cf-4dac-9265-e75ad7509835-tls-certs\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:40:34.521933 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:34.521847    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-4d6dbb/autores-model-4d6dbb-kserve-75f4445c99-2dnw7"
Sep 15 11:40:34.522365 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:34.521850    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-4d6dbb/autores-model-4d6dbb-kserve-75f4445c99-2dnw7" event={"ID":"412d72ba-13cf-4dac-9265-e75ad7509835","Type":"ContainerDied","Data":"9c38328ead978b0fbef883f4ce0a3659eaff633bca766ae9ab4d56722ccb91d4"}
Sep 15 11:40:34.522365 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:34.521980    2575 scope.go:117] "RemoveContainer" containerID="35d45e32f0321c43dc293155f152ce6a2c6badca6adbc8458c9133ae88a66db3"
Sep 15 11:40:34.543211 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:34.543168    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-4d6dbb/autores-model-4d6dbb-kserve-75f4445c99-2dnw7"]
Sep 15 11:40:34.547509 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:34.547465    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-autores-4d6dbb/autores-model-4d6dbb-kserve-75f4445c99-2dnw7"]
Sep 15 11:40:36.094892 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:36.094859    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="412d72ba-13cf-4dac-9265-e75ad7509835" path="/var/lib/kubelet/pods/412d72ba-13cf-4dac-9265-e75ad7509835/volumes"
Sep 15 11:40:36.181563 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:36.181518    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-9fc4b9/test-model-9fc4b9-kserve-76c4469b8c-bbtwr"
Sep 15 11:40:36.181563 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:36.181566    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-9fc4b9/test-model-9fc4b9-kserve-76c4469b8c-bbtwr"
Sep 15 11:40:36.194606 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:36.194575    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-9fc4b9/test-model-9fc4b9-kserve-76c4469b8c-bbtwr"
Sep 15 11:40:36.546207 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:36.546108    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-9fc4b9/test-model-9fc4b9-kserve-76c4469b8c-bbtwr"
Sep 15 11:40:47.864581 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:47.864540    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6f21996a-pktxb"]
Sep 15 11:40:47.865118 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:47.865038    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="412d72ba-13cf-4dac-9265-e75ad7509835" containerName="main"
Sep 15 11:40:47.865118 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:47.865052    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="412d72ba-13cf-4dac-9265-e75ad7509835" containerName="main"
Sep 15 11:40:47.865203 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:47.865123    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="412d72ba-13cf-4dac-9265-e75ad7509835" containerName="main"
Sep 15 11:40:47.869756 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:47.869737    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6f21996a-pktxb"
Sep 15 11:40:47.872135 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:47.872104    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rbxjk\""
Sep 15 11:40:47.880971 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:47.880938    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6f21996a-pktxb"]
Sep 15 11:40:48.002187 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:48.002137    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d7ed00b-4697-473d-88bd-3ee3a0f8ee08-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-6f21996a-pktxb\" (UID: \"3d7ed00b-4697-473d-88bd-3ee3a0f8ee08\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6f21996a-pktxb"
Sep 15 11:40:48.103584 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:48.103538    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d7ed00b-4697-473d-88bd-3ee3a0f8ee08-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-6f21996a-pktxb\" (UID: \"3d7ed00b-4697-473d-88bd-3ee3a0f8ee08\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6f21996a-pktxb"
Sep 15 11:40:48.104207 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:48.104183    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d7ed00b-4697-473d-88bd-3ee3a0f8ee08-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-6f21996a-pktxb\" (UID: \"3d7ed00b-4697-473d-88bd-3ee3a0f8ee08\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6f21996a-pktxb"
Sep 15 11:40:48.189065 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:48.188959    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6f21996a-pktxb"
Sep 15 11:40:48.467490 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:48.467462    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6f21996a-pktxb"]
Sep 15 11:40:48.469568 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:40:48.469535    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d7ed00b_4697_473d_88bd_3ee3a0f8ee08.slice/crio-84d77438c55a8f27e52bb845995eb940f96496a60c20c8c064da53ca64d15f58 WatchSource:0}: Error finding container 84d77438c55a8f27e52bb845995eb940f96496a60c20c8c064da53ca64d15f58: Status 404 returned error can't find the container with id 84d77438c55a8f27e52bb845995eb940f96496a60c20c8c064da53ca64d15f58
Sep 15 11:40:48.611357 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:48.611319    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6f21996a-pktxb" event={"ID":"3d7ed00b-4697-473d-88bd-3ee3a0f8ee08","Type":"ContainerStarted","Data":"84d77438c55a8f27e52bb845995eb940f96496a60c20c8c064da53ca64d15f58"}
Sep 15 11:40:49.620079 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:49.620045    2575 generic.go:356] "Generic (PLEG): container finished" podID="3d7ed00b-4697-473d-88bd-3ee3a0f8ee08" containerID="4edc6155c489ba2711ddd01208b4b4c27205354560c8b010f447be805edb3344" exitCode=0
Sep 15 11:40:49.620516 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:49.620133    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6f21996a-pktxb" event={"ID":"3d7ed00b-4697-473d-88bd-3ee3a0f8ee08","Type":"ContainerDied","Data":"4edc6155c489ba2711ddd01208b4b4c27205354560c8b010f447be805edb3344"}
Sep 15 11:40:50.770134 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:50.770105    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6f21996a-pktxb"
Sep 15 11:40:50.933462 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:50.933355    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d7ed00b-4697-473d-88bd-3ee3a0f8ee08-maas-api-service-ca\") pod \"3d7ed00b-4697-473d-88bd-3ee3a0f8ee08\" (UID: \"3d7ed00b-4697-473d-88bd-3ee3a0f8ee08\") "
Sep 15 11:40:50.933779 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:50.933756    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d7ed00b-4697-473d-88bd-3ee3a0f8ee08-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3d7ed00b-4697-473d-88bd-3ee3a0f8ee08" (UID: "3d7ed00b-4697-473d-88bd-3ee3a0f8ee08"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:40:51.034483 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:51.034431    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d7ed00b-4697-473d-88bd-3ee3a0f8ee08-maas-api-service-ca\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:40:51.636197 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:51.636167    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6f21996a-pktxb"
Sep 15 11:40:51.636197 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:51.636185    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6f21996a-pktxb" event={"ID":"3d7ed00b-4697-473d-88bd-3ee3a0f8ee08","Type":"ContainerDied","Data":"84d77438c55a8f27e52bb845995eb940f96496a60c20c8c064da53ca64d15f58"}
Sep 15 11:40:51.636422 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:40:51.636232    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="84d77438c55a8f27e52bb845995eb940f96496a60c20c8c064da53ca64d15f58"
Sep 15 11:41:00.288713 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:00.288641    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6f21996a-pktxb"]
Sep 15 11:41:00.291411 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:00.291387    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6f21996a-pktxb"]
Sep 15 11:41:02.094422 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:02.094388    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d7ed00b-4697-473d-88bd-3ee3a0f8ee08" path="/var/lib/kubelet/pods/3d7ed00b-4697-473d-88bd-3ee3a0f8ee08/volumes"
Sep 15 11:41:11.202691 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:11.202634    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"]
Sep 15 11:41:11.203208 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:11.202934    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96" podUID="ceb86645-1f0a-47e6-b9c0-f14e350d3ada" containerName="istio-proxy" containerID="cri-o://2b12df40fb0f6abf42fabe4fa77a6a7889c2fc9e299c04a1786fd3b5668395fa" gracePeriod=30
Sep 15 11:41:16.470288 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:16.470213    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"
Sep 15 11:41:16.605220 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:16.605183    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-workload-socket\") pod \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\" (UID: \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\") "
Sep 15 11:41:16.605425 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:16.605231    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-istio-data\") pod \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\" (UID: \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\") "
Sep 15 11:41:16.605425 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:16.605260    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwn7h\" (UniqueName: \"kubernetes.io/projected/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-kube-api-access-bwn7h\") pod \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\" (UID: \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\") "
Sep 15 11:41:16.605425 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:16.605291    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-istio-podinfo\") pod \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\" (UID: \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\") "
Sep 15 11:41:16.605425 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:16.605324    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-istio-token\") pod \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\" (UID: \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\") "
Sep 15 11:41:16.605425 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:16.605345    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-credential-socket\") pod \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\" (UID: \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\") "
Sep 15 11:41:16.605425 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:16.605420    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-workload-certs\") pod \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\" (UID: \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\") "
Sep 15 11:41:16.605819 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:16.605453    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-istio-envoy\") pod \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\" (UID: \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\") "
Sep 15 11:41:16.605819 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:16.605450    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ceb86645-1f0a-47e6-b9c0-f14e350d3ada" (UID: "ceb86645-1f0a-47e6-b9c0-f14e350d3ada"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:41:16.605819 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:16.605521    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-istiod-ca-cert\") pod \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\" (UID: \"ceb86645-1f0a-47e6-b9c0-f14e350d3ada\") "
Sep 15 11:41:16.605819 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:16.605521    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-istio-data" (OuterVolumeSpecName: "istio-data") pod "ceb86645-1f0a-47e6-b9c0-f14e350d3ada" (UID: "ceb86645-1f0a-47e6-b9c0-f14e350d3ada"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:41:16.606032 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:16.605964    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-workload-socket\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:41:16.606032 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:16.605986    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-istio-data\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:41:16.606032 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:16.605979    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ceb86645-1f0a-47e6-b9c0-f14e350d3ada" (UID: "ceb86645-1f0a-47e6-b9c0-f14e350d3ada"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:41:16.606032 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:16.605995    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ceb86645-1f0a-47e6-b9c0-f14e350d3ada" (UID: "ceb86645-1f0a-47e6-b9c0-f14e350d3ada"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:41:16.606032 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:16.606012    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ceb86645-1f0a-47e6-b9c0-f14e350d3ada" (UID: "ceb86645-1f0a-47e6-b9c0-f14e350d3ada"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:41:16.607760 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:16.607727    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ceb86645-1f0a-47e6-b9c0-f14e350d3ada" (UID: "ceb86645-1f0a-47e6-b9c0-f14e350d3ada"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:41:16.607760 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:16.607735    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ceb86645-1f0a-47e6-b9c0-f14e350d3ada" (UID: "ceb86645-1f0a-47e6-b9c0-f14e350d3ada"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 11:41:16.608177 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:16.608151    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-kube-api-access-bwn7h" (OuterVolumeSpecName: "kube-api-access-bwn7h") pod "ceb86645-1f0a-47e6-b9c0-f14e350d3ada" (UID: "ceb86645-1f0a-47e6-b9c0-f14e350d3ada"). InnerVolumeSpecName "kube-api-access-bwn7h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:41:16.608296 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:16.608156    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-istio-token" (OuterVolumeSpecName: "istio-token") pod "ceb86645-1f0a-47e6-b9c0-f14e350d3ada" (UID: "ceb86645-1f0a-47e6-b9c0-f14e350d3ada"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:41:16.707171 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:16.707121    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-istio-token\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:41:16.707171 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:16.707160    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-credential-socket\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:41:16.707171 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:16.707172    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-workload-certs\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:41:16.707171 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:16.707184    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-istio-envoy\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:41:16.707490 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:16.707192    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-istiod-ca-cert\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:41:16.707490 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:16.707201    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwn7h\" (UniqueName: \"kubernetes.io/projected/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-kube-api-access-bwn7h\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:41:16.707490 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:16.707209    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ceb86645-1f0a-47e6-b9c0-f14e350d3ada-istio-podinfo\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:41:16.797946 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:16.797835    2575 generic.go:356] "Generic (PLEG): container finished" podID="ceb86645-1f0a-47e6-b9c0-f14e350d3ada" containerID="2b12df40fb0f6abf42fabe4fa77a6a7889c2fc9e299c04a1786fd3b5668395fa" exitCode=0
Sep 15 11:41:16.797946 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:16.797886    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"
Sep 15 11:41:16.797946 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:16.797920    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96" event={"ID":"ceb86645-1f0a-47e6-b9c0-f14e350d3ada","Type":"ContainerDied","Data":"2b12df40fb0f6abf42fabe4fa77a6a7889c2fc9e299c04a1786fd3b5668395fa"}
Sep 15 11:41:16.798257 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:16.797987    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96" event={"ID":"ceb86645-1f0a-47e6-b9c0-f14e350d3ada","Type":"ContainerDied","Data":"087097f320e2bb37608bbcfff686baf705d0b5e0745229c08aa60075591c71ed"}
Sep 15 11:41:16.798257 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:16.798016    2575 scope.go:117] "RemoveContainer" containerID="2b12df40fb0f6abf42fabe4fa77a6a7889c2fc9e299c04a1786fd3b5668395fa"
Sep 15 11:41:16.811244 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:16.811222    2575 scope.go:117] "RemoveContainer" containerID="d019031e4e4a452ca6215fe29466372760f71aec095f3db0e942ef4b8d24a96b"
Sep 15 11:41:16.821747 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:16.821645    2575 scope.go:117] "RemoveContainer" containerID="2b12df40fb0f6abf42fabe4fa77a6a7889c2fc9e299c04a1786fd3b5668395fa"
Sep 15 11:41:16.822124 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:41:16.822101    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b12df40fb0f6abf42fabe4fa77a6a7889c2fc9e299c04a1786fd3b5668395fa\": container with ID starting with 2b12df40fb0f6abf42fabe4fa77a6a7889c2fc9e299c04a1786fd3b5668395fa not found: ID does not exist" containerID="2b12df40fb0f6abf42fabe4fa77a6a7889c2fc9e299c04a1786fd3b5668395fa"
Sep 15 11:41:16.822227 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:16.822132    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b12df40fb0f6abf42fabe4fa77a6a7889c2fc9e299c04a1786fd3b5668395fa"} err="failed to get container status \"2b12df40fb0f6abf42fabe4fa77a6a7889c2fc9e299c04a1786fd3b5668395fa\": rpc error: code = NotFound desc = could not find container \"2b12df40fb0f6abf42fabe4fa77a6a7889c2fc9e299c04a1786fd3b5668395fa\": container with ID starting with 2b12df40fb0f6abf42fabe4fa77a6a7889c2fc9e299c04a1786fd3b5668395fa not found: ID does not exist"
Sep 15 11:41:16.822227 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:16.822152    2575 scope.go:117] "RemoveContainer" containerID="d019031e4e4a452ca6215fe29466372760f71aec095f3db0e942ef4b8d24a96b"
Sep 15 11:41:16.822485 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:41:16.822460    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d019031e4e4a452ca6215fe29466372760f71aec095f3db0e942ef4b8d24a96b\": container with ID starting with d019031e4e4a452ca6215fe29466372760f71aec095f3db0e942ef4b8d24a96b not found: ID does not exist" containerID="d019031e4e4a452ca6215fe29466372760f71aec095f3db0e942ef4b8d24a96b"
Sep 15 11:41:16.822538 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:16.822497    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d019031e4e4a452ca6215fe29466372760f71aec095f3db0e942ef4b8d24a96b"} err="failed to get container status \"d019031e4e4a452ca6215fe29466372760f71aec095f3db0e942ef4b8d24a96b\": rpc error: code = NotFound desc = could not find container \"d019031e4e4a452ca6215fe29466372760f71aec095f3db0e942ef4b8d24a96b\": container with ID starting with d019031e4e4a452ca6215fe29466372760f71aec095f3db0e942ef4b8d24a96b not found: ID does not exist"
Sep 15 11:41:16.823092 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:16.823076    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"]
Sep 15 11:41:16.828780 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:16.828752    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96"]
Sep 15 11:41:18.094813 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:18.094778    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ceb86645-1f0a-47e6-b9c0-f14e350d3ada" path="/var/lib/kubelet/pods/ceb86645-1f0a-47e6-b9c0-f14e350d3ada/volumes"
Sep 15 11:41:18.452938 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:18.452840    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q"]
Sep 15 11:41:18.453316 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:18.453303    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ceb86645-1f0a-47e6-b9c0-f14e350d3ada" containerName="istio-proxy"
Sep 15 11:41:18.453364 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:18.453319    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ceb86645-1f0a-47e6-b9c0-f14e350d3ada" containerName="istio-proxy"
Sep 15 11:41:18.453364 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:18.453343    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d7ed00b-4697-473d-88bd-3ee3a0f8ee08" containerName="revoke-keys"
Sep 15 11:41:18.453364 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:18.453349    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d7ed00b-4697-473d-88bd-3ee3a0f8ee08" containerName="revoke-keys"
Sep 15 11:41:18.453457 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:18.453408    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d7ed00b-4697-473d-88bd-3ee3a0f8ee08" containerName="revoke-keys"
Sep 15 11:41:18.453457 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:18.453418    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ceb86645-1f0a-47e6-b9c0-f14e350d3ada" containerName="istio-proxy"
Sep 15 11:41:18.453457 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:18.453424    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ceb86645-1f0a-47e6-b9c0-f14e350d3ada" containerName="istio-proxy"
Sep 15 11:41:18.458450 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:18.458420    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q"
Sep 15 11:41:18.462727 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:18.462700    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-a73e48-serving-cert\""
Sep 15 11:41:18.474966 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:18.474933    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q"]
Sep 15 11:41:18.628397 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:18.628357    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c640e0e-a05a-4c4e-9988-40d4ffac5464-metrics-certs\") pod \"maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q\" (UID: \"5c640e0e-a05a-4c4e-9988-40d4ffac5464\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q"
Sep 15 11:41:18.628397 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:18.628404    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrp5g\" (UniqueName: \"kubernetes.io/projected/5c640e0e-a05a-4c4e-9988-40d4ffac5464-kube-api-access-lrp5g\") pod \"maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q\" (UID: \"5c640e0e-a05a-4c4e-9988-40d4ffac5464\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q"
Sep 15 11:41:18.628629 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:18.628435    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c640e0e-a05a-4c4e-9988-40d4ffac5464-maas-api-tls\") pod \"maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q\" (UID: \"5c640e0e-a05a-4c4e-9988-40d4ffac5464\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q"
Sep 15 11:41:18.628629 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:18.628508    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c640e0e-a05a-4c4e-9988-40d4ffac5464-openshift-service-ca\") pod \"maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q\" (UID: \"5c640e0e-a05a-4c4e-9988-40d4ffac5464\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q"
Sep 15 11:41:18.729746 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:18.729622    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c640e0e-a05a-4c4e-9988-40d4ffac5464-metrics-certs\") pod \"maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q\" (UID: \"5c640e0e-a05a-4c4e-9988-40d4ffac5464\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q"
Sep 15 11:41:18.729746 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:18.729705    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrp5g\" (UniqueName: \"kubernetes.io/projected/5c640e0e-a05a-4c4e-9988-40d4ffac5464-kube-api-access-lrp5g\") pod \"maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q\" (UID: \"5c640e0e-a05a-4c4e-9988-40d4ffac5464\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q"
Sep 15 11:41:18.729746 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:18.729744    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c640e0e-a05a-4c4e-9988-40d4ffac5464-maas-api-tls\") pod \"maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q\" (UID: \"5c640e0e-a05a-4c4e-9988-40d4ffac5464\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q"
Sep 15 11:41:18.730211 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:18.729764    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c640e0e-a05a-4c4e-9988-40d4ffac5464-openshift-service-ca\") pod \"maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q\" (UID: \"5c640e0e-a05a-4c4e-9988-40d4ffac5464\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q"
Sep 15 11:41:18.730211 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:41:18.729864    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-a73e48-serving-cert: secret "maas-api-e2e-explicit-a73e48-serving-cert" not found
Sep 15 11:41:18.730211 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:41:18.729941    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c640e0e-a05a-4c4e-9988-40d4ffac5464-maas-api-tls podName:5c640e0e-a05a-4c4e-9988-40d4ffac5464 nodeName:}" failed. No retries permitted until 2026-09-15 11:41:19.229923132 +0000 UTC m=+949.656253706 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5c640e0e-a05a-4c4e-9988-40d4ffac5464-maas-api-tls") pod "maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q" (UID: "5c640e0e-a05a-4c4e-9988-40d4ffac5464") : secret "maas-api-e2e-explicit-a73e48-serving-cert" not found
Sep 15 11:41:18.730545 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:18.730521    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c640e0e-a05a-4c4e-9988-40d4ffac5464-openshift-service-ca\") pod \"maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q\" (UID: \"5c640e0e-a05a-4c4e-9988-40d4ffac5464\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q"
Sep 15 11:41:18.732190 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:18.732173    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c640e0e-a05a-4c4e-9988-40d4ffac5464-metrics-certs\") pod \"maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q\" (UID: \"5c640e0e-a05a-4c4e-9988-40d4ffac5464\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q"
Sep 15 11:41:18.744605 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:18.744578    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrp5g\" (UniqueName: \"kubernetes.io/projected/5c640e0e-a05a-4c4e-9988-40d4ffac5464-kube-api-access-lrp5g\") pod \"maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q\" (UID: \"5c640e0e-a05a-4c4e-9988-40d4ffac5464\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q"
Sep 15 11:41:19.234836 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:19.234784    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c640e0e-a05a-4c4e-9988-40d4ffac5464-maas-api-tls\") pod \"maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q\" (UID: \"5c640e0e-a05a-4c4e-9988-40d4ffac5464\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q"
Sep 15 11:41:19.237275 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:19.237246    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c640e0e-a05a-4c4e-9988-40d4ffac5464-maas-api-tls\") pod \"maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q\" (UID: \"5c640e0e-a05a-4c4e-9988-40d4ffac5464\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q"
Sep 15 11:41:19.372447 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:19.372407    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q"
Sep 15 11:41:19.661239 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:19.661204    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q"]
Sep 15 11:41:19.662349 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:41:19.662318    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c640e0e_a05a_4c4e_9988_40d4ffac5464.slice/crio-5746e414ebaa0ec6ea92a21d798cea5e40ecb996ed7516a23932623723997107 WatchSource:0}: Error finding container 5746e414ebaa0ec6ea92a21d798cea5e40ecb996ed7516a23932623723997107: Status 404 returned error can't find the container with id 5746e414ebaa0ec6ea92a21d798cea5e40ecb996ed7516a23932623723997107
Sep 15 11:41:19.663824 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:19.663805    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 11:41:19.822449 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:19.822408    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q" event={"ID":"5c640e0e-a05a-4c4e-9988-40d4ffac5464","Type":"ContainerStarted","Data":"5746e414ebaa0ec6ea92a21d798cea5e40ecb996ed7516a23932623723997107"}
Sep 15 11:41:20.830534 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:20.830490    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q" event={"ID":"5c640e0e-a05a-4c4e-9988-40d4ffac5464","Type":"ContainerStarted","Data":"1c6eadd8acb631f7b6cdaf6534564c954d8dbd8081d5c56c3bad6ac596f690a8"}
Sep 15 11:41:20.831029 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:20.830558    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q"
Sep 15 11:41:20.861350 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:20.861289    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q" podStartSLOduration=2.348837448 podStartE2EDuration="2.861268216s" totalImagesPullingTime="512.430768ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:41:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:41:20.852974278 +0000 UTC m=+951.279304874" watchObservedRunningTime="2026-09-15 11:41:20.861268216 +0000 UTC m=+951.287598811"
Sep 15 11:41:26.842698 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:26.842648    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q"
Sep 15 11:41:58.647218 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:58.647127    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-6e996c/premium-w0-6e996c-kserve-568c8f4784-q9r2n"]
Sep 15 11:41:58.647721 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:58.647624    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ceb86645-1f0a-47e6-b9c0-f14e350d3ada" containerName="istio-proxy"
Sep 15 11:41:58.647721 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:58.647636    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ceb86645-1f0a-47e6-b9c0-f14e350d3ada" containerName="istio-proxy"
Sep 15 11:41:58.651338 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:58.651315    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-6e996c/premium-w0-6e996c-kserve-568c8f4784-q9r2n"
Sep 15 11:41:58.654257 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:58.654223    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-6e996c\"/\"openshift-service-ca.crt\""
Sep 15 11:41:58.655025 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:58.654997    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-6e996c\"/\"default-dockercfg-hqdd9\""
Sep 15 11:41:58.655232 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:58.655169    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-6e996c\"/\"premium-w0-6e996c-kserve-self-signed-certs\""
Sep 15 11:41:58.655619 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:58.655600    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-6e996c\"/\"kube-root-ca.crt\""
Sep 15 11:41:58.666821 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:58.666782    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-6e996c/premium-w0-6e996c-kserve-568c8f4784-q9r2n"]
Sep 15 11:41:58.759282 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:58.759237    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e95847f2-211e-4264-8ca8-8e5dc9a756fd-model-cache\") pod \"premium-w0-6e996c-kserve-568c8f4784-q9r2n\" (UID: \"e95847f2-211e-4264-8ca8-8e5dc9a756fd\") " pod="e2e-models-e2e-worker-w0-6e996c/premium-w0-6e996c-kserve-568c8f4784-q9r2n"
Sep 15 11:41:58.759480 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:58.759350    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e95847f2-211e-4264-8ca8-8e5dc9a756fd-home\") pod \"premium-w0-6e996c-kserve-568c8f4784-q9r2n\" (UID: \"e95847f2-211e-4264-8ca8-8e5dc9a756fd\") " pod="e2e-models-e2e-worker-w0-6e996c/premium-w0-6e996c-kserve-568c8f4784-q9r2n"
Sep 15 11:41:58.759480 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:58.759388    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e95847f2-211e-4264-8ca8-8e5dc9a756fd-tmp-dir\") pod \"premium-w0-6e996c-kserve-568c8f4784-q9r2n\" (UID: \"e95847f2-211e-4264-8ca8-8e5dc9a756fd\") " pod="e2e-models-e2e-worker-w0-6e996c/premium-w0-6e996c-kserve-568c8f4784-q9r2n"
Sep 15 11:41:58.759480 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:58.759413    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e95847f2-211e-4264-8ca8-8e5dc9a756fd-tls-certs\") pod \"premium-w0-6e996c-kserve-568c8f4784-q9r2n\" (UID: \"e95847f2-211e-4264-8ca8-8e5dc9a756fd\") " pod="e2e-models-e2e-worker-w0-6e996c/premium-w0-6e996c-kserve-568c8f4784-q9r2n"
Sep 15 11:41:58.759480 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:58.759443    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqh8n\" (UniqueName: \"kubernetes.io/projected/e95847f2-211e-4264-8ca8-8e5dc9a756fd-kube-api-access-bqh8n\") pod \"premium-w0-6e996c-kserve-568c8f4784-q9r2n\" (UID: \"e95847f2-211e-4264-8ca8-8e5dc9a756fd\") " pod="e2e-models-e2e-worker-w0-6e996c/premium-w0-6e996c-kserve-568c8f4784-q9r2n"
Sep 15 11:41:58.759635 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:58.759527    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e95847f2-211e-4264-8ca8-8e5dc9a756fd-dshm\") pod \"premium-w0-6e996c-kserve-568c8f4784-q9r2n\" (UID: \"e95847f2-211e-4264-8ca8-8e5dc9a756fd\") " pod="e2e-models-e2e-worker-w0-6e996c/premium-w0-6e996c-kserve-568c8f4784-q9r2n"
Sep 15 11:41:58.860883 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:58.860836    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqh8n\" (UniqueName: \"kubernetes.io/projected/e95847f2-211e-4264-8ca8-8e5dc9a756fd-kube-api-access-bqh8n\") pod \"premium-w0-6e996c-kserve-568c8f4784-q9r2n\" (UID: \"e95847f2-211e-4264-8ca8-8e5dc9a756fd\") " pod="e2e-models-e2e-worker-w0-6e996c/premium-w0-6e996c-kserve-568c8f4784-q9r2n"
Sep 15 11:41:58.860883 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:58.860890    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e95847f2-211e-4264-8ca8-8e5dc9a756fd-dshm\") pod \"premium-w0-6e996c-kserve-568c8f4784-q9r2n\" (UID: \"e95847f2-211e-4264-8ca8-8e5dc9a756fd\") " pod="e2e-models-e2e-worker-w0-6e996c/premium-w0-6e996c-kserve-568c8f4784-q9r2n"
Sep 15 11:41:58.861164 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:58.860956    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e95847f2-211e-4264-8ca8-8e5dc9a756fd-model-cache\") pod \"premium-w0-6e996c-kserve-568c8f4784-q9r2n\" (UID: \"e95847f2-211e-4264-8ca8-8e5dc9a756fd\") " pod="e2e-models-e2e-worker-w0-6e996c/premium-w0-6e996c-kserve-568c8f4784-q9r2n"
Sep 15 11:41:58.861164 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:58.861002    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e95847f2-211e-4264-8ca8-8e5dc9a756fd-home\") pod \"premium-w0-6e996c-kserve-568c8f4784-q9r2n\" (UID: \"e95847f2-211e-4264-8ca8-8e5dc9a756fd\") " pod="e2e-models-e2e-worker-w0-6e996c/premium-w0-6e996c-kserve-568c8f4784-q9r2n"
Sep 15 11:41:58.861164 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:58.861026    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e95847f2-211e-4264-8ca8-8e5dc9a756fd-tmp-dir\") pod \"premium-w0-6e996c-kserve-568c8f4784-q9r2n\" (UID: \"e95847f2-211e-4264-8ca8-8e5dc9a756fd\") " pod="e2e-models-e2e-worker-w0-6e996c/premium-w0-6e996c-kserve-568c8f4784-q9r2n"
Sep 15 11:41:58.861164 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:58.861048    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e95847f2-211e-4264-8ca8-8e5dc9a756fd-tls-certs\") pod \"premium-w0-6e996c-kserve-568c8f4784-q9r2n\" (UID: \"e95847f2-211e-4264-8ca8-8e5dc9a756fd\") " pod="e2e-models-e2e-worker-w0-6e996c/premium-w0-6e996c-kserve-568c8f4784-q9r2n"
Sep 15 11:41:58.861410 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:58.861391    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e95847f2-211e-4264-8ca8-8e5dc9a756fd-tmp-dir\") pod \"premium-w0-6e996c-kserve-568c8f4784-q9r2n\" (UID: \"e95847f2-211e-4264-8ca8-8e5dc9a756fd\") " pod="e2e-models-e2e-worker-w0-6e996c/premium-w0-6e996c-kserve-568c8f4784-q9r2n"
Sep 15 11:41:58.861482 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:58.861434    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e95847f2-211e-4264-8ca8-8e5dc9a756fd-model-cache\") pod \"premium-w0-6e996c-kserve-568c8f4784-q9r2n\" (UID: \"e95847f2-211e-4264-8ca8-8e5dc9a756fd\") " pod="e2e-models-e2e-worker-w0-6e996c/premium-w0-6e996c-kserve-568c8f4784-q9r2n"
Sep 15 11:41:58.861547 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:58.861495    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e95847f2-211e-4264-8ca8-8e5dc9a756fd-home\") pod \"premium-w0-6e996c-kserve-568c8f4784-q9r2n\" (UID: \"e95847f2-211e-4264-8ca8-8e5dc9a756fd\") " pod="e2e-models-e2e-worker-w0-6e996c/premium-w0-6e996c-kserve-568c8f4784-q9r2n"
Sep 15 11:41:58.863428 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:58.863405    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e95847f2-211e-4264-8ca8-8e5dc9a756fd-dshm\") pod \"premium-w0-6e996c-kserve-568c8f4784-q9r2n\" (UID: \"e95847f2-211e-4264-8ca8-8e5dc9a756fd\") " pod="e2e-models-e2e-worker-w0-6e996c/premium-w0-6e996c-kserve-568c8f4784-q9r2n"
Sep 15 11:41:58.863699 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:58.863678    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e95847f2-211e-4264-8ca8-8e5dc9a756fd-tls-certs\") pod \"premium-w0-6e996c-kserve-568c8f4784-q9r2n\" (UID: \"e95847f2-211e-4264-8ca8-8e5dc9a756fd\") " pod="e2e-models-e2e-worker-w0-6e996c/premium-w0-6e996c-kserve-568c8f4784-q9r2n"
Sep 15 11:41:58.869486 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:58.869453    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqh8n\" (UniqueName: \"kubernetes.io/projected/e95847f2-211e-4264-8ca8-8e5dc9a756fd-kube-api-access-bqh8n\") pod \"premium-w0-6e996c-kserve-568c8f4784-q9r2n\" (UID: \"e95847f2-211e-4264-8ca8-8e5dc9a756fd\") " pod="e2e-models-e2e-worker-w0-6e996c/premium-w0-6e996c-kserve-568c8f4784-q9r2n"
Sep 15 11:41:58.962626 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:58.962523    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-6e996c/premium-w0-6e996c-kserve-568c8f4784-q9r2n"
Sep 15 11:41:59.242533 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:41:59.242495    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-6e996c/premium-w0-6e996c-kserve-568c8f4784-q9r2n"]
Sep 15 11:41:59.243826 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:41:59.243788    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode95847f2_211e_4264_8ca8_8e5dc9a756fd.slice/crio-7bb1cf3aeff102fae58eb1203431697ec286ab350747352c24d0c6df2861f49c WatchSource:0}: Error finding container 7bb1cf3aeff102fae58eb1203431697ec286ab350747352c24d0c6df2861f49c: Status 404 returned error can't find the container with id 7bb1cf3aeff102fae58eb1203431697ec286ab350747352c24d0c6df2861f49c
Sep 15 11:42:00.081808 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:00.081758    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-6e996c/premium-w0-6e996c-kserve-568c8f4784-q9r2n" event={"ID":"e95847f2-211e-4264-8ca8-8e5dc9a756fd","Type":"ContainerStarted","Data":"692ea447f4c96104e46e2620a787662931702881e541fae05e7a71b288483707"}
Sep 15 11:42:00.082308 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:00.081823    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-6e996c/premium-w0-6e996c-kserve-568c8f4784-q9r2n" event={"ID":"e95847f2-211e-4264-8ca8-8e5dc9a756fd","Type":"ContainerStarted","Data":"7bb1cf3aeff102fae58eb1203431697ec286ab350747352c24d0c6df2861f49c"}
Sep 15 11:42:00.101536 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:00.101475    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-6e996c/premium-w0-6e996c-kserve-568c8f4784-q9r2n" podStartSLOduration=2.101451929 podStartE2EDuration="2.101451929s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:41:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:42:00.09809555 +0000 UTC m=+990.524426146" watchObservedRunningTime="2026-09-15 11:42:00.101451929 +0000 UTC m=+990.527782524"
Sep 15 11:42:08.962935 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:08.962891    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-6e996c/premium-w0-6e996c-kserve-568c8f4784-q9r2n"
Sep 15 11:42:08.962935 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:08.962946    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-6e996c/premium-w0-6e996c-kserve-568c8f4784-q9r2n"
Sep 15 11:42:08.976220 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:08.976188    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-6e996c/premium-w0-6e996c-kserve-568c8f4784-q9r2n"
Sep 15 11:42:09.153402 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:09.153371    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-6e996c/premium-w0-6e996c-kserve-568c8f4784-q9r2n"
Sep 15 11:42:33.046992 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:33.046944    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-78522e/test-model-78522e-kserve-6ff65f68cf-2rpsz"]
Sep 15 11:42:33.050988 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:33.050966    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-78522e/test-model-78522e-kserve-6ff65f68cf-2rpsz"
Sep 15 11:42:33.053371 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:33.053332    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-78522e\"/\"default-dockercfg-b2tdm\""
Sep 15 11:42:33.054025 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:33.053998    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-78522e\"/\"test-model-78522e-kserve-self-signed-certs\""
Sep 15 11:42:33.054025 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:33.054019    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-78522e\"/\"openshift-service-ca.crt\""
Sep 15 11:42:33.054221 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:33.054119    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-78522e\"/\"kube-root-ca.crt\""
Sep 15 11:42:33.059969 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:33.059942    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-78522e/test-model-78522e-kserve-6ff65f68cf-2rpsz"]
Sep 15 11:42:33.123309 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:33.123265    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d208efeb-be4d-4092-9b8b-1f3dca26a7e4-tmp-dir\") pod \"test-model-78522e-kserve-6ff65f68cf-2rpsz\" (UID: \"d208efeb-be4d-4092-9b8b-1f3dca26a7e4\") " pod="ai-tenant-e2e-inf-b-78522e/test-model-78522e-kserve-6ff65f68cf-2rpsz"
Sep 15 11:42:33.123309 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:33.123307    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d208efeb-be4d-4092-9b8b-1f3dca26a7e4-model-cache\") pod \"test-model-78522e-kserve-6ff65f68cf-2rpsz\" (UID: \"d208efeb-be4d-4092-9b8b-1f3dca26a7e4\") " pod="ai-tenant-e2e-inf-b-78522e/test-model-78522e-kserve-6ff65f68cf-2rpsz"
Sep 15 11:42:33.123547 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:33.123383    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d208efeb-be4d-4092-9b8b-1f3dca26a7e4-tls-certs\") pod \"test-model-78522e-kserve-6ff65f68cf-2rpsz\" (UID: \"d208efeb-be4d-4092-9b8b-1f3dca26a7e4\") " pod="ai-tenant-e2e-inf-b-78522e/test-model-78522e-kserve-6ff65f68cf-2rpsz"
Sep 15 11:42:33.123547 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:33.123450    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d208efeb-be4d-4092-9b8b-1f3dca26a7e4-dshm\") pod \"test-model-78522e-kserve-6ff65f68cf-2rpsz\" (UID: \"d208efeb-be4d-4092-9b8b-1f3dca26a7e4\") " pod="ai-tenant-e2e-inf-b-78522e/test-model-78522e-kserve-6ff65f68cf-2rpsz"
Sep 15 11:42:33.123628 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:33.123591    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d208efeb-be4d-4092-9b8b-1f3dca26a7e4-home\") pod \"test-model-78522e-kserve-6ff65f68cf-2rpsz\" (UID: \"d208efeb-be4d-4092-9b8b-1f3dca26a7e4\") " pod="ai-tenant-e2e-inf-b-78522e/test-model-78522e-kserve-6ff65f68cf-2rpsz"
Sep 15 11:42:33.123699 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:33.123635    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl9s8\" (UniqueName: \"kubernetes.io/projected/d208efeb-be4d-4092-9b8b-1f3dca26a7e4-kube-api-access-sl9s8\") pod \"test-model-78522e-kserve-6ff65f68cf-2rpsz\" (UID: \"d208efeb-be4d-4092-9b8b-1f3dca26a7e4\") " pod="ai-tenant-e2e-inf-b-78522e/test-model-78522e-kserve-6ff65f68cf-2rpsz"
Sep 15 11:42:33.224254 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:33.224219    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d208efeb-be4d-4092-9b8b-1f3dca26a7e4-home\") pod \"test-model-78522e-kserve-6ff65f68cf-2rpsz\" (UID: \"d208efeb-be4d-4092-9b8b-1f3dca26a7e4\") " pod="ai-tenant-e2e-inf-b-78522e/test-model-78522e-kserve-6ff65f68cf-2rpsz"
Sep 15 11:42:33.224254 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:33.224264    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl9s8\" (UniqueName: \"kubernetes.io/projected/d208efeb-be4d-4092-9b8b-1f3dca26a7e4-kube-api-access-sl9s8\") pod \"test-model-78522e-kserve-6ff65f68cf-2rpsz\" (UID: \"d208efeb-be4d-4092-9b8b-1f3dca26a7e4\") " pod="ai-tenant-e2e-inf-b-78522e/test-model-78522e-kserve-6ff65f68cf-2rpsz"
Sep 15 11:42:33.224513 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:33.224320    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d208efeb-be4d-4092-9b8b-1f3dca26a7e4-tmp-dir\") pod \"test-model-78522e-kserve-6ff65f68cf-2rpsz\" (UID: \"d208efeb-be4d-4092-9b8b-1f3dca26a7e4\") " pod="ai-tenant-e2e-inf-b-78522e/test-model-78522e-kserve-6ff65f68cf-2rpsz"
Sep 15 11:42:33.224513 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:33.224360    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d208efeb-be4d-4092-9b8b-1f3dca26a7e4-model-cache\") pod \"test-model-78522e-kserve-6ff65f68cf-2rpsz\" (UID: \"d208efeb-be4d-4092-9b8b-1f3dca26a7e4\") " pod="ai-tenant-e2e-inf-b-78522e/test-model-78522e-kserve-6ff65f68cf-2rpsz"
Sep 15 11:42:33.224513 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:33.224439    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d208efeb-be4d-4092-9b8b-1f3dca26a7e4-tls-certs\") pod \"test-model-78522e-kserve-6ff65f68cf-2rpsz\" (UID: \"d208efeb-be4d-4092-9b8b-1f3dca26a7e4\") " pod="ai-tenant-e2e-inf-b-78522e/test-model-78522e-kserve-6ff65f68cf-2rpsz"
Sep 15 11:42:33.224513 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:33.224461    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d208efeb-be4d-4092-9b8b-1f3dca26a7e4-dshm\") pod \"test-model-78522e-kserve-6ff65f68cf-2rpsz\" (UID: \"d208efeb-be4d-4092-9b8b-1f3dca26a7e4\") " pod="ai-tenant-e2e-inf-b-78522e/test-model-78522e-kserve-6ff65f68cf-2rpsz"
Sep 15 11:42:33.224788 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:33.224677    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d208efeb-be4d-4092-9b8b-1f3dca26a7e4-home\") pod \"test-model-78522e-kserve-6ff65f68cf-2rpsz\" (UID: \"d208efeb-be4d-4092-9b8b-1f3dca26a7e4\") " pod="ai-tenant-e2e-inf-b-78522e/test-model-78522e-kserve-6ff65f68cf-2rpsz"
Sep 15 11:42:33.224788 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:33.224738    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d208efeb-be4d-4092-9b8b-1f3dca26a7e4-tmp-dir\") pod \"test-model-78522e-kserve-6ff65f68cf-2rpsz\" (UID: \"d208efeb-be4d-4092-9b8b-1f3dca26a7e4\") " pod="ai-tenant-e2e-inf-b-78522e/test-model-78522e-kserve-6ff65f68cf-2rpsz"
Sep 15 11:42:33.224880 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:33.224780    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d208efeb-be4d-4092-9b8b-1f3dca26a7e4-model-cache\") pod \"test-model-78522e-kserve-6ff65f68cf-2rpsz\" (UID: \"d208efeb-be4d-4092-9b8b-1f3dca26a7e4\") " pod="ai-tenant-e2e-inf-b-78522e/test-model-78522e-kserve-6ff65f68cf-2rpsz"
Sep 15 11:42:33.226747 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:33.226729    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d208efeb-be4d-4092-9b8b-1f3dca26a7e4-dshm\") pod \"test-model-78522e-kserve-6ff65f68cf-2rpsz\" (UID: \"d208efeb-be4d-4092-9b8b-1f3dca26a7e4\") " pod="ai-tenant-e2e-inf-b-78522e/test-model-78522e-kserve-6ff65f68cf-2rpsz"
Sep 15 11:42:33.227074 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:33.227056    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d208efeb-be4d-4092-9b8b-1f3dca26a7e4-tls-certs\") pod \"test-model-78522e-kserve-6ff65f68cf-2rpsz\" (UID: \"d208efeb-be4d-4092-9b8b-1f3dca26a7e4\") " pod="ai-tenant-e2e-inf-b-78522e/test-model-78522e-kserve-6ff65f68cf-2rpsz"
Sep 15 11:42:33.233121 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:33.233093    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl9s8\" (UniqueName: \"kubernetes.io/projected/d208efeb-be4d-4092-9b8b-1f3dca26a7e4-kube-api-access-sl9s8\") pod \"test-model-78522e-kserve-6ff65f68cf-2rpsz\" (UID: \"d208efeb-be4d-4092-9b8b-1f3dca26a7e4\") " pod="ai-tenant-e2e-inf-b-78522e/test-model-78522e-kserve-6ff65f68cf-2rpsz"
Sep 15 11:42:33.361914 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:33.361871    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-78522e/test-model-78522e-kserve-6ff65f68cf-2rpsz"
Sep 15 11:42:33.644335 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:33.644298    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-78522e/test-model-78522e-kserve-6ff65f68cf-2rpsz"]
Sep 15 11:42:33.645472 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:42:33.645438    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd208efeb_be4d_4092_9b8b_1f3dca26a7e4.slice/crio-f835cc0227943db22cf2ff9b14052aa4b816e2101df43d019c1bd49f0a635553 WatchSource:0}: Error finding container f835cc0227943db22cf2ff9b14052aa4b816e2101df43d019c1bd49f0a635553: Status 404 returned error can't find the container with id f835cc0227943db22cf2ff9b14052aa4b816e2101df43d019c1bd49f0a635553
Sep 15 11:42:34.304862 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:34.304822    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-78522e/test-model-78522e-kserve-6ff65f68cf-2rpsz" event={"ID":"d208efeb-be4d-4092-9b8b-1f3dca26a7e4","Type":"ContainerStarted","Data":"5f466cd64ece7b5ed65c0462e2c00973d637f9d5062e472aa1f71dc3f016a21d"}
Sep 15 11:42:34.305261 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:34.304872    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-78522e/test-model-78522e-kserve-6ff65f68cf-2rpsz" event={"ID":"d208efeb-be4d-4092-9b8b-1f3dca26a7e4","Type":"ContainerStarted","Data":"f835cc0227943db22cf2ff9b14052aa4b816e2101df43d019c1bd49f0a635553"}
Sep 15 11:42:34.329676 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:34.326045    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-78522e/test-model-78522e-kserve-6ff65f68cf-2rpsz" podStartSLOduration=1.326019768 podStartE2EDuration="1.326019768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:42:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:42:34.321976612 +0000 UTC m=+1024.748307208" watchObservedRunningTime="2026-09-15 11:42:34.326019768 +0000 UTC m=+1024.752350365"
Sep 15 11:42:43.362111 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:43.362073    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-78522e/test-model-78522e-kserve-6ff65f68cf-2rpsz"
Sep 15 11:42:43.362608 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:43.362136    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-78522e/test-model-78522e-kserve-6ff65f68cf-2rpsz"
Sep 15 11:42:43.375834 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:43.375801    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-78522e/test-model-78522e-kserve-6ff65f68cf-2rpsz"
Sep 15 11:42:44.385576 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:44.385542    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-78522e/test-model-78522e-kserve-6ff65f68cf-2rpsz"
Sep 15 11:42:47.374102 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:47.374060    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49"]
Sep 15 11:42:47.378521 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:47.378495    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49"
Sep 15 11:42:47.380632 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:47.380606    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-5f7ca109-serving-cert\""
Sep 15 11:42:47.386456 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:47.386429    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49"]
Sep 15 11:42:47.483974 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:47.483924    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7770d13b-3d5e-4084-a8a4-4c23e3298f16-openshift-service-ca\") pod \"maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49\" (UID: \"7770d13b-3d5e-4084-a8a4-4c23e3298f16\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49"
Sep 15 11:42:47.483974 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:47.483977    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7770d13b-3d5e-4084-a8a4-4c23e3298f16-metrics-certs\") pod \"maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49\" (UID: \"7770d13b-3d5e-4084-a8a4-4c23e3298f16\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49"
Sep 15 11:42:47.484244 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:47.483994    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkp9t\" (UniqueName: \"kubernetes.io/projected/7770d13b-3d5e-4084-a8a4-4c23e3298f16-kube-api-access-jkp9t\") pod \"maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49\" (UID: \"7770d13b-3d5e-4084-a8a4-4c23e3298f16\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49"
Sep 15 11:42:47.484244 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:47.484163    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7770d13b-3d5e-4084-a8a4-4c23e3298f16-maas-api-tls\") pod \"maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49\" (UID: \"7770d13b-3d5e-4084-a8a4-4c23e3298f16\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49"
Sep 15 11:42:47.585449 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:47.585398    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7770d13b-3d5e-4084-a8a4-4c23e3298f16-maas-api-tls\") pod \"maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49\" (UID: \"7770d13b-3d5e-4084-a8a4-4c23e3298f16\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49"
Sep 15 11:42:47.585719 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:47.585500    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7770d13b-3d5e-4084-a8a4-4c23e3298f16-openshift-service-ca\") pod \"maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49\" (UID: \"7770d13b-3d5e-4084-a8a4-4c23e3298f16\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49"
Sep 15 11:42:47.585719 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:47.585548    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7770d13b-3d5e-4084-a8a4-4c23e3298f16-metrics-certs\") pod \"maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49\" (UID: \"7770d13b-3d5e-4084-a8a4-4c23e3298f16\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49"
Sep 15 11:42:47.585719 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:42:47.585556    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-5f7ca109-serving-cert: secret "maas-api-e2e-mt-5f7ca109-serving-cert" not found
Sep 15 11:42:47.585719 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:42:47.585633    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7770d13b-3d5e-4084-a8a4-4c23e3298f16-maas-api-tls podName:7770d13b-3d5e-4084-a8a4-4c23e3298f16 nodeName:}" failed. No retries permitted until 2026-09-15 11:42:48.085612677 +0000 UTC m=+1038.511943251 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7770d13b-3d5e-4084-a8a4-4c23e3298f16-maas-api-tls") pod "maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49" (UID: "7770d13b-3d5e-4084-a8a4-4c23e3298f16") : secret "maas-api-e2e-mt-5f7ca109-serving-cert" not found
Sep 15 11:42:47.585719 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:47.585568    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkp9t\" (UniqueName: \"kubernetes.io/projected/7770d13b-3d5e-4084-a8a4-4c23e3298f16-kube-api-access-jkp9t\") pod \"maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49\" (UID: \"7770d13b-3d5e-4084-a8a4-4c23e3298f16\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49"
Sep 15 11:42:47.586255 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:47.586227    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7770d13b-3d5e-4084-a8a4-4c23e3298f16-openshift-service-ca\") pod \"maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49\" (UID: \"7770d13b-3d5e-4084-a8a4-4c23e3298f16\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49"
Sep 15 11:42:47.588206 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:47.588171    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7770d13b-3d5e-4084-a8a4-4c23e3298f16-metrics-certs\") pod \"maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49\" (UID: \"7770d13b-3d5e-4084-a8a4-4c23e3298f16\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49"
Sep 15 11:42:47.594517 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:47.594477    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkp9t\" (UniqueName: \"kubernetes.io/projected/7770d13b-3d5e-4084-a8a4-4c23e3298f16-kube-api-access-jkp9t\") pod \"maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49\" (UID: \"7770d13b-3d5e-4084-a8a4-4c23e3298f16\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49"
Sep 15 11:42:48.091461 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:48.091410    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7770d13b-3d5e-4084-a8a4-4c23e3298f16-maas-api-tls\") pod \"maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49\" (UID: \"7770d13b-3d5e-4084-a8a4-4c23e3298f16\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49"
Sep 15 11:42:48.096488 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:48.096456    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7770d13b-3d5e-4084-a8a4-4c23e3298f16-maas-api-tls\") pod \"maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49\" (UID: \"7770d13b-3d5e-4084-a8a4-4c23e3298f16\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49"
Sep 15 11:42:48.293591 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:48.293544    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49"
Sep 15 11:42:48.574751 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:48.574718    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49"]
Sep 15 11:42:48.576111 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:42:48.576081    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7770d13b_3d5e_4084_a8a4_4c23e3298f16.slice/crio-608eb8a2ec583a00d9f44fe04e8a3cc0a5e31acfd57904ccc7283f868b15d5e5 WatchSource:0}: Error finding container 608eb8a2ec583a00d9f44fe04e8a3cc0a5e31acfd57904ccc7283f868b15d5e5: Status 404 returned error can't find the container with id 608eb8a2ec583a00d9f44fe04e8a3cc0a5e31acfd57904ccc7283f868b15d5e5
Sep 15 11:42:49.411126 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:49.411087    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49" event={"ID":"7770d13b-3d5e-4084-a8a4-4c23e3298f16","Type":"ContainerStarted","Data":"9c18a1284b96f0fce0062e20f7b605cbb477dc37baaaf2da40a24dff96b64531"}
Sep 15 11:42:49.411344 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:49.411148    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49" event={"ID":"7770d13b-3d5e-4084-a8a4-4c23e3298f16","Type":"ContainerStarted","Data":"608eb8a2ec583a00d9f44fe04e8a3cc0a5e31acfd57904ccc7283f868b15d5e5"}
Sep 15 11:42:49.411344 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:49.411183    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49"
Sep 15 11:42:54.528947 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:54.528889    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49" podStartSLOduration=6.921483524 podStartE2EDuration="7.528868029s" totalImagesPullingTime="607.384505ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:42:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:42:49.430620063 +0000 UTC m=+1039.856950660" watchObservedRunningTime="2026-09-15 11:42:54.528868029 +0000 UTC m=+1044.955198625"
Sep 15 11:42:54.531516 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:54.531490    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-b8fbdd/e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs"]
Sep 15 11:42:54.535376 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:54.535357    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-b8fbdd/e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs"
Sep 15 11:42:54.538033 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:54.537998    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-b8fbdd\"/\"e2e-conflict-a-bc0d44e9-kserve-self-signed-certs\""
Sep 15 11:42:54.546804 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:54.546769    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-b8fbdd/e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs"]
Sep 15 11:42:54.661963 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:54.661921    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d62e3b8d-b1fd-424a-acde-90576844bb74-tls-certs\") pod \"e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs\" (UID: \"d62e3b8d-b1fd-424a-acde-90576844bb74\") " pod="e2e-models-e2e-worker-w4-b8fbdd/e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs"
Sep 15 11:42:54.662162 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:54.661979    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d62e3b8d-b1fd-424a-acde-90576844bb74-dshm\") pod \"e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs\" (UID: \"d62e3b8d-b1fd-424a-acde-90576844bb74\") " pod="e2e-models-e2e-worker-w4-b8fbdd/e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs"
Sep 15 11:42:54.662162 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:54.662072    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d62e3b8d-b1fd-424a-acde-90576844bb74-tmp-dir\") pod \"e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs\" (UID: \"d62e3b8d-b1fd-424a-acde-90576844bb74\") " pod="e2e-models-e2e-worker-w4-b8fbdd/e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs"
Sep 15 11:42:54.662162 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:54.662137    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d62e3b8d-b1fd-424a-acde-90576844bb74-model-cache\") pod \"e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs\" (UID: \"d62e3b8d-b1fd-424a-acde-90576844bb74\") " pod="e2e-models-e2e-worker-w4-b8fbdd/e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs"
Sep 15 11:42:54.662285 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:54.662252    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfshc\" (UniqueName: \"kubernetes.io/projected/d62e3b8d-b1fd-424a-acde-90576844bb74-kube-api-access-xfshc\") pod \"e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs\" (UID: \"d62e3b8d-b1fd-424a-acde-90576844bb74\") " pod="e2e-models-e2e-worker-w4-b8fbdd/e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs"
Sep 15 11:42:54.662285 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:54.662273    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d62e3b8d-b1fd-424a-acde-90576844bb74-home\") pod \"e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs\" (UID: \"d62e3b8d-b1fd-424a-acde-90576844bb74\") " pod="e2e-models-e2e-worker-w4-b8fbdd/e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs"
Sep 15 11:42:54.763350 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:54.763306    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d62e3b8d-b1fd-424a-acde-90576844bb74-model-cache\") pod \"e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs\" (UID: \"d62e3b8d-b1fd-424a-acde-90576844bb74\") " pod="e2e-models-e2e-worker-w4-b8fbdd/e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs"
Sep 15 11:42:54.763542 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:54.763422    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfshc\" (UniqueName: \"kubernetes.io/projected/d62e3b8d-b1fd-424a-acde-90576844bb74-kube-api-access-xfshc\") pod \"e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs\" (UID: \"d62e3b8d-b1fd-424a-acde-90576844bb74\") " pod="e2e-models-e2e-worker-w4-b8fbdd/e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs"
Sep 15 11:42:54.763542 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:54.763446    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d62e3b8d-b1fd-424a-acde-90576844bb74-home\") pod \"e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs\" (UID: \"d62e3b8d-b1fd-424a-acde-90576844bb74\") " pod="e2e-models-e2e-worker-w4-b8fbdd/e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs"
Sep 15 11:42:54.763542 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:54.763478    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d62e3b8d-b1fd-424a-acde-90576844bb74-tls-certs\") pod \"e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs\" (UID: \"d62e3b8d-b1fd-424a-acde-90576844bb74\") " pod="e2e-models-e2e-worker-w4-b8fbdd/e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs"
Sep 15 11:42:54.763542 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:54.763522    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d62e3b8d-b1fd-424a-acde-90576844bb74-dshm\") pod \"e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs\" (UID: \"d62e3b8d-b1fd-424a-acde-90576844bb74\") " pod="e2e-models-e2e-worker-w4-b8fbdd/e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs"
Sep 15 11:42:54.763800 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:54.763572    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d62e3b8d-b1fd-424a-acde-90576844bb74-tmp-dir\") pod \"e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs\" (UID: \"d62e3b8d-b1fd-424a-acde-90576844bb74\") " pod="e2e-models-e2e-worker-w4-b8fbdd/e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs"
Sep 15 11:42:54.763864 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:54.763822    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d62e3b8d-b1fd-424a-acde-90576844bb74-model-cache\") pod \"e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs\" (UID: \"d62e3b8d-b1fd-424a-acde-90576844bb74\") " pod="e2e-models-e2e-worker-w4-b8fbdd/e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs"
Sep 15 11:42:54.763919 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:54.763880    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d62e3b8d-b1fd-424a-acde-90576844bb74-home\") pod \"e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs\" (UID: \"d62e3b8d-b1fd-424a-acde-90576844bb74\") " pod="e2e-models-e2e-worker-w4-b8fbdd/e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs"
Sep 15 11:42:54.763919 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:54.763908    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d62e3b8d-b1fd-424a-acde-90576844bb74-tmp-dir\") pod \"e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs\" (UID: \"d62e3b8d-b1fd-424a-acde-90576844bb74\") " pod="e2e-models-e2e-worker-w4-b8fbdd/e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs"
Sep 15 11:42:54.765878 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:54.765854    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d62e3b8d-b1fd-424a-acde-90576844bb74-dshm\") pod \"e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs\" (UID: \"d62e3b8d-b1fd-424a-acde-90576844bb74\") " pod="e2e-models-e2e-worker-w4-b8fbdd/e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs"
Sep 15 11:42:54.766142 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:54.766125    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d62e3b8d-b1fd-424a-acde-90576844bb74-tls-certs\") pod \"e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs\" (UID: \"d62e3b8d-b1fd-424a-acde-90576844bb74\") " pod="e2e-models-e2e-worker-w4-b8fbdd/e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs"
Sep 15 11:42:54.771597 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:54.771568    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfshc\" (UniqueName: \"kubernetes.io/projected/d62e3b8d-b1fd-424a-acde-90576844bb74-kube-api-access-xfshc\") pod \"e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs\" (UID: \"d62e3b8d-b1fd-424a-acde-90576844bb74\") " pod="e2e-models-e2e-worker-w4-b8fbdd/e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs"
Sep 15 11:42:54.845781 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:54.845728    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-b8fbdd/e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs"
Sep 15 11:42:55.125828 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:55.125780    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-b8fbdd/e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs"]
Sep 15 11:42:55.126572 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:42:55.126544    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd62e3b8d_b1fd_424a_acde_90576844bb74.slice/crio-795987bc6825c1eaf091c1708b474708a7c23c9cb8edb4f994e043255eb1560b WatchSource:0}: Error finding container 795987bc6825c1eaf091c1708b474708a7c23c9cb8edb4f994e043255eb1560b: Status 404 returned error can't find the container with id 795987bc6825c1eaf091c1708b474708a7c23c9cb8edb4f994e043255eb1560b
Sep 15 11:42:55.423155 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:55.423066    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49"
Sep 15 11:42:55.460234 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:55.459988    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-b8fbdd/e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs" event={"ID":"d62e3b8d-b1fd-424a-acde-90576844bb74","Type":"ContainerStarted","Data":"0fc1d0e7c0f3f2c03301f19d1d623cdf8bfd736a3c1a9d22b160d01b735eae9c"}
Sep 15 11:42:55.460234 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:55.460054    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-b8fbdd/e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs" event={"ID":"d62e3b8d-b1fd-424a-acde-90576844bb74","Type":"ContainerStarted","Data":"795987bc6825c1eaf091c1708b474708a7c23c9cb8edb4f994e043255eb1560b"}
Sep 15 11:42:55.479556 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:42:55.479432    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-b8fbdd/e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs" podStartSLOduration=1.479410022 podStartE2EDuration="1.479410022s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:42:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:42:55.477887177 +0000 UTC m=+1045.904217769" watchObservedRunningTime="2026-09-15 11:42:55.479410022 +0000 UTC m=+1045.905740622"
Sep 15 11:43:04.846861 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:04.846811    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-b8fbdd/e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs"
Sep 15 11:43:04.847340 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:04.846880    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-b8fbdd/e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs"
Sep 15 11:43:04.860484 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:04.860451    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-b8fbdd/e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs"
Sep 15 11:43:05.538577 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:05.538537    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-b8fbdd/e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs"
Sep 15 11:43:07.757886 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:07.757842    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q"]
Sep 15 11:43:07.758408 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:07.758087    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q" podUID="5c640e0e-a05a-4c4e-9988-40d4ffac5464" containerName="maas-api" containerID="cri-o://1c6eadd8acb631f7b6cdaf6534564c954d8dbd8081d5c56c3bad6ac596f690a8" gracePeriod=30
Sep 15 11:43:08.023299 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:08.023226    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q"
Sep 15 11:43:08.112135 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:08.112097    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c640e0e-a05a-4c4e-9988-40d4ffac5464-maas-api-tls\") pod \"5c640e0e-a05a-4c4e-9988-40d4ffac5464\" (UID: \"5c640e0e-a05a-4c4e-9988-40d4ffac5464\") "
Sep 15 11:43:08.112348 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:08.112228    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrp5g\" (UniqueName: \"kubernetes.io/projected/5c640e0e-a05a-4c4e-9988-40d4ffac5464-kube-api-access-lrp5g\") pod \"5c640e0e-a05a-4c4e-9988-40d4ffac5464\" (UID: \"5c640e0e-a05a-4c4e-9988-40d4ffac5464\") "
Sep 15 11:43:08.112348 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:08.112287    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c640e0e-a05a-4c4e-9988-40d4ffac5464-metrics-certs\") pod \"5c640e0e-a05a-4c4e-9988-40d4ffac5464\" (UID: \"5c640e0e-a05a-4c4e-9988-40d4ffac5464\") "
Sep 15 11:43:08.112480 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:08.112355    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c640e0e-a05a-4c4e-9988-40d4ffac5464-openshift-service-ca\") pod \"5c640e0e-a05a-4c4e-9988-40d4ffac5464\" (UID: \"5c640e0e-a05a-4c4e-9988-40d4ffac5464\") "
Sep 15 11:43:08.112808 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:08.112771    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c640e0e-a05a-4c4e-9988-40d4ffac5464-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5c640e0e-a05a-4c4e-9988-40d4ffac5464" (UID: "5c640e0e-a05a-4c4e-9988-40d4ffac5464"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:43:08.114483 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:08.114454    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c640e0e-a05a-4c4e-9988-40d4ffac5464-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5c640e0e-a05a-4c4e-9988-40d4ffac5464" (UID: "5c640e0e-a05a-4c4e-9988-40d4ffac5464"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:43:08.114483 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:08.114475    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c640e0e-a05a-4c4e-9988-40d4ffac5464-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5c640e0e-a05a-4c4e-9988-40d4ffac5464" (UID: "5c640e0e-a05a-4c4e-9988-40d4ffac5464"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:43:08.114692 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:08.114545    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c640e0e-a05a-4c4e-9988-40d4ffac5464-kube-api-access-lrp5g" (OuterVolumeSpecName: "kube-api-access-lrp5g") pod "5c640e0e-a05a-4c4e-9988-40d4ffac5464" (UID: "5c640e0e-a05a-4c4e-9988-40d4ffac5464"). InnerVolumeSpecName "kube-api-access-lrp5g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:43:08.214616 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:08.214580    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c640e0e-a05a-4c4e-9988-40d4ffac5464-openshift-service-ca\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:43:08.214616 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:08.214614    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c640e0e-a05a-4c4e-9988-40d4ffac5464-maas-api-tls\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:43:08.214855 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:08.214628    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrp5g\" (UniqueName: \"kubernetes.io/projected/5c640e0e-a05a-4c4e-9988-40d4ffac5464-kube-api-access-lrp5g\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:43:08.214855 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:08.214641    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c640e0e-a05a-4c4e-9988-40d4ffac5464-metrics-certs\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:43:08.549298 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:08.549266    2575 generic.go:356] "Generic (PLEG): container finished" podID="5c640e0e-a05a-4c4e-9988-40d4ffac5464" containerID="1c6eadd8acb631f7b6cdaf6534564c954d8dbd8081d5c56c3bad6ac596f690a8" exitCode=0
Sep 15 11:43:08.549298 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:08.549309    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q"
Sep 15 11:43:08.549536 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:08.549353    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q" event={"ID":"5c640e0e-a05a-4c4e-9988-40d4ffac5464","Type":"ContainerDied","Data":"1c6eadd8acb631f7b6cdaf6534564c954d8dbd8081d5c56c3bad6ac596f690a8"}
Sep 15 11:43:08.549536 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:08.549409    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q" event={"ID":"5c640e0e-a05a-4c4e-9988-40d4ffac5464","Type":"ContainerDied","Data":"5746e414ebaa0ec6ea92a21d798cea5e40ecb996ed7516a23932623723997107"}
Sep 15 11:43:08.549536 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:08.549436    2575 scope.go:117] "RemoveContainer" containerID="1c6eadd8acb631f7b6cdaf6534564c954d8dbd8081d5c56c3bad6ac596f690a8"
Sep 15 11:43:08.560428 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:08.560408    2575 scope.go:117] "RemoveContainer" containerID="1c6eadd8acb631f7b6cdaf6534564c954d8dbd8081d5c56c3bad6ac596f690a8"
Sep 15 11:43:08.560801 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:43:08.560776    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c6eadd8acb631f7b6cdaf6534564c954d8dbd8081d5c56c3bad6ac596f690a8\": container with ID starting with 1c6eadd8acb631f7b6cdaf6534564c954d8dbd8081d5c56c3bad6ac596f690a8 not found: ID does not exist" containerID="1c6eadd8acb631f7b6cdaf6534564c954d8dbd8081d5c56c3bad6ac596f690a8"
Sep 15 11:43:08.560872 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:08.560813    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c6eadd8acb631f7b6cdaf6534564c954d8dbd8081d5c56c3bad6ac596f690a8"} err="failed to get container status \"1c6eadd8acb631f7b6cdaf6534564c954d8dbd8081d5c56c3bad6ac596f690a8\": rpc error: code = NotFound desc = could not find container \"1c6eadd8acb631f7b6cdaf6534564c954d8dbd8081d5c56c3bad6ac596f690a8\": container with ID starting with 1c6eadd8acb631f7b6cdaf6534564c954d8dbd8081d5c56c3bad6ac596f690a8 not found: ID does not exist"
Sep 15 11:43:08.626916 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:08.626878    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q"]
Sep 15 11:43:08.640766 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:08.640734    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-a73e48-6b48c4fb49-4wx8q"]
Sep 15 11:43:10.100982 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:10.100948    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c640e0e-a05a-4c4e-9988-40d4ffac5464" path="/var/lib/kubelet/pods/5c640e0e-a05a-4c4e-9988-40d4ffac5464/volumes"
Sep 15 11:43:24.120282 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:24.120192    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49"]
Sep 15 11:43:24.120827 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:24.120478    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49" podUID="7770d13b-3d5e-4084-a8a4-4c23e3298f16" containerName="maas-api" containerID="cri-o://9c18a1284b96f0fce0062e20f7b605cbb477dc37baaaf2da40a24dff96b64531" gracePeriod=30
Sep 15 11:43:24.386118 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:24.386035    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49"
Sep 15 11:43:24.502118 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:24.502080    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7770d13b-3d5e-4084-a8a4-4c23e3298f16-maas-api-tls\") pod \"7770d13b-3d5e-4084-a8a4-4c23e3298f16\" (UID: \"7770d13b-3d5e-4084-a8a4-4c23e3298f16\") "
Sep 15 11:43:24.502340 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:24.502188    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7770d13b-3d5e-4084-a8a4-4c23e3298f16-metrics-certs\") pod \"7770d13b-3d5e-4084-a8a4-4c23e3298f16\" (UID: \"7770d13b-3d5e-4084-a8a4-4c23e3298f16\") "
Sep 15 11:43:24.502340 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:24.502313    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7770d13b-3d5e-4084-a8a4-4c23e3298f16-openshift-service-ca\") pod \"7770d13b-3d5e-4084-a8a4-4c23e3298f16\" (UID: \"7770d13b-3d5e-4084-a8a4-4c23e3298f16\") "
Sep 15 11:43:24.502340 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:24.502332    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jkp9t\" (UniqueName: \"kubernetes.io/projected/7770d13b-3d5e-4084-a8a4-4c23e3298f16-kube-api-access-jkp9t\") pod \"7770d13b-3d5e-4084-a8a4-4c23e3298f16\" (UID: \"7770d13b-3d5e-4084-a8a4-4c23e3298f16\") "
Sep 15 11:43:24.502777 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:24.502730    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7770d13b-3d5e-4084-a8a4-4c23e3298f16-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7770d13b-3d5e-4084-a8a4-4c23e3298f16" (UID: "7770d13b-3d5e-4084-a8a4-4c23e3298f16"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:43:24.504503 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:24.504458    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7770d13b-3d5e-4084-a8a4-4c23e3298f16-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7770d13b-3d5e-4084-a8a4-4c23e3298f16" (UID: "7770d13b-3d5e-4084-a8a4-4c23e3298f16"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:43:24.504634 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:24.504503    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7770d13b-3d5e-4084-a8a4-4c23e3298f16-kube-api-access-jkp9t" (OuterVolumeSpecName: "kube-api-access-jkp9t") pod "7770d13b-3d5e-4084-a8a4-4c23e3298f16" (UID: "7770d13b-3d5e-4084-a8a4-4c23e3298f16"). InnerVolumeSpecName "kube-api-access-jkp9t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:43:24.504634 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:24.504512    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7770d13b-3d5e-4084-a8a4-4c23e3298f16-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7770d13b-3d5e-4084-a8a4-4c23e3298f16" (UID: "7770d13b-3d5e-4084-a8a4-4c23e3298f16"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:43:24.603366 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:24.603327    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7770d13b-3d5e-4084-a8a4-4c23e3298f16-openshift-service-ca\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:43:24.603366 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:24.603360    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jkp9t\" (UniqueName: \"kubernetes.io/projected/7770d13b-3d5e-4084-a8a4-4c23e3298f16-kube-api-access-jkp9t\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:43:24.603366 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:24.603370    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7770d13b-3d5e-4084-a8a4-4c23e3298f16-maas-api-tls\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:43:24.603366 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:24.603381    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7770d13b-3d5e-4084-a8a4-4c23e3298f16-metrics-certs\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:43:24.662800 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:24.662704    2575 generic.go:356] "Generic (PLEG): container finished" podID="7770d13b-3d5e-4084-a8a4-4c23e3298f16" containerID="9c18a1284b96f0fce0062e20f7b605cbb477dc37baaaf2da40a24dff96b64531" exitCode=0
Sep 15 11:43:24.662800 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:24.662757    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49" event={"ID":"7770d13b-3d5e-4084-a8a4-4c23e3298f16","Type":"ContainerDied","Data":"9c18a1284b96f0fce0062e20f7b605cbb477dc37baaaf2da40a24dff96b64531"}
Sep 15 11:43:24.662800 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:24.662797    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49" event={"ID":"7770d13b-3d5e-4084-a8a4-4c23e3298f16","Type":"ContainerDied","Data":"608eb8a2ec583a00d9f44fe04e8a3cc0a5e31acfd57904ccc7283f868b15d5e5"}
Sep 15 11:43:24.663081 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:24.662820    2575 scope.go:117] "RemoveContainer" containerID="9c18a1284b96f0fce0062e20f7b605cbb477dc37baaaf2da40a24dff96b64531"
Sep 15 11:43:24.663081 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:24.662758    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49"
Sep 15 11:43:24.673890 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:24.673864    2575 scope.go:117] "RemoveContainer" containerID="9c18a1284b96f0fce0062e20f7b605cbb477dc37baaaf2da40a24dff96b64531"
Sep 15 11:43:24.674262 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:43:24.674241    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c18a1284b96f0fce0062e20f7b605cbb477dc37baaaf2da40a24dff96b64531\": container with ID starting with 9c18a1284b96f0fce0062e20f7b605cbb477dc37baaaf2da40a24dff96b64531 not found: ID does not exist" containerID="9c18a1284b96f0fce0062e20f7b605cbb477dc37baaaf2da40a24dff96b64531"
Sep 15 11:43:24.674340 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:24.674277    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c18a1284b96f0fce0062e20f7b605cbb477dc37baaaf2da40a24dff96b64531"} err="failed to get container status \"9c18a1284b96f0fce0062e20f7b605cbb477dc37baaaf2da40a24dff96b64531\": rpc error: code = NotFound desc = could not find container \"9c18a1284b96f0fce0062e20f7b605cbb477dc37baaaf2da40a24dff96b64531\": container with ID starting with 9c18a1284b96f0fce0062e20f7b605cbb477dc37baaaf2da40a24dff96b64531 not found: ID does not exist"
Sep 15 11:43:24.685154 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:24.685112    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49"]
Sep 15 11:43:24.689246 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:24.689211    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5f7ca109-6c84c767d4-wzb49"]
Sep 15 11:43:26.095675 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:43:26.095625    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7770d13b-3d5e-4084-a8a4-4c23e3298f16" path="/var/lib/kubelet/pods/7770d13b-3d5e-4084-a8a4-4c23e3298f16/volumes"
Sep 15 11:44:26.941735 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:26.941682    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r"]
Sep 15 11:44:26.943432 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:26.943397    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7770d13b-3d5e-4084-a8a4-4c23e3298f16" containerName="maas-api"
Sep 15 11:44:26.943432 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:26.943432    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7770d13b-3d5e-4084-a8a4-4c23e3298f16" containerName="maas-api"
Sep 15 11:44:26.943609 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:26.943514    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c640e0e-a05a-4c4e-9988-40d4ffac5464" containerName="maas-api"
Sep 15 11:44:26.943609 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:26.943526    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c640e0e-a05a-4c4e-9988-40d4ffac5464" containerName="maas-api"
Sep 15 11:44:26.943755 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:26.943732    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7770d13b-3d5e-4084-a8a4-4c23e3298f16" containerName="maas-api"
Sep 15 11:44:26.943873 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:26.943765    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c640e0e-a05a-4c4e-9988-40d4ffac5464" containerName="maas-api"
Sep 15 11:44:26.951185 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:26.951149    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r"
Sep 15 11:44:26.953217 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:26.953188    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r"]
Sep 15 11:44:26.953782 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:26.953634    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-d63075-serving-cert\""
Sep 15 11:44:26.996375 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:26.996332    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7bc61c5-d351-449c-9086-27016d1be019-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r\" (UID: \"a7bc61c5-d351-449c-9086-27016d1be019\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r"
Sep 15 11:44:26.996560 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:26.996447    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7bc61c5-d351-449c-9086-27016d1be019-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r\" (UID: \"a7bc61c5-d351-449c-9086-27016d1be019\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r"
Sep 15 11:44:26.996560 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:26.996489    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7bc61c5-d351-449c-9086-27016d1be019-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r\" (UID: \"a7bc61c5-d351-449c-9086-27016d1be019\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r"
Sep 15 11:44:26.996636 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:26.996577    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l65z\" (UniqueName: \"kubernetes.io/projected/a7bc61c5-d351-449c-9086-27016d1be019-kube-api-access-6l65z\") pod \"maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r\" (UID: \"a7bc61c5-d351-449c-9086-27016d1be019\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r"
Sep 15 11:44:27.097402 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:27.097347    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7bc61c5-d351-449c-9086-27016d1be019-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r\" (UID: \"a7bc61c5-d351-449c-9086-27016d1be019\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r"
Sep 15 11:44:27.097620 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:44:27.097481    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d63075-serving-cert: secret "maas-api-e2e-shared-b-w2-d63075-serving-cert" not found
Sep 15 11:44:27.097620 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:44:27.097540    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7bc61c5-d351-449c-9086-27016d1be019-maas-api-tls podName:a7bc61c5-d351-449c-9086-27016d1be019 nodeName:}" failed. No retries permitted until 2026-09-15 11:44:27.597518065 +0000 UTC m=+1138.023848639 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a7bc61c5-d351-449c-9086-27016d1be019-maas-api-tls") pod "maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r" (UID: "a7bc61c5-d351-449c-9086-27016d1be019") : secret "maas-api-e2e-shared-b-w2-d63075-serving-cert" not found
Sep 15 11:44:27.097620 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:27.097561    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7bc61c5-d351-449c-9086-27016d1be019-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r\" (UID: \"a7bc61c5-d351-449c-9086-27016d1be019\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r"
Sep 15 11:44:27.097793 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:27.097699    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l65z\" (UniqueName: \"kubernetes.io/projected/a7bc61c5-d351-449c-9086-27016d1be019-kube-api-access-6l65z\") pod \"maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r\" (UID: \"a7bc61c5-d351-449c-9086-27016d1be019\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r"
Sep 15 11:44:27.097829 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:27.097813    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7bc61c5-d351-449c-9086-27016d1be019-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r\" (UID: \"a7bc61c5-d351-449c-9086-27016d1be019\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r"
Sep 15 11:44:27.098286 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:27.098265    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7bc61c5-d351-449c-9086-27016d1be019-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r\" (UID: \"a7bc61c5-d351-449c-9086-27016d1be019\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r"
Sep 15 11:44:27.100312 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:27.100290    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7bc61c5-d351-449c-9086-27016d1be019-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r\" (UID: \"a7bc61c5-d351-449c-9086-27016d1be019\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r"
Sep 15 11:44:27.106255 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:27.106228    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l65z\" (UniqueName: \"kubernetes.io/projected/a7bc61c5-d351-449c-9086-27016d1be019-kube-api-access-6l65z\") pod \"maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r\" (UID: \"a7bc61c5-d351-449c-9086-27016d1be019\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r"
Sep 15 11:44:27.602425 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:27.602390    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7bc61c5-d351-449c-9086-27016d1be019-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r\" (UID: \"a7bc61c5-d351-449c-9086-27016d1be019\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r"
Sep 15 11:44:27.605301 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:27.605269    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7bc61c5-d351-449c-9086-27016d1be019-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r\" (UID: \"a7bc61c5-d351-449c-9086-27016d1be019\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r"
Sep 15 11:44:27.865293 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:27.865137    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r"
Sep 15 11:44:28.142999 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:28.142970    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r"]
Sep 15 11:44:28.144603 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:44:28.144569    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7bc61c5_d351_449c_9086_27016d1be019.slice/crio-4da852ed9a374d81f305833fd8df815437086cdfad70a2e76b17f50bc9bcbd62 WatchSource:0}: Error finding container 4da852ed9a374d81f305833fd8df815437086cdfad70a2e76b17f50bc9bcbd62: Status 404 returned error can't find the container with id 4da852ed9a374d81f305833fd8df815437086cdfad70a2e76b17f50bc9bcbd62
Sep 15 11:44:29.088058 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:29.088025    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r" event={"ID":"a7bc61c5-d351-449c-9086-27016d1be019","Type":"ContainerStarted","Data":"9324f74ed5838b898eccf854cbb0a28ffce50a3548e8b8c67a677cbe81fa1300"}
Sep 15 11:44:29.088257 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:29.088080    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r" event={"ID":"a7bc61c5-d351-449c-9086-27016d1be019","Type":"ContainerStarted","Data":"4da852ed9a374d81f305833fd8df815437086cdfad70a2e76b17f50bc9bcbd62"}
Sep 15 11:44:29.088257 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:29.088153    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r"
Sep 15 11:44:29.109009 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:29.108952    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r" podStartSLOduration=2.711790914 podStartE2EDuration="3.108932916s" totalImagesPullingTime="397.142002ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:44:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:44:29.106075193 +0000 UTC m=+1139.532405788" watchObservedRunningTime="2026-09-15 11:44:29.108932916 +0000 UTC m=+1139.535263512"
Sep 15 11:44:35.101618 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:35.101582    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r"
Sep 15 11:44:53.445800 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:53.445711    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-6e996c/distinct-w0-6e996c-kserve-846f8969b7-956r5"]
Sep 15 11:44:53.450091 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:53.450065    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-6e996c/distinct-w0-6e996c-kserve-846f8969b7-956r5"
Sep 15 11:44:53.452268 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:53.452238    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-6e996c\"/\"distinct-w0-6e996c-kserve-self-signed-certs\""
Sep 15 11:44:53.460103 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:53.460069    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-6e996c/distinct-w0-6e996c-kserve-846f8969b7-956r5"]
Sep 15 11:44:53.595528 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:53.595477    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4bpz\" (UniqueName: \"kubernetes.io/projected/c747b133-059b-4acc-a048-0e40df3a9cd1-kube-api-access-r4bpz\") pod \"distinct-w0-6e996c-kserve-846f8969b7-956r5\" (UID: \"c747b133-059b-4acc-a048-0e40df3a9cd1\") " pod="e2e-models-e2e-worker-w0-6e996c/distinct-w0-6e996c-kserve-846f8969b7-956r5"
Sep 15 11:44:53.595767 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:53.595542    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c747b133-059b-4acc-a048-0e40df3a9cd1-tls-certs\") pod \"distinct-w0-6e996c-kserve-846f8969b7-956r5\" (UID: \"c747b133-059b-4acc-a048-0e40df3a9cd1\") " pod="e2e-models-e2e-worker-w0-6e996c/distinct-w0-6e996c-kserve-846f8969b7-956r5"
Sep 15 11:44:53.595767 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:53.595587    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c747b133-059b-4acc-a048-0e40df3a9cd1-home\") pod \"distinct-w0-6e996c-kserve-846f8969b7-956r5\" (UID: \"c747b133-059b-4acc-a048-0e40df3a9cd1\") " pod="e2e-models-e2e-worker-w0-6e996c/distinct-w0-6e996c-kserve-846f8969b7-956r5"
Sep 15 11:44:53.595767 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:53.595612    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c747b133-059b-4acc-a048-0e40df3a9cd1-model-cache\") pod \"distinct-w0-6e996c-kserve-846f8969b7-956r5\" (UID: \"c747b133-059b-4acc-a048-0e40df3a9cd1\") " pod="e2e-models-e2e-worker-w0-6e996c/distinct-w0-6e996c-kserve-846f8969b7-956r5"
Sep 15 11:44:53.595767 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:53.595759    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c747b133-059b-4acc-a048-0e40df3a9cd1-dshm\") pod \"distinct-w0-6e996c-kserve-846f8969b7-956r5\" (UID: \"c747b133-059b-4acc-a048-0e40df3a9cd1\") " pod="e2e-models-e2e-worker-w0-6e996c/distinct-w0-6e996c-kserve-846f8969b7-956r5"
Sep 15 11:44:53.595983 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:53.595817    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c747b133-059b-4acc-a048-0e40df3a9cd1-tmp-dir\") pod \"distinct-w0-6e996c-kserve-846f8969b7-956r5\" (UID: \"c747b133-059b-4acc-a048-0e40df3a9cd1\") " pod="e2e-models-e2e-worker-w0-6e996c/distinct-w0-6e996c-kserve-846f8969b7-956r5"
Sep 15 11:44:53.696910 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:53.696806    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c747b133-059b-4acc-a048-0e40df3a9cd1-dshm\") pod \"distinct-w0-6e996c-kserve-846f8969b7-956r5\" (UID: \"c747b133-059b-4acc-a048-0e40df3a9cd1\") " pod="e2e-models-e2e-worker-w0-6e996c/distinct-w0-6e996c-kserve-846f8969b7-956r5"
Sep 15 11:44:53.696910 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:53.696868    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c747b133-059b-4acc-a048-0e40df3a9cd1-tmp-dir\") pod \"distinct-w0-6e996c-kserve-846f8969b7-956r5\" (UID: \"c747b133-059b-4acc-a048-0e40df3a9cd1\") " pod="e2e-models-e2e-worker-w0-6e996c/distinct-w0-6e996c-kserve-846f8969b7-956r5"
Sep 15 11:44:53.697161 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:53.696972    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4bpz\" (UniqueName: \"kubernetes.io/projected/c747b133-059b-4acc-a048-0e40df3a9cd1-kube-api-access-r4bpz\") pod \"distinct-w0-6e996c-kserve-846f8969b7-956r5\" (UID: \"c747b133-059b-4acc-a048-0e40df3a9cd1\") " pod="e2e-models-e2e-worker-w0-6e996c/distinct-w0-6e996c-kserve-846f8969b7-956r5"
Sep 15 11:44:53.697161 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:53.697010    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c747b133-059b-4acc-a048-0e40df3a9cd1-tls-certs\") pod \"distinct-w0-6e996c-kserve-846f8969b7-956r5\" (UID: \"c747b133-059b-4acc-a048-0e40df3a9cd1\") " pod="e2e-models-e2e-worker-w0-6e996c/distinct-w0-6e996c-kserve-846f8969b7-956r5"
Sep 15 11:44:53.697161 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:53.697041    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c747b133-059b-4acc-a048-0e40df3a9cd1-home\") pod \"distinct-w0-6e996c-kserve-846f8969b7-956r5\" (UID: \"c747b133-059b-4acc-a048-0e40df3a9cd1\") " pod="e2e-models-e2e-worker-w0-6e996c/distinct-w0-6e996c-kserve-846f8969b7-956r5"
Sep 15 11:44:53.697161 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:53.697063    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c747b133-059b-4acc-a048-0e40df3a9cd1-model-cache\") pod \"distinct-w0-6e996c-kserve-846f8969b7-956r5\" (UID: \"c747b133-059b-4acc-a048-0e40df3a9cd1\") " pod="e2e-models-e2e-worker-w0-6e996c/distinct-w0-6e996c-kserve-846f8969b7-956r5"
Sep 15 11:44:53.697377 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:53.697351    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c747b133-059b-4acc-a048-0e40df3a9cd1-tmp-dir\") pod \"distinct-w0-6e996c-kserve-846f8969b7-956r5\" (UID: \"c747b133-059b-4acc-a048-0e40df3a9cd1\") " pod="e2e-models-e2e-worker-w0-6e996c/distinct-w0-6e996c-kserve-846f8969b7-956r5"
Sep 15 11:44:53.697431 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:53.697372    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c747b133-059b-4acc-a048-0e40df3a9cd1-home\") pod \"distinct-w0-6e996c-kserve-846f8969b7-956r5\" (UID: \"c747b133-059b-4acc-a048-0e40df3a9cd1\") " pod="e2e-models-e2e-worker-w0-6e996c/distinct-w0-6e996c-kserve-846f8969b7-956r5"
Sep 15 11:44:53.697481 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:53.697443    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c747b133-059b-4acc-a048-0e40df3a9cd1-model-cache\") pod \"distinct-w0-6e996c-kserve-846f8969b7-956r5\" (UID: \"c747b133-059b-4acc-a048-0e40df3a9cd1\") " pod="e2e-models-e2e-worker-w0-6e996c/distinct-w0-6e996c-kserve-846f8969b7-956r5"
Sep 15 11:44:53.699321 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:53.699300    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c747b133-059b-4acc-a048-0e40df3a9cd1-dshm\") pod \"distinct-w0-6e996c-kserve-846f8969b7-956r5\" (UID: \"c747b133-059b-4acc-a048-0e40df3a9cd1\") " pod="e2e-models-e2e-worker-w0-6e996c/distinct-w0-6e996c-kserve-846f8969b7-956r5"
Sep 15 11:44:53.699609 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:53.699591    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c747b133-059b-4acc-a048-0e40df3a9cd1-tls-certs\") pod \"distinct-w0-6e996c-kserve-846f8969b7-956r5\" (UID: \"c747b133-059b-4acc-a048-0e40df3a9cd1\") " pod="e2e-models-e2e-worker-w0-6e996c/distinct-w0-6e996c-kserve-846f8969b7-956r5"
Sep 15 11:44:53.705435 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:53.705405    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4bpz\" (UniqueName: \"kubernetes.io/projected/c747b133-059b-4acc-a048-0e40df3a9cd1-kube-api-access-r4bpz\") pod \"distinct-w0-6e996c-kserve-846f8969b7-956r5\" (UID: \"c747b133-059b-4acc-a048-0e40df3a9cd1\") " pod="e2e-models-e2e-worker-w0-6e996c/distinct-w0-6e996c-kserve-846f8969b7-956r5"
Sep 15 11:44:53.762495 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:53.762455    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-6e996c/distinct-w0-6e996c-kserve-846f8969b7-956r5"
Sep 15 11:44:54.046718 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:54.046686    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-6e996c/distinct-w0-6e996c-kserve-846f8969b7-956r5"]
Sep 15 11:44:54.049389 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:44:54.049357    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc747b133_059b_4acc_a048_0e40df3a9cd1.slice/crio-80cd7832c36d31032779a9e9ccd8cddfb78e02f108fc3910aba732261077cfed WatchSource:0}: Error finding container 80cd7832c36d31032779a9e9ccd8cddfb78e02f108fc3910aba732261077cfed: Status 404 returned error can't find the container with id 80cd7832c36d31032779a9e9ccd8cddfb78e02f108fc3910aba732261077cfed
Sep 15 11:44:54.260116 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:54.260075    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-6e996c/distinct-w0-6e996c-kserve-846f8969b7-956r5" event={"ID":"c747b133-059b-4acc-a048-0e40df3a9cd1","Type":"ContainerStarted","Data":"1c2ff9a8463e02a389fa73cb3f98ba6eec16139b7daa28e828628ce934bff420"}
Sep 15 11:44:54.260329 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:54.260126    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-6e996c/distinct-w0-6e996c-kserve-846f8969b7-956r5" event={"ID":"c747b133-059b-4acc-a048-0e40df3a9cd1","Type":"ContainerStarted","Data":"80cd7832c36d31032779a9e9ccd8cddfb78e02f108fc3910aba732261077cfed"}
Sep 15 11:44:54.281011 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:54.280936    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-6e996c/distinct-w0-6e996c-kserve-846f8969b7-956r5" podStartSLOduration=1.28091017 podStartE2EDuration="1.28091017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:44:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:44:54.277237916 +0000 UTC m=+1164.703568512" watchObservedRunningTime="2026-09-15 11:44:54.28091017 +0000 UTC m=+1164.707240774"
Sep 15 11:44:55.917736 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:55.917694    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7456-dbefca"]
Sep 15 11:44:55.921543 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:55.921521    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7456-dbefca"
Sep 15 11:44:55.924000 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:55.923977    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-lfxxr\""
Sep 15 11:44:55.929899 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:55.929868    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7456-dbefca"]
Sep 15 11:44:56.023341 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:56.023300    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsv79\" (UniqueName: \"kubernetes.io/projected/37dd943e-3f2f-43da-a313-34785397d70d-kube-api-access-vsv79\") pod \"test-curl-7456-dbefca\" (UID: \"37dd943e-3f2f-43da-a313-34785397d70d\") " pod="opendatahub/test-curl-7456-dbefca"
Sep 15 11:44:56.124399 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:56.124354    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsv79\" (UniqueName: \"kubernetes.io/projected/37dd943e-3f2f-43da-a313-34785397d70d-kube-api-access-vsv79\") pod \"test-curl-7456-dbefca\" (UID: \"37dd943e-3f2f-43da-a313-34785397d70d\") " pod="opendatahub/test-curl-7456-dbefca"
Sep 15 11:44:56.132915 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:56.132887    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsv79\" (UniqueName: \"kubernetes.io/projected/37dd943e-3f2f-43da-a313-34785397d70d-kube-api-access-vsv79\") pod \"test-curl-7456-dbefca\" (UID: \"37dd943e-3f2f-43da-a313-34785397d70d\") " pod="opendatahub/test-curl-7456-dbefca"
Sep 15 11:44:56.234710 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:56.234579    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7456-dbefca"
Sep 15 11:44:56.510407 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:56.510375    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7456-dbefca"]
Sep 15 11:44:56.511902 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:44:56.511866    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod37dd943e_3f2f_43da_a313_34785397d70d.slice/crio-3f1599c564ee26f7bb6152d70829f8db3193723eee197eed9f8d22a1ee232edd WatchSource:0}: Error finding container 3f1599c564ee26f7bb6152d70829f8db3193723eee197eed9f8d22a1ee232edd: Status 404 returned error can't find the container with id 3f1599c564ee26f7bb6152d70829f8db3193723eee197eed9f8d22a1ee232edd
Sep 15 11:44:57.282240 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:57.282214    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7456-dbefca" event={"ID":"37dd943e-3f2f-43da-a313-34785397d70d","Type":"ContainerStarted","Data":"3f1599c564ee26f7bb6152d70829f8db3193723eee197eed9f8d22a1ee232edd"}
Sep 15 11:44:58.290769 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:58.290729    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7456-dbefca" event={"ID":"37dd943e-3f2f-43da-a313-34785397d70d","Type":"ContainerStarted","Data":"9232d7e537ba1d03d6fd063b244912566ecd5953b5588a16967a8c646541dca3"}
Sep 15 11:44:58.307871 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:58.307819    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7456-dbefca" podStartSLOduration=2.556889474 podStartE2EDuration="3.307800092s" totalImagesPullingTime="750.910618ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:44:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:44:58.305055114 +0000 UTC m=+1168.731385709" watchObservedRunningTime="2026-09-15 11:44:58.307800092 +0000 UTC m=+1168.734130690"
Sep 15 11:44:58.903606 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:58.903546    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7456-dbefca"]
Sep 15 11:44:58.907732 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:58.907694    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7456-dbefca"]
Sep 15 11:44:59.017610 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:59.017517    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7456-b71185"]
Sep 15 11:44:59.018103 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:59.018085    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37dd943e-3f2f-43da-a313-34785397d70d" containerName="test-curl-7456-dbefca"
Sep 15 11:44:59.018151 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:59.018105    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="37dd943e-3f2f-43da-a313-34785397d70d" containerName="test-curl-7456-dbefca"
Sep 15 11:44:59.018200 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:59.018191    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="37dd943e-3f2f-43da-a313-34785397d70d" containerName="test-curl-7456-dbefca"
Sep 15 11:44:59.021465 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:59.021445    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7456-b71185"
Sep 15 11:44:59.030018 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:59.029983    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7456-b71185"]
Sep 15 11:44:59.056167 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:59.056131    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spld6\" (UniqueName: \"kubernetes.io/projected/385afa55-7281-4a89-962e-a972a788a73c-kube-api-access-spld6\") pod \"test-curl-7456-b71185\" (UID: \"385afa55-7281-4a89-962e-a972a788a73c\") " pod="opendatahub/test-curl-7456-b71185"
Sep 15 11:44:59.157067 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:59.157024    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spld6\" (UniqueName: \"kubernetes.io/projected/385afa55-7281-4a89-962e-a972a788a73c-kube-api-access-spld6\") pod \"test-curl-7456-b71185\" (UID: \"385afa55-7281-4a89-962e-a972a788a73c\") " pod="opendatahub/test-curl-7456-b71185"
Sep 15 11:44:59.168199 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:59.168170    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spld6\" (UniqueName: \"kubernetes.io/projected/385afa55-7281-4a89-962e-a972a788a73c-kube-api-access-spld6\") pod \"test-curl-7456-b71185\" (UID: \"385afa55-7281-4a89-962e-a972a788a73c\") " pod="opendatahub/test-curl-7456-b71185"
Sep 15 11:44:59.297378 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:44:59.297285    2575 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7456-dbefca" container="test-curl-7456-dbefca"
Sep 15 11:44:59.334263 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:59.334209    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7456-b71185"
Sep 15 11:44:59.614150 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:44:59.614116    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7456-b71185"]
Sep 15 11:44:59.615009 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:44:59.614979    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod385afa55_7281_4a89_962e_a972a788a73c.slice/crio-93a91e4ab9565a9a5194c39a2c811a7dd1eebe7eb47eb4f04086888d3daf27a7 WatchSource:0}: Error finding container 93a91e4ab9565a9a5194c39a2c811a7dd1eebe7eb47eb4f04086888d3daf27a7: Status 404 returned error can't find the container with id 93a91e4ab9565a9a5194c39a2c811a7dd1eebe7eb47eb4f04086888d3daf27a7
Sep 15 11:45:00.150190 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:00.150156    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9fc4b9-29824545-rcqq5"]
Sep 15 11:45:00.153986 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:00.153958    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-5a8d6f-29824545-sqsms"]
Sep 15 11:45:00.154127 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:00.154079    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9fc4b9-29824545-rcqq5"
Sep 15 11:45:00.158093 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:00.158063    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rbxjk\""
Sep 15 11:45:00.158255 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:00.158111    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-5a8d6f-29824545-sqsms"
Sep 15 11:45:00.166186 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:00.166165    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9fc4b9-29824545-rcqq5"
Sep 15 11:45:00.173269 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:00.173235    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-5a8d6f-29824545-sqsms"]
Sep 15 11:45:00.175557 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:00.175531    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-5a8d6f-29824545-sqsms"
Sep 15 11:45:00.190618 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:00.190531    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9fc4b9-29824545-rcqq5"]
Sep 15 11:45:00.194100 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:00.194070    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-6e996c-29824545-7hrrt"]
Sep 15 11:45:00.199019 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:00.198979    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-6e996c-29824545-7hrrt"
Sep 15 11:45:00.207184 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:00.206976    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-6e996c-29824545-7hrrt"]
Sep 15 11:45:00.237765 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:00.237727    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-6e996c-29824545-7hrrt"
Sep 15 11:45:00.306692 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:00.306627    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7456-dbefca" podUID="37dd943e-3f2f-43da-a313-34785397d70d" containerName="test-curl-7456-dbefca" containerID="cri-o://9232d7e537ba1d03d6fd063b244912566ecd5953b5588a16967a8c646541dca3" gracePeriod=2
Sep 15 11:45:00.307213 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:00.307190    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7456-b71185" event={"ID":"385afa55-7281-4a89-962e-a972a788a73c","Type":"ContainerStarted","Data":"968ac266bd43c697cb6b57f97fe3e6ee62deab7855a530d303a798b989135883"}
Sep 15 11:45:00.307266 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:00.307229    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7456-b71185" event={"ID":"385afa55-7281-4a89-962e-a972a788a73c","Type":"ContainerStarted","Data":"93a91e4ab9565a9a5194c39a2c811a7dd1eebe7eb47eb4f04086888d3daf27a7"}
Sep 15 11:45:00.326902 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:00.326836    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7456-b71185" podStartSLOduration=1.326810746 podStartE2EDuration="1.326810746s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:44:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:45:00.325386666 +0000 UTC m=+1170.751717274" watchObservedRunningTime="2026-09-15 11:45:00.326810746 +0000 UTC m=+1170.753141341"
Sep 15 11:45:00.483783 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:00.483620    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9fc4b9-29824545-rcqq5"]
Sep 15 11:45:00.486956 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:45:00.486926    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5f15be2_f897_40ce_a00c_1d2f2537ae42.slice/crio-7361a043b27c0c2ed13ccac8fae0a34c5113d1b56cc9d2bdfd308efa92dd06a5 WatchSource:0}: Error finding container 7361a043b27c0c2ed13ccac8fae0a34c5113d1b56cc9d2bdfd308efa92dd06a5: Status 404 returned error can't find the container with id 7361a043b27c0c2ed13ccac8fae0a34c5113d1b56cc9d2bdfd308efa92dd06a5
Sep 15 11:45:00.488093 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:00.488046    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-5a8d6f-29824545-sqsms"]
Sep 15 11:45:00.489416 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:45:00.489393    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbe9a2a7_0523_4dad_aab9_3a2fff38bcf5.slice/crio-e15e0dc0c9cf1c5d8aeb03bdb85f589ddf2ddaac91f20f6da7b1fd1fd578ad58 WatchSource:0}: Error finding container e15e0dc0c9cf1c5d8aeb03bdb85f589ddf2ddaac91f20f6da7b1fd1fd578ad58: Status 404 returned error can't find the container with id e15e0dc0c9cf1c5d8aeb03bdb85f589ddf2ddaac91f20f6da7b1fd1fd578ad58
Sep 15 11:45:00.551036 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:00.551005    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-6e996c-29824545-7hrrt"]
Sep 15 11:45:00.552542 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:45:00.552515    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28e6506e_6947_4c57_bd3b_38c78e5e95a5.slice/crio-fddd192bf0ba7bfb722990ef21148f8f6a08a1046637d7bc4708608bb63a7365 WatchSource:0}: Error finding container fddd192bf0ba7bfb722990ef21148f8f6a08a1046637d7bc4708608bb63a7365: Status 404 returned error can't find the container with id fddd192bf0ba7bfb722990ef21148f8f6a08a1046637d7bc4708608bb63a7365
Sep 15 11:45:00.920869 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:00.920770    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7456-b71185"]
Sep 15 11:45:00.925964 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:00.925928    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7456-b71185"]
Sep 15 11:45:01.314823 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:01.314789    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9fc4b9-29824545-rcqq5" event={"ID":"bbe9a2a7-0523-4dad-aab9-3a2fff38bcf5","Type":"ContainerStarted","Data":"25fb1d9c5a83e39f045148ec4d02724755e36ebd10499796bb98ac3dbd4155e2"}
Sep 15 11:45:01.315322 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:01.314853    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9fc4b9-29824545-rcqq5" event={"ID":"bbe9a2a7-0523-4dad-aab9-3a2fff38bcf5","Type":"ContainerStarted","Data":"e15e0dc0c9cf1c5d8aeb03bdb85f589ddf2ddaac91f20f6da7b1fd1fd578ad58"}
Sep 15 11:45:01.320965 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:01.320929    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-6e996c-29824545-7hrrt" event={"ID":"28e6506e-6947-4c57-bd3b-38c78e5e95a5","Type":"ContainerStarted","Data":"b1a710688b1ddb888fa6a9963fbc6833531748de58f692c90333985dada8bd74"}
Sep 15 11:45:01.321148 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:01.320991    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-6e996c-29824545-7hrrt" event={"ID":"28e6506e-6947-4c57-bd3b-38c78e5e95a5","Type":"ContainerStarted","Data":"fddd192bf0ba7bfb722990ef21148f8f6a08a1046637d7bc4708608bb63a7365"}
Sep 15 11:45:01.322824 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:01.322788    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-5a8d6f-29824545-sqsms" event={"ID":"c5f15be2-f897-40ce-a00c-1d2f2537ae42","Type":"ContainerStarted","Data":"2e0af1df352b061cc5c205b10b6df0633f269fe6c5322a50a61fc9effec7f808"}
Sep 15 11:45:01.322993 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:01.322850    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-5a8d6f-29824545-sqsms" event={"ID":"c5f15be2-f897-40ce-a00c-1d2f2537ae42","Type":"ContainerStarted","Data":"7361a043b27c0c2ed13ccac8fae0a34c5113d1b56cc9d2bdfd308efa92dd06a5"}
Sep 15 11:45:01.323081 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:45:01.323004    2575 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7456-b71185" container="test-curl-7456-b71185"
Sep 15 11:45:01.331076 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:01.331018    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9fc4b9-29824545-rcqq5" podStartSLOduration=1.33100008 podStartE2EDuration="1.33100008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:45:01.330405776 +0000 UTC m=+1171.756736374" watchObservedRunningTime="2026-09-15 11:45:01.33100008 +0000 UTC m=+1171.757330687"
Sep 15 11:45:01.346224 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:01.346164    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-6e996c-29824545-7hrrt" podStartSLOduration=1.346143944 podStartE2EDuration="1.346143944s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:45:01.343970466 +0000 UTC m=+1171.770301062" watchObservedRunningTime="2026-09-15 11:45:01.346143944 +0000 UTC m=+1171.772474540"
Sep 15 11:45:01.358236 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:01.358172    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-5a8d6f-29824545-sqsms" podStartSLOduration=1.358148499 podStartE2EDuration="1.358148499s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:45:01.358031074 +0000 UTC m=+1171.784361673" watchObservedRunningTime="2026-09-15 11:45:01.358148499 +0000 UTC m=+1171.784479098"
Sep 15 11:45:02.331970 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:02.331939    2575 generic.go:356] "Generic (PLEG): container finished" podID="28e6506e-6947-4c57-bd3b-38c78e5e95a5" containerID="b1a710688b1ddb888fa6a9963fbc6833531748de58f692c90333985dada8bd74" exitCode=0
Sep 15 11:45:02.332415 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:02.332017    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-6e996c-29824545-7hrrt" event={"ID":"28e6506e-6947-4c57-bd3b-38c78e5e95a5","Type":"ContainerDied","Data":"b1a710688b1ddb888fa6a9963fbc6833531748de58f692c90333985dada8bd74"}
Sep 15 11:45:02.333908 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:02.333886    2575 generic.go:356] "Generic (PLEG): container finished" podID="c5f15be2-f897-40ce-a00c-1d2f2537ae42" containerID="2e0af1df352b061cc5c205b10b6df0633f269fe6c5322a50a61fc9effec7f808" exitCode=0
Sep 15 11:45:02.334029 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:02.333937    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-5a8d6f-29824545-sqsms" event={"ID":"c5f15be2-f897-40ce-a00c-1d2f2537ae42","Type":"ContainerDied","Data":"2e0af1df352b061cc5c205b10b6df0633f269fe6c5322a50a61fc9effec7f808"}
Sep 15 11:45:02.335696 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:02.335627    2575 generic.go:356] "Generic (PLEG): container finished" podID="bbe9a2a7-0523-4dad-aab9-3a2fff38bcf5" containerID="25fb1d9c5a83e39f045148ec4d02724755e36ebd10499796bb98ac3dbd4155e2" exitCode=0
Sep 15 11:45:02.335696 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:02.335688    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9fc4b9-29824545-rcqq5" event={"ID":"bbe9a2a7-0523-4dad-aab9-3a2fff38bcf5","Type":"ContainerDied","Data":"25fb1d9c5a83e39f045148ec4d02724755e36ebd10499796bb98ac3dbd4155e2"}
Sep 15 11:45:02.335841 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:02.335768    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7456-b71185" podUID="385afa55-7281-4a89-962e-a972a788a73c" containerName="test-curl-7456-b71185" containerID="cri-o://968ac266bd43c697cb6b57f97fe3e6ee62deab7855a530d303a798b989135883" gracePeriod=2
Sep 15 11:45:02.512464 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:02.512437    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7456-dbefca"
Sep 15 11:45:02.613716 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:02.613637    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vsv79\" (UniqueName: \"kubernetes.io/projected/37dd943e-3f2f-43da-a313-34785397d70d-kube-api-access-vsv79\") pod \"37dd943e-3f2f-43da-a313-34785397d70d\" (UID: \"37dd943e-3f2f-43da-a313-34785397d70d\") "
Sep 15 11:45:02.615984 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:02.615952    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37dd943e-3f2f-43da-a313-34785397d70d-kube-api-access-vsv79" (OuterVolumeSpecName: "kube-api-access-vsv79") pod "37dd943e-3f2f-43da-a313-34785397d70d" (UID: "37dd943e-3f2f-43da-a313-34785397d70d"). InnerVolumeSpecName "kube-api-access-vsv79". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:45:02.715383 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:02.715341    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vsv79\" (UniqueName: \"kubernetes.io/projected/37dd943e-3f2f-43da-a313-34785397d70d-kube-api-access-vsv79\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:45:03.344127 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:03.344085    2575 generic.go:356] "Generic (PLEG): container finished" podID="37dd943e-3f2f-43da-a313-34785397d70d" containerID="9232d7e537ba1d03d6fd063b244912566ecd5953b5588a16967a8c646541dca3" exitCode=137
Sep 15 11:45:03.344610 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:03.344152    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7456-dbefca"
Sep 15 11:45:03.344610 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:03.344195    2575 scope.go:117] "RemoveContainer" containerID="9232d7e537ba1d03d6fd063b244912566ecd5953b5588a16967a8c646541dca3"
Sep 15 11:45:03.357978 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:03.357956    2575 scope.go:117] "RemoveContainer" containerID="9232d7e537ba1d03d6fd063b244912566ecd5953b5588a16967a8c646541dca3"
Sep 15 11:45:03.358444 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:45:03.358414    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9232d7e537ba1d03d6fd063b244912566ecd5953b5588a16967a8c646541dca3\": container with ID starting with 9232d7e537ba1d03d6fd063b244912566ecd5953b5588a16967a8c646541dca3 not found: ID does not exist" containerID="9232d7e537ba1d03d6fd063b244912566ecd5953b5588a16967a8c646541dca3"
Sep 15 11:45:03.358558 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:03.358452    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9232d7e537ba1d03d6fd063b244912566ecd5953b5588a16967a8c646541dca3"} err="failed to get container status \"9232d7e537ba1d03d6fd063b244912566ecd5953b5588a16967a8c646541dca3\": rpc error: code = NotFound desc = could not find container \"9232d7e537ba1d03d6fd063b244912566ecd5953b5588a16967a8c646541dca3\": container with ID starting with 9232d7e537ba1d03d6fd063b244912566ecd5953b5588a16967a8c646541dca3 not found: ID does not exist"
Sep 15 11:45:03.358974 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:45:03.358939    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7456-dbefca\" is forbidden: User \"system:node:ip-10-0-132-240.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-240.ec2.internal' and this object" podUID="37dd943e-3f2f-43da-a313-34785397d70d" pod="opendatahub/test-curl-7456-dbefca"
Sep 15 11:45:03.520753 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:03.520718    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-5a8d6f-29824545-sqsms"
Sep 15 11:45:03.538060 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:45:03.538010    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7456-dbefca\" is forbidden: User \"system:node:ip-10-0-132-240.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-240.ec2.internal' and this object" podUID="37dd943e-3f2f-43da-a313-34785397d70d" pod="opendatahub/test-curl-7456-dbefca"
Sep 15 11:45:03.568179 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:03.568149    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9fc4b9-29824545-rcqq5"
Sep 15 11:45:03.570262 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:45:03.570223    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7456-dbefca\" is forbidden: User \"system:node:ip-10-0-132-240.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-240.ec2.internal' and this object" podUID="37dd943e-3f2f-43da-a313-34785397d70d" pod="opendatahub/test-curl-7456-dbefca"
Sep 15 11:45:03.571926 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:03.571906    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-6e996c-29824545-7hrrt"
Sep 15 11:45:03.602568 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:45:03.602441    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7456-dbefca\" is forbidden: User \"system:node:ip-10-0-132-240.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-240.ec2.internal' and this object" podUID="37dd943e-3f2f-43da-a313-34785397d70d" pod="opendatahub/test-curl-7456-dbefca"
Sep 15 11:45:03.763547 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:03.763495    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-6e996c/distinct-w0-6e996c-kserve-846f8969b7-956r5"
Sep 15 11:45:03.763771 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:03.763567    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-6e996c/distinct-w0-6e996c-kserve-846f8969b7-956r5"
Sep 15 11:45:03.776549 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:03.776521    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-6e996c/distinct-w0-6e996c-kserve-846f8969b7-956r5"
Sep 15 11:45:03.778349 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:45:03.778320    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7456-dbefca\" is forbidden: User \"system:node:ip-10-0-132-240.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-240.ec2.internal' and this object" podUID="37dd943e-3f2f-43da-a313-34785397d70d" pod="opendatahub/test-curl-7456-dbefca"
Sep 15 11:45:04.094853 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:04.094809    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37dd943e-3f2f-43da-a313-34785397d70d" path="/var/lib/kubelet/pods/37dd943e-3f2f-43da-a313-34785397d70d/volumes"
Sep 15 11:45:04.352835 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:04.352799    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9fc4b9-29824545-rcqq5"
Sep 15 11:45:04.352835 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:04.352821    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9fc4b9-29824545-rcqq5" event={"ID":"bbe9a2a7-0523-4dad-aab9-3a2fff38bcf5","Type":"ContainerDied","Data":"e15e0dc0c9cf1c5d8aeb03bdb85f589ddf2ddaac91f20f6da7b1fd1fd578ad58"}
Sep 15 11:45:04.353268 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:04.352880    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e15e0dc0c9cf1c5d8aeb03bdb85f589ddf2ddaac91f20f6da7b1fd1fd578ad58"
Sep 15 11:45:04.355279 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:04.355258    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-6e996c-29824545-7hrrt"
Sep 15 11:45:04.355423 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:04.355260    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-6e996c-29824545-7hrrt" event={"ID":"28e6506e-6947-4c57-bd3b-38c78e5e95a5","Type":"ContainerDied","Data":"fddd192bf0ba7bfb722990ef21148f8f6a08a1046637d7bc4708608bb63a7365"}
Sep 15 11:45:04.355423 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:04.355377    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fddd192bf0ba7bfb722990ef21148f8f6a08a1046637d7bc4708608bb63a7365"
Sep 15 11:45:04.356638 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:04.356610    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-5a8d6f-29824545-sqsms"
Sep 15 11:45:04.356797 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:04.356643    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-5a8d6f-29824545-sqsms" event={"ID":"c5f15be2-f897-40ce-a00c-1d2f2537ae42","Type":"ContainerDied","Data":"7361a043b27c0c2ed13ccac8fae0a34c5113d1b56cc9d2bdfd308efa92dd06a5"}
Sep 15 11:45:04.356797 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:04.356710    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7361a043b27c0c2ed13ccac8fae0a34c5113d1b56cc9d2bdfd308efa92dd06a5"
Sep 15 11:45:04.368562 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:04.368533    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-6e996c/distinct-w0-6e996c-kserve-846f8969b7-956r5"
Sep 15 11:45:04.554771 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:04.554742    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7456-b71185"
Sep 15 11:45:04.641157 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:04.641061    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spld6\" (UniqueName: \"kubernetes.io/projected/385afa55-7281-4a89-962e-a972a788a73c-kube-api-access-spld6\") pod \"385afa55-7281-4a89-962e-a972a788a73c\" (UID: \"385afa55-7281-4a89-962e-a972a788a73c\") "
Sep 15 11:45:04.643196 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:04.643158    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/385afa55-7281-4a89-962e-a972a788a73c-kube-api-access-spld6" (OuterVolumeSpecName: "kube-api-access-spld6") pod "385afa55-7281-4a89-962e-a972a788a73c" (UID: "385afa55-7281-4a89-962e-a972a788a73c"). InnerVolumeSpecName "kube-api-access-spld6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:45:04.742872 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:04.742815    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spld6\" (UniqueName: \"kubernetes.io/projected/385afa55-7281-4a89-962e-a972a788a73c-kube-api-access-spld6\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:45:05.365210 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:05.365178    2575 generic.go:356] "Generic (PLEG): container finished" podID="385afa55-7281-4a89-962e-a972a788a73c" containerID="968ac266bd43c697cb6b57f97fe3e6ee62deab7855a530d303a798b989135883" exitCode=137
Sep 15 11:45:05.365744 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:05.365219    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7456-b71185"
Sep 15 11:45:05.365744 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:05.365294    2575 scope.go:117] "RemoveContainer" containerID="968ac266bd43c697cb6b57f97fe3e6ee62deab7855a530d303a798b989135883"
Sep 15 11:45:05.375783 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:45:05.375751    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7456-b71185\" is forbidden: User \"system:node:ip-10-0-132-240.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-240.ec2.internal' and this object" podUID="385afa55-7281-4a89-962e-a972a788a73c" pod="opendatahub/test-curl-7456-b71185"
Sep 15 11:45:05.376107 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:05.376088    2575 scope.go:117] "RemoveContainer" containerID="968ac266bd43c697cb6b57f97fe3e6ee62deab7855a530d303a798b989135883"
Sep 15 11:45:05.376450 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:45:05.376430    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"968ac266bd43c697cb6b57f97fe3e6ee62deab7855a530d303a798b989135883\": container with ID starting with 968ac266bd43c697cb6b57f97fe3e6ee62deab7855a530d303a798b989135883 not found: ID does not exist" containerID="968ac266bd43c697cb6b57f97fe3e6ee62deab7855a530d303a798b989135883"
Sep 15 11:45:05.376525 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:05.376458    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"968ac266bd43c697cb6b57f97fe3e6ee62deab7855a530d303a798b989135883"} err="failed to get container status \"968ac266bd43c697cb6b57f97fe3e6ee62deab7855a530d303a798b989135883\": rpc error: code = NotFound desc = could not find container \"968ac266bd43c697cb6b57f97fe3e6ee62deab7855a530d303a798b989135883\": container with ID starting with 968ac266bd43c697cb6b57f97fe3e6ee62deab7855a530d303a798b989135883 not found: ID does not exist"
Sep 15 11:45:06.094754 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:06.094720    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="385afa55-7281-4a89-962e-a972a788a73c" path="/var/lib/kubelet/pods/385afa55-7281-4a89-962e-a972a788a73c/volumes"
Sep 15 11:45:12.658378 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:12.658328    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-baee2b93-86c695f8d5-v796c"]
Sep 15 11:45:12.659138 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:12.659113    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="385afa55-7281-4a89-962e-a972a788a73c" containerName="test-curl-7456-b71185"
Sep 15 11:45:12.659188 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:12.659144    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="385afa55-7281-4a89-962e-a972a788a73c" containerName="test-curl-7456-b71185"
Sep 15 11:45:12.659220 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:12.659189    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5f15be2-f897-40ce-a00c-1d2f2537ae42" containerName="cleanup"
Sep 15 11:45:12.659220 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:12.659198    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5f15be2-f897-40ce-a00c-1d2f2537ae42" containerName="cleanup"
Sep 15 11:45:12.659325 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:12.659232    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28e6506e-6947-4c57-bd3b-38c78e5e95a5" containerName="cleanup"
Sep 15 11:45:12.659325 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:12.659243    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="28e6506e-6947-4c57-bd3b-38c78e5e95a5" containerName="cleanup"
Sep 15 11:45:12.659325 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:12.659254    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbe9a2a7-0523-4dad-aab9-3a2fff38bcf5" containerName="cleanup"
Sep 15 11:45:12.659325 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:12.659262    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbe9a2a7-0523-4dad-aab9-3a2fff38bcf5" containerName="cleanup"
Sep 15 11:45:12.659450 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:12.659364    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbe9a2a7-0523-4dad-aab9-3a2fff38bcf5" containerName="cleanup"
Sep 15 11:45:12.659450 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:12.659379    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5f15be2-f897-40ce-a00c-1d2f2537ae42" containerName="cleanup"
Sep 15 11:45:12.659450 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:12.659391    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="28e6506e-6947-4c57-bd3b-38c78e5e95a5" containerName="cleanup"
Sep 15 11:45:12.659450 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:12.659403    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="385afa55-7281-4a89-962e-a972a788a73c" containerName="test-curl-7456-b71185"
Sep 15 11:45:12.664793 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:12.664763    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-baee2b93-86c695f8d5-v796c"
Sep 15 11:45:12.667753 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:12.667722    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-baee2b93-serving-cert\""
Sep 15 11:45:12.677510 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:12.677197    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-baee2b93-86c695f8d5-v796c"]
Sep 15 11:45:12.838064 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:12.838020    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d7178e6-9d58-4803-b60f-7b14a30ab686-metrics-certs\") pod \"maas-api-e2e-mt-baee2b93-86c695f8d5-v796c\" (UID: \"5d7178e6-9d58-4803-b60f-7b14a30ab686\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-baee2b93-86c695f8d5-v796c"
Sep 15 11:45:12.838266 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:12.838072    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x45qb\" (UniqueName: \"kubernetes.io/projected/5d7178e6-9d58-4803-b60f-7b14a30ab686-kube-api-access-x45qb\") pod \"maas-api-e2e-mt-baee2b93-86c695f8d5-v796c\" (UID: \"5d7178e6-9d58-4803-b60f-7b14a30ab686\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-baee2b93-86c695f8d5-v796c"
Sep 15 11:45:12.838266 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:12.838102    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d7178e6-9d58-4803-b60f-7b14a30ab686-openshift-service-ca\") pod \"maas-api-e2e-mt-baee2b93-86c695f8d5-v796c\" (UID: \"5d7178e6-9d58-4803-b60f-7b14a30ab686\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-baee2b93-86c695f8d5-v796c"
Sep 15 11:45:12.838266 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:12.838165    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d7178e6-9d58-4803-b60f-7b14a30ab686-maas-api-tls\") pod \"maas-api-e2e-mt-baee2b93-86c695f8d5-v796c\" (UID: \"5d7178e6-9d58-4803-b60f-7b14a30ab686\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-baee2b93-86c695f8d5-v796c"
Sep 15 11:45:12.939610 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:12.939503    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d7178e6-9d58-4803-b60f-7b14a30ab686-metrics-certs\") pod \"maas-api-e2e-mt-baee2b93-86c695f8d5-v796c\" (UID: \"5d7178e6-9d58-4803-b60f-7b14a30ab686\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-baee2b93-86c695f8d5-v796c"
Sep 15 11:45:12.939610 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:12.939562    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x45qb\" (UniqueName: \"kubernetes.io/projected/5d7178e6-9d58-4803-b60f-7b14a30ab686-kube-api-access-x45qb\") pod \"maas-api-e2e-mt-baee2b93-86c695f8d5-v796c\" (UID: \"5d7178e6-9d58-4803-b60f-7b14a30ab686\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-baee2b93-86c695f8d5-v796c"
Sep 15 11:45:12.939610 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:12.939599    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d7178e6-9d58-4803-b60f-7b14a30ab686-openshift-service-ca\") pod \"maas-api-e2e-mt-baee2b93-86c695f8d5-v796c\" (UID: \"5d7178e6-9d58-4803-b60f-7b14a30ab686\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-baee2b93-86c695f8d5-v796c"
Sep 15 11:45:12.939928 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:12.939830    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d7178e6-9d58-4803-b60f-7b14a30ab686-maas-api-tls\") pod \"maas-api-e2e-mt-baee2b93-86c695f8d5-v796c\" (UID: \"5d7178e6-9d58-4803-b60f-7b14a30ab686\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-baee2b93-86c695f8d5-v796c"
Sep 15 11:45:12.940430 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:12.940408    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d7178e6-9d58-4803-b60f-7b14a30ab686-openshift-service-ca\") pod \"maas-api-e2e-mt-baee2b93-86c695f8d5-v796c\" (UID: \"5d7178e6-9d58-4803-b60f-7b14a30ab686\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-baee2b93-86c695f8d5-v796c"
Sep 15 11:45:12.942729 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:12.942707    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d7178e6-9d58-4803-b60f-7b14a30ab686-metrics-certs\") pod \"maas-api-e2e-mt-baee2b93-86c695f8d5-v796c\" (UID: \"5d7178e6-9d58-4803-b60f-7b14a30ab686\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-baee2b93-86c695f8d5-v796c"
Sep 15 11:45:12.942903 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:12.942879    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d7178e6-9d58-4803-b60f-7b14a30ab686-maas-api-tls\") pod \"maas-api-e2e-mt-baee2b93-86c695f8d5-v796c\" (UID: \"5d7178e6-9d58-4803-b60f-7b14a30ab686\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-baee2b93-86c695f8d5-v796c"
Sep 15 11:45:12.948944 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:12.948914    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x45qb\" (UniqueName: \"kubernetes.io/projected/5d7178e6-9d58-4803-b60f-7b14a30ab686-kube-api-access-x45qb\") pod \"maas-api-e2e-mt-baee2b93-86c695f8d5-v796c\" (UID: \"5d7178e6-9d58-4803-b60f-7b14a30ab686\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-baee2b93-86c695f8d5-v796c"
Sep 15 11:45:12.980860 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:12.980816    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-baee2b93-86c695f8d5-v796c"
Sep 15 11:45:13.273727 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:13.273688    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-baee2b93-86c695f8d5-v796c"]
Sep 15 11:45:13.274690 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:45:13.274630    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d7178e6_9d58_4803_b60f_7b14a30ab686.slice/crio-b9f0e09393e99dc159f06989609d0073ffb34243bd3ea78da9020355711458fe WatchSource:0}: Error finding container b9f0e09393e99dc159f06989609d0073ffb34243bd3ea78da9020355711458fe: Status 404 returned error can't find the container with id b9f0e09393e99dc159f06989609d0073ffb34243bd3ea78da9020355711458fe
Sep 15 11:45:13.425568 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:13.425528    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-baee2b93-86c695f8d5-v796c" event={"ID":"5d7178e6-9d58-4803-b60f-7b14a30ab686","Type":"ContainerStarted","Data":"b9f0e09393e99dc159f06989609d0073ffb34243bd3ea78da9020355711458fe"}
Sep 15 11:45:14.435035 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:14.434980    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-baee2b93-86c695f8d5-v796c" event={"ID":"5d7178e6-9d58-4803-b60f-7b14a30ab686","Type":"ContainerStarted","Data":"623d133db40eea67cc96bc3eee7b638bfcb43e763927277fd42312ea3ada7e93"}
Sep 15 11:45:14.435447 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:14.435075    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-baee2b93-86c695f8d5-v796c"
Sep 15 11:45:14.454172 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:14.454113    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-baee2b93-86c695f8d5-v796c" podStartSLOduration=1.9436950400000002 podStartE2EDuration="2.454095537s" totalImagesPullingTime="510.400497ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:45:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:45:14.451768999 +0000 UTC m=+1184.878099595" watchObservedRunningTime="2026-09-15 11:45:14.454095537 +0000 UTC m=+1184.880426184"
Sep 15 11:45:20.448304 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:20.448275    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-baee2b93-86c695f8d5-v796c"
Sep 15 11:45:30.614802 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:30.614765    2575 scope.go:117] "RemoveContainer" containerID="846fb547e8649fa9ae6d45f48df93ca86ee25efa1413995ec30314df0f073227"
Sep 15 11:45:30.624783 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:30.624757    2575 scope.go:117] "RemoveContainer" containerID="119a729661b719cbe02f22f8ab582e15243ce227741e785b919c9a3cd2d45545"
Sep 15 11:45:45.813630 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:45.813587    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9fc4b9-29824545-rcqq5"]
Sep 15 11:45:45.816861 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:45.816834    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9fc4b9-29824545-rcqq5"]
Sep 15 11:45:46.094888 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:46.094852    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbe9a2a7-0523-4dad-aab9-3a2fff38bcf5" path="/var/lib/kubelet/pods/bbe9a2a7-0523-4dad-aab9-3a2fff38bcf5/volumes"
Sep 15 11:45:51.355760 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:45:51.355716    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-9fc4b9/test-model-9fc4b9-kserve-76c4469b8c-bbtwr"]
Sep 15 11:46:06.376570 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:06.376517    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-9fc4b9/test-model-9fc4b9-kserve-76c4469b8c-bbtwr" podUID="817afd82-9ae4-43ae-8ade-b3bf74be97c6" containerName="main" containerID="cri-o://5022a007e495fe304ed18aa0263b2d6451dc858750709a8cafd4ff08d4f24c6b" gracePeriod=45
Sep 15 11:46:06.536136 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:06.536082    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-inf-a-9fc4b9/test-model-9fc4b9-kserve-76c4469b8c-bbtwr" podUID="817afd82-9ae4-43ae-8ade-b3bf74be97c6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.64:8000/ready\": dial tcp 10.134.0.64:8000: connect: connection refused"
Sep 15 11:46:06.627789 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:06.627705    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-9fc4b9/test-model-9fc4b9-kserve-76c4469b8c-bbtwr"
Sep 15 11:46:06.746223 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:06.746187    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/817afd82-9ae4-43ae-8ade-b3bf74be97c6-tls-certs\") pod \"817afd82-9ae4-43ae-8ade-b3bf74be97c6\" (UID: \"817afd82-9ae4-43ae-8ade-b3bf74be97c6\") "
Sep 15 11:46:06.746223 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:06.746231    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/817afd82-9ae4-43ae-8ade-b3bf74be97c6-dshm\") pod \"817afd82-9ae4-43ae-8ade-b3bf74be97c6\" (UID: \"817afd82-9ae4-43ae-8ade-b3bf74be97c6\") "
Sep 15 11:46:06.746478 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:06.746316    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/817afd82-9ae4-43ae-8ade-b3bf74be97c6-home\") pod \"817afd82-9ae4-43ae-8ade-b3bf74be97c6\" (UID: \"817afd82-9ae4-43ae-8ade-b3bf74be97c6\") "
Sep 15 11:46:06.746478 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:06.746358    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/817afd82-9ae4-43ae-8ade-b3bf74be97c6-model-cache\") pod \"817afd82-9ae4-43ae-8ade-b3bf74be97c6\" (UID: \"817afd82-9ae4-43ae-8ade-b3bf74be97c6\") "
Sep 15 11:46:06.746478 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:06.746428    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/817afd82-9ae4-43ae-8ade-b3bf74be97c6-tmp-dir\") pod \"817afd82-9ae4-43ae-8ade-b3bf74be97c6\" (UID: \"817afd82-9ae4-43ae-8ade-b3bf74be97c6\") "
Sep 15 11:46:06.746644 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:06.746481    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m92m7\" (UniqueName: \"kubernetes.io/projected/817afd82-9ae4-43ae-8ade-b3bf74be97c6-kube-api-access-m92m7\") pod \"817afd82-9ae4-43ae-8ade-b3bf74be97c6\" (UID: \"817afd82-9ae4-43ae-8ade-b3bf74be97c6\") "
Sep 15 11:46:06.746745 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:06.746705    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/817afd82-9ae4-43ae-8ade-b3bf74be97c6-home" (OuterVolumeSpecName: "home") pod "817afd82-9ae4-43ae-8ade-b3bf74be97c6" (UID: "817afd82-9ae4-43ae-8ade-b3bf74be97c6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:46:06.746745 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:06.746691    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/817afd82-9ae4-43ae-8ade-b3bf74be97c6-model-cache" (OuterVolumeSpecName: "model-cache") pod "817afd82-9ae4-43ae-8ade-b3bf74be97c6" (UID: "817afd82-9ae4-43ae-8ade-b3bf74be97c6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:46:06.746833 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:06.746769    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/817afd82-9ae4-43ae-8ade-b3bf74be97c6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "817afd82-9ae4-43ae-8ade-b3bf74be97c6" (UID: "817afd82-9ae4-43ae-8ade-b3bf74be97c6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:46:06.747010 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:06.746992    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/817afd82-9ae4-43ae-8ade-b3bf74be97c6-home\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:46:06.747205 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:06.747012    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/817afd82-9ae4-43ae-8ade-b3bf74be97c6-model-cache\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:46:06.747205 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:06.747024    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/817afd82-9ae4-43ae-8ade-b3bf74be97c6-tmp-dir\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:46:06.748670 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:06.748632    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/817afd82-9ae4-43ae-8ade-b3bf74be97c6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "817afd82-9ae4-43ae-8ade-b3bf74be97c6" (UID: "817afd82-9ae4-43ae-8ade-b3bf74be97c6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:46:06.748670 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:06.748635    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/817afd82-9ae4-43ae-8ade-b3bf74be97c6-dshm" (OuterVolumeSpecName: "dshm") pod "817afd82-9ae4-43ae-8ade-b3bf74be97c6" (UID: "817afd82-9ae4-43ae-8ade-b3bf74be97c6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:46:06.748811 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:06.748677    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/817afd82-9ae4-43ae-8ade-b3bf74be97c6-kube-api-access-m92m7" (OuterVolumeSpecName: "kube-api-access-m92m7") pod "817afd82-9ae4-43ae-8ade-b3bf74be97c6" (UID: "817afd82-9ae4-43ae-8ade-b3bf74be97c6"). InnerVolumeSpecName "kube-api-access-m92m7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:46:06.790489 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:06.790445    2575 generic.go:356] "Generic (PLEG): container finished" podID="817afd82-9ae4-43ae-8ade-b3bf74be97c6" containerID="5022a007e495fe304ed18aa0263b2d6451dc858750709a8cafd4ff08d4f24c6b" exitCode=0
Sep 15 11:46:06.790489 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:06.790488    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-9fc4b9/test-model-9fc4b9-kserve-76c4469b8c-bbtwr"
Sep 15 11:46:06.790757 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:06.790520    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-9fc4b9/test-model-9fc4b9-kserve-76c4469b8c-bbtwr" event={"ID":"817afd82-9ae4-43ae-8ade-b3bf74be97c6","Type":"ContainerDied","Data":"5022a007e495fe304ed18aa0263b2d6451dc858750709a8cafd4ff08d4f24c6b"}
Sep 15 11:46:06.790757 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:06.790570    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-9fc4b9/test-model-9fc4b9-kserve-76c4469b8c-bbtwr" event={"ID":"817afd82-9ae4-43ae-8ade-b3bf74be97c6","Type":"ContainerDied","Data":"a321667ee7e896c4aac3885d69580fc4cba298770df52f452541eb553c225cab"}
Sep 15 11:46:06.790757 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:06.790594    2575 scope.go:117] "RemoveContainer" containerID="5022a007e495fe304ed18aa0263b2d6451dc858750709a8cafd4ff08d4f24c6b"
Sep 15 11:46:06.801719 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:06.801683    2575 scope.go:117] "RemoveContainer" containerID="5022a007e495fe304ed18aa0263b2d6451dc858750709a8cafd4ff08d4f24c6b"
Sep 15 11:46:06.802091 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:46:06.802065    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5022a007e495fe304ed18aa0263b2d6451dc858750709a8cafd4ff08d4f24c6b\": container with ID starting with 5022a007e495fe304ed18aa0263b2d6451dc858750709a8cafd4ff08d4f24c6b not found: ID does not exist" containerID="5022a007e495fe304ed18aa0263b2d6451dc858750709a8cafd4ff08d4f24c6b"
Sep 15 11:46:06.802172 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:06.802101    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5022a007e495fe304ed18aa0263b2d6451dc858750709a8cafd4ff08d4f24c6b"} err="failed to get container status \"5022a007e495fe304ed18aa0263b2d6451dc858750709a8cafd4ff08d4f24c6b\": rpc error: code = NotFound desc = could not find container \"5022a007e495fe304ed18aa0263b2d6451dc858750709a8cafd4ff08d4f24c6b\": container with ID starting with 5022a007e495fe304ed18aa0263b2d6451dc858750709a8cafd4ff08d4f24c6b not found: ID does not exist"
Sep 15 11:46:06.816926 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:06.816885    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-9fc4b9/test-model-9fc4b9-kserve-76c4469b8c-bbtwr"]
Sep 15 11:46:06.822561 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:06.822529    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-9fc4b9/test-model-9fc4b9-kserve-76c4469b8c-bbtwr"]
Sep 15 11:46:06.848118 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:06.848077    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m92m7\" (UniqueName: \"kubernetes.io/projected/817afd82-9ae4-43ae-8ade-b3bf74be97c6-kube-api-access-m92m7\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:46:06.848118 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:06.848117    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/817afd82-9ae4-43ae-8ade-b3bf74be97c6-tls-certs\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:46:06.848372 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:06.848133    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/817afd82-9ae4-43ae-8ade-b3bf74be97c6-dshm\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:46:08.097490 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:08.097443    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="817afd82-9ae4-43ae-8ade-b3bf74be97c6" path="/var/lib/kubelet/pods/817afd82-9ae4-43ae-8ade-b3bf74be97c6/volumes"
Sep 15 11:46:12.523016 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:12.522970    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"]
Sep 15 11:46:12.523480 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:12.523300    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8" podUID="981d2e3c-8232-4a0f-bcf3-c13ad35d2007" containerName="istio-proxy" containerID="cri-o://b807b2e5f9b65fdf263120361fe73d73c33f31a0107f09d0ca216bcec736b618" gracePeriod=30
Sep 15 11:46:14.739462 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:14.739422    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-78522e/test-model-78522e-kserve-6ff65f68cf-2rpsz"]
Sep 15 11:46:17.784254 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:17.784218    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"
Sep 15 11:46:17.871863 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:17.871829    2575 generic.go:356] "Generic (PLEG): container finished" podID="981d2e3c-8232-4a0f-bcf3-c13ad35d2007" containerID="b807b2e5f9b65fdf263120361fe73d73c33f31a0107f09d0ca216bcec736b618" exitCode=0
Sep 15 11:46:17.872048 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:17.871884    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"
Sep 15 11:46:17.872048 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:17.871892    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8" event={"ID":"981d2e3c-8232-4a0f-bcf3-c13ad35d2007","Type":"ContainerDied","Data":"b807b2e5f9b65fdf263120361fe73d73c33f31a0107f09d0ca216bcec736b618"}
Sep 15 11:46:17.872048 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:17.871963    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8" event={"ID":"981d2e3c-8232-4a0f-bcf3-c13ad35d2007","Type":"ContainerDied","Data":"da2b2140f02647e88ff89b089da4002c9d141a8c8170e8d869ea4106b6e8708a"}
Sep 15 11:46:17.872048 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:17.871986    2575 scope.go:117] "RemoveContainer" containerID="b807b2e5f9b65fdf263120361fe73d73c33f31a0107f09d0ca216bcec736b618"
Sep 15 11:46:17.877409 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:17.877382    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-istio-podinfo\") pod \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\" (UID: \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\") "
Sep 15 11:46:17.877545 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:17.877440    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-istiod-ca-cert\") pod \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\" (UID: \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\") "
Sep 15 11:46:17.877545 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:17.877480    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-workload-socket\") pod \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\" (UID: \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\") "
Sep 15 11:46:17.877667 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:17.877563    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-credential-socket\") pod \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\" (UID: \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\") "
Sep 15 11:46:17.877667 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:17.877613    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7p2jx\" (UniqueName: \"kubernetes.io/projected/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-kube-api-access-7p2jx\") pod \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\" (UID: \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\") "
Sep 15 11:46:17.877799 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:17.877688    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-istio-data\") pod \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\" (UID: \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\") "
Sep 15 11:46:17.877799 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:17.877742    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-istio-envoy\") pod \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\" (UID: \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\") "
Sep 15 11:46:17.877799 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:17.877782    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-istio-token\") pod \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\" (UID: \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\") "
Sep 15 11:46:17.877969 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:17.877841    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-workload-certs\") pod \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\" (UID: \"981d2e3c-8232-4a0f-bcf3-c13ad35d2007\") "
Sep 15 11:46:17.877969 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:17.877893    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "981d2e3c-8232-4a0f-bcf3-c13ad35d2007" (UID: "981d2e3c-8232-4a0f-bcf3-c13ad35d2007"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:46:17.877969 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:17.877923    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "981d2e3c-8232-4a0f-bcf3-c13ad35d2007" (UID: "981d2e3c-8232-4a0f-bcf3-c13ad35d2007"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:46:17.878132 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:17.877976    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "981d2e3c-8232-4a0f-bcf3-c13ad35d2007" (UID: "981d2e3c-8232-4a0f-bcf3-c13ad35d2007"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:46:17.878198 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:17.878124    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-istio-data" (OuterVolumeSpecName: "istio-data") pod "981d2e3c-8232-4a0f-bcf3-c13ad35d2007" (UID: "981d2e3c-8232-4a0f-bcf3-c13ad35d2007"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:46:17.878198 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:17.878138    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "981d2e3c-8232-4a0f-bcf3-c13ad35d2007" (UID: "981d2e3c-8232-4a0f-bcf3-c13ad35d2007"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:46:17.878302 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:17.878231    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-credential-socket\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:46:17.878302 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:17.878249    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-istio-data\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:46:17.878302 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:17.878264    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-workload-certs\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:46:17.878302 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:17.878276    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-istiod-ca-cert\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:46:17.878302 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:17.878288    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-workload-socket\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:46:17.880053 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:17.880031    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "981d2e3c-8232-4a0f-bcf3-c13ad35d2007" (UID: "981d2e3c-8232-4a0f-bcf3-c13ad35d2007"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:46:17.880273 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:17.880252    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "981d2e3c-8232-4a0f-bcf3-c13ad35d2007" (UID: "981d2e3c-8232-4a0f-bcf3-c13ad35d2007"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 11:46:17.880352 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:17.880274    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-kube-api-access-7p2jx" (OuterVolumeSpecName: "kube-api-access-7p2jx") pod "981d2e3c-8232-4a0f-bcf3-c13ad35d2007" (UID: "981d2e3c-8232-4a0f-bcf3-c13ad35d2007"). InnerVolumeSpecName "kube-api-access-7p2jx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:46:17.880445 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:17.880426    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-istio-token" (OuterVolumeSpecName: "istio-token") pod "981d2e3c-8232-4a0f-bcf3-c13ad35d2007" (UID: "981d2e3c-8232-4a0f-bcf3-c13ad35d2007"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:46:17.883525 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:17.883504    2575 scope.go:117] "RemoveContainer" containerID="9e3a819e244601eccab364d9b8528d3f2ea5aa924e1d5e3ed8930b23f9e7e075"
Sep 15 11:46:17.904531 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:17.904506    2575 scope.go:117] "RemoveContainer" containerID="b807b2e5f9b65fdf263120361fe73d73c33f31a0107f09d0ca216bcec736b618"
Sep 15 11:46:17.904912 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:46:17.904890    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b807b2e5f9b65fdf263120361fe73d73c33f31a0107f09d0ca216bcec736b618\": container with ID starting with b807b2e5f9b65fdf263120361fe73d73c33f31a0107f09d0ca216bcec736b618 not found: ID does not exist" containerID="b807b2e5f9b65fdf263120361fe73d73c33f31a0107f09d0ca216bcec736b618"
Sep 15 11:46:17.905000 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:17.904927    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b807b2e5f9b65fdf263120361fe73d73c33f31a0107f09d0ca216bcec736b618"} err="failed to get container status \"b807b2e5f9b65fdf263120361fe73d73c33f31a0107f09d0ca216bcec736b618\": rpc error: code = NotFound desc = could not find container \"b807b2e5f9b65fdf263120361fe73d73c33f31a0107f09d0ca216bcec736b618\": container with ID starting with b807b2e5f9b65fdf263120361fe73d73c33f31a0107f09d0ca216bcec736b618 not found: ID does not exist"
Sep 15 11:46:17.905000 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:17.904956    2575 scope.go:117] "RemoveContainer" containerID="9e3a819e244601eccab364d9b8528d3f2ea5aa924e1d5e3ed8930b23f9e7e075"
Sep 15 11:46:17.905272 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:46:17.905250    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e3a819e244601eccab364d9b8528d3f2ea5aa924e1d5e3ed8930b23f9e7e075\": container with ID starting with 9e3a819e244601eccab364d9b8528d3f2ea5aa924e1d5e3ed8930b23f9e7e075 not found: ID does not exist" containerID="9e3a819e244601eccab364d9b8528d3f2ea5aa924e1d5e3ed8930b23f9e7e075"
Sep 15 11:46:17.905313 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:17.905279    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e3a819e244601eccab364d9b8528d3f2ea5aa924e1d5e3ed8930b23f9e7e075"} err="failed to get container status \"9e3a819e244601eccab364d9b8528d3f2ea5aa924e1d5e3ed8930b23f9e7e075\": rpc error: code = NotFound desc = could not find container \"9e3a819e244601eccab364d9b8528d3f2ea5aa924e1d5e3ed8930b23f9e7e075\": container with ID starting with 9e3a819e244601eccab364d9b8528d3f2ea5aa924e1d5e3ed8930b23f9e7e075 not found: ID does not exist"
Sep 15 11:46:17.979302 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:17.979260    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-istio-envoy\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:46:17.979302 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:17.979295    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-istio-token\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:46:17.979302 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:17.979304    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-istio-podinfo\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:46:17.979551 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:17.979313    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7p2jx\" (UniqueName: \"kubernetes.io/projected/981d2e3c-8232-4a0f-bcf3-c13ad35d2007-kube-api-access-7p2jx\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:46:18.190065 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:18.189975    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"]
Sep 15 11:46:18.196141 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:18.196105    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8"]
Sep 15 11:46:20.095768 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:20.095728    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="981d2e3c-8232-4a0f-bcf3-c13ad35d2007" path="/var/lib/kubelet/pods/981d2e3c-8232-4a0f-bcf3-c13ad35d2007/volumes"
Sep 15 11:46:29.760261 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:29.760152    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-78522e/test-model-78522e-kserve-6ff65f68cf-2rpsz" podUID="d208efeb-be4d-4092-9b8b-1f3dca26a7e4" containerName="main" containerID="cri-o://5f466cd64ece7b5ed65c0462e2c00973d637f9d5062e472aa1f71dc3f016a21d" gracePeriod=45
Sep 15 11:46:29.956315 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:29.956265    2575 generic.go:356] "Generic (PLEG): container finished" podID="d208efeb-be4d-4092-9b8b-1f3dca26a7e4" containerID="5f466cd64ece7b5ed65c0462e2c00973d637f9d5062e472aa1f71dc3f016a21d" exitCode=0
Sep 15 11:46:29.956495 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:29.956338    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-78522e/test-model-78522e-kserve-6ff65f68cf-2rpsz" event={"ID":"d208efeb-be4d-4092-9b8b-1f3dca26a7e4","Type":"ContainerDied","Data":"5f466cd64ece7b5ed65c0462e2c00973d637f9d5062e472aa1f71dc3f016a21d"}
Sep 15 11:46:30.031020 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:30.030987    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-78522e/test-model-78522e-kserve-6ff65f68cf-2rpsz"
Sep 15 11:46:30.112305 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:30.112262    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d208efeb-be4d-4092-9b8b-1f3dca26a7e4-model-cache\") pod \"d208efeb-be4d-4092-9b8b-1f3dca26a7e4\" (UID: \"d208efeb-be4d-4092-9b8b-1f3dca26a7e4\") "
Sep 15 11:46:30.112510 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:30.112318    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d208efeb-be4d-4092-9b8b-1f3dca26a7e4-home\") pod \"d208efeb-be4d-4092-9b8b-1f3dca26a7e4\" (UID: \"d208efeb-be4d-4092-9b8b-1f3dca26a7e4\") "
Sep 15 11:46:30.112510 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:30.112413    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d208efeb-be4d-4092-9b8b-1f3dca26a7e4-tls-certs\") pod \"d208efeb-be4d-4092-9b8b-1f3dca26a7e4\" (UID: \"d208efeb-be4d-4092-9b8b-1f3dca26a7e4\") "
Sep 15 11:46:30.112510 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:30.112456    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d208efeb-be4d-4092-9b8b-1f3dca26a7e4-dshm\") pod \"d208efeb-be4d-4092-9b8b-1f3dca26a7e4\" (UID: \"d208efeb-be4d-4092-9b8b-1f3dca26a7e4\") "
Sep 15 11:46:30.112719 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:30.112523    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sl9s8\" (UniqueName: \"kubernetes.io/projected/d208efeb-be4d-4092-9b8b-1f3dca26a7e4-kube-api-access-sl9s8\") pod \"d208efeb-be4d-4092-9b8b-1f3dca26a7e4\" (UID: \"d208efeb-be4d-4092-9b8b-1f3dca26a7e4\") "
Sep 15 11:46:30.112719 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:30.112578    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d208efeb-be4d-4092-9b8b-1f3dca26a7e4-tmp-dir\") pod \"d208efeb-be4d-4092-9b8b-1f3dca26a7e4\" (UID: \"d208efeb-be4d-4092-9b8b-1f3dca26a7e4\") "
Sep 15 11:46:30.112719 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:30.112592    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d208efeb-be4d-4092-9b8b-1f3dca26a7e4-home" (OuterVolumeSpecName: "home") pod "d208efeb-be4d-4092-9b8b-1f3dca26a7e4" (UID: "d208efeb-be4d-4092-9b8b-1f3dca26a7e4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:46:30.112719 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:30.112588    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d208efeb-be4d-4092-9b8b-1f3dca26a7e4-model-cache" (OuterVolumeSpecName: "model-cache") pod "d208efeb-be4d-4092-9b8b-1f3dca26a7e4" (UID: "d208efeb-be4d-4092-9b8b-1f3dca26a7e4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:46:30.112919 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:30.112794    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d208efeb-be4d-4092-9b8b-1f3dca26a7e4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d208efeb-be4d-4092-9b8b-1f3dca26a7e4" (UID: "d208efeb-be4d-4092-9b8b-1f3dca26a7e4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:46:30.113028 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:30.113008    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d208efeb-be4d-4092-9b8b-1f3dca26a7e4-tmp-dir\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:46:30.113088 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:30.113033    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d208efeb-be4d-4092-9b8b-1f3dca26a7e4-model-cache\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:46:30.113088 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:30.113046    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d208efeb-be4d-4092-9b8b-1f3dca26a7e4-home\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:46:30.114733 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:30.114710    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d208efeb-be4d-4092-9b8b-1f3dca26a7e4-dshm" (OuterVolumeSpecName: "dshm") pod "d208efeb-be4d-4092-9b8b-1f3dca26a7e4" (UID: "d208efeb-be4d-4092-9b8b-1f3dca26a7e4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:46:30.114733 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:30.114723    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d208efeb-be4d-4092-9b8b-1f3dca26a7e4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d208efeb-be4d-4092-9b8b-1f3dca26a7e4" (UID: "d208efeb-be4d-4092-9b8b-1f3dca26a7e4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:46:30.114853 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:30.114781    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d208efeb-be4d-4092-9b8b-1f3dca26a7e4-kube-api-access-sl9s8" (OuterVolumeSpecName: "kube-api-access-sl9s8") pod "d208efeb-be4d-4092-9b8b-1f3dca26a7e4" (UID: "d208efeb-be4d-4092-9b8b-1f3dca26a7e4"). InnerVolumeSpecName "kube-api-access-sl9s8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:46:30.214748 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:30.214703    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sl9s8\" (UniqueName: \"kubernetes.io/projected/d208efeb-be4d-4092-9b8b-1f3dca26a7e4-kube-api-access-sl9s8\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:46:30.214748 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:30.214748    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d208efeb-be4d-4092-9b8b-1f3dca26a7e4-tls-certs\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:46:30.215003 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:30.214763    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d208efeb-be4d-4092-9b8b-1f3dca26a7e4-dshm\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:46:30.667537 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:30.667500    2575 scope.go:117] "RemoveContainer" containerID="636ffe4d37621e468c9bea50409072ddf0769030c7b98a8d84667c4f37e71fd2"
Sep 15 11:46:30.964966 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:30.964882    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-78522e/test-model-78522e-kserve-6ff65f68cf-2rpsz"
Sep 15 11:46:30.964966 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:30.964922    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-78522e/test-model-78522e-kserve-6ff65f68cf-2rpsz" event={"ID":"d208efeb-be4d-4092-9b8b-1f3dca26a7e4","Type":"ContainerDied","Data":"f835cc0227943db22cf2ff9b14052aa4b816e2101df43d019c1bd49f0a635553"}
Sep 15 11:46:30.965846 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:30.964969    2575 scope.go:117] "RemoveContainer" containerID="5f466cd64ece7b5ed65c0462e2c00973d637f9d5062e472aa1f71dc3f016a21d"
Sep 15 11:46:30.986905 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:30.986875    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-78522e/test-model-78522e-kserve-6ff65f68cf-2rpsz"]
Sep 15 11:46:30.992472 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:30.992444    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-78522e/test-model-78522e-kserve-6ff65f68cf-2rpsz"]
Sep 15 11:46:32.095149 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:32.095115    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d208efeb-be4d-4092-9b8b-1f3dca26a7e4" path="/var/lib/kubelet/pods/d208efeb-be4d-4092-9b8b-1f3dca26a7e4/volumes"
Sep 15 11:46:35.210413 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:35.210369    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"]
Sep 15 11:46:35.210881 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:35.210601    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795" podUID="4e9272d5-231d-425b-b15a-5fe8b64dec7f" containerName="istio-proxy" containerID="cri-o://0c650a23d3dc0b96b152ea8d88b299de29097c5e38c13c8529165af41d7e2d2b" gracePeriod=30
Sep 15 11:46:40.483461 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:40.483393    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"
Sep 15 11:46:40.624011 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:40.623966    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e9272d5-231d-425b-b15a-5fe8b64dec7f-credential-socket\") pod \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\" (UID: \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\") "
Sep 15 11:46:40.624011 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:40.624010    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kw6vs\" (UniqueName: \"kubernetes.io/projected/4e9272d5-231d-425b-b15a-5fe8b64dec7f-kube-api-access-kw6vs\") pod \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\" (UID: \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\") "
Sep 15 11:46:40.624287 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:40.624040    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e9272d5-231d-425b-b15a-5fe8b64dec7f-istio-token\") pod \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\" (UID: \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\") "
Sep 15 11:46:40.624287 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:40.624091    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e9272d5-231d-425b-b15a-5fe8b64dec7f-istio-data\") pod \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\" (UID: \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\") "
Sep 15 11:46:40.624287 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:40.624120    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e9272d5-231d-425b-b15a-5fe8b64dec7f-istio-envoy\") pod \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\" (UID: \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\") "
Sep 15 11:46:40.624456 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:40.624283    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e9272d5-231d-425b-b15a-5fe8b64dec7f-workload-certs\") pod \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\" (UID: \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\") "
Sep 15 11:46:40.624456 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:40.624365    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e9272d5-231d-425b-b15a-5fe8b64dec7f-workload-socket\") pod \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\" (UID: \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\") "
Sep 15 11:46:40.624456 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:40.624279    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e9272d5-231d-425b-b15a-5fe8b64dec7f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4e9272d5-231d-425b-b15a-5fe8b64dec7f" (UID: "4e9272d5-231d-425b-b15a-5fe8b64dec7f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:46:40.624456 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:40.624421    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e9272d5-231d-425b-b15a-5fe8b64dec7f-istiod-ca-cert\") pod \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\" (UID: \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\") "
Sep 15 11:46:40.624676 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:40.624420    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e9272d5-231d-425b-b15a-5fe8b64dec7f-istio-data" (OuterVolumeSpecName: "istio-data") pod "4e9272d5-231d-425b-b15a-5fe8b64dec7f" (UID: "4e9272d5-231d-425b-b15a-5fe8b64dec7f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:46:40.624676 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:40.624483    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e9272d5-231d-425b-b15a-5fe8b64dec7f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4e9272d5-231d-425b-b15a-5fe8b64dec7f" (UID: "4e9272d5-231d-425b-b15a-5fe8b64dec7f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:46:40.624676 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:40.624492    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e9272d5-231d-425b-b15a-5fe8b64dec7f-istio-podinfo\") pod \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\" (UID: \"4e9272d5-231d-425b-b15a-5fe8b64dec7f\") "
Sep 15 11:46:40.624676 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:40.624630    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e9272d5-231d-425b-b15a-5fe8b64dec7f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4e9272d5-231d-425b-b15a-5fe8b64dec7f" (UID: "4e9272d5-231d-425b-b15a-5fe8b64dec7f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:46:40.624863 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:40.624742    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e9272d5-231d-425b-b15a-5fe8b64dec7f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4e9272d5-231d-425b-b15a-5fe8b64dec7f" (UID: "4e9272d5-231d-425b-b15a-5fe8b64dec7f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:46:40.625096 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:40.625075    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e9272d5-231d-425b-b15a-5fe8b64dec7f-credential-socket\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:46:40.625158 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:40.625102    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e9272d5-231d-425b-b15a-5fe8b64dec7f-istio-data\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:46:40.625158 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:40.625119    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e9272d5-231d-425b-b15a-5fe8b64dec7f-workload-certs\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:46:40.625158 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:40.625131    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e9272d5-231d-425b-b15a-5fe8b64dec7f-workload-socket\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:46:40.625158 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:40.625144    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e9272d5-231d-425b-b15a-5fe8b64dec7f-istiod-ca-cert\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:46:40.626598 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:40.626569    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e9272d5-231d-425b-b15a-5fe8b64dec7f-istio-token" (OuterVolumeSpecName: "istio-token") pod "4e9272d5-231d-425b-b15a-5fe8b64dec7f" (UID: "4e9272d5-231d-425b-b15a-5fe8b64dec7f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:46:40.626833 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:40.626605    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e9272d5-231d-425b-b15a-5fe8b64dec7f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4e9272d5-231d-425b-b15a-5fe8b64dec7f" (UID: "4e9272d5-231d-425b-b15a-5fe8b64dec7f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:46:40.626948 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:40.626928    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e9272d5-231d-425b-b15a-5fe8b64dec7f-kube-api-access-kw6vs" (OuterVolumeSpecName: "kube-api-access-kw6vs") pod "4e9272d5-231d-425b-b15a-5fe8b64dec7f" (UID: "4e9272d5-231d-425b-b15a-5fe8b64dec7f"). InnerVolumeSpecName "kube-api-access-kw6vs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:46:40.627013 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:40.626969    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4e9272d5-231d-425b-b15a-5fe8b64dec7f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4e9272d5-231d-425b-b15a-5fe8b64dec7f" (UID: "4e9272d5-231d-425b-b15a-5fe8b64dec7f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 11:46:40.726127 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:40.726087    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e9272d5-231d-425b-b15a-5fe8b64dec7f-istio-podinfo\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:46:40.726127 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:40.726121    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kw6vs\" (UniqueName: \"kubernetes.io/projected/4e9272d5-231d-425b-b15a-5fe8b64dec7f-kube-api-access-kw6vs\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:46:40.726127 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:40.726130    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e9272d5-231d-425b-b15a-5fe8b64dec7f-istio-token\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:46:40.726127 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:40.726138    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e9272d5-231d-425b-b15a-5fe8b64dec7f-istio-envoy\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:46:41.034334 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:41.034294    2575 generic.go:356] "Generic (PLEG): container finished" podID="4e9272d5-231d-425b-b15a-5fe8b64dec7f" containerID="0c650a23d3dc0b96b152ea8d88b299de29097c5e38c13c8529165af41d7e2d2b" exitCode=0
Sep 15 11:46:41.034533 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:41.034356    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"
Sep 15 11:46:41.034533 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:41.034379    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795" event={"ID":"4e9272d5-231d-425b-b15a-5fe8b64dec7f","Type":"ContainerDied","Data":"0c650a23d3dc0b96b152ea8d88b299de29097c5e38c13c8529165af41d7e2d2b"}
Sep 15 11:46:41.034533 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:41.034444    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795" event={"ID":"4e9272d5-231d-425b-b15a-5fe8b64dec7f","Type":"ContainerDied","Data":"3bcbd83cd9773722531679cb790fe326d52d6b55ad728cb1bd649d7f7725a924"}
Sep 15 11:46:41.034533 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:41.034473    2575 scope.go:117] "RemoveContainer" containerID="0c650a23d3dc0b96b152ea8d88b299de29097c5e38c13c8529165af41d7e2d2b"
Sep 15 11:46:41.045675 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:41.045642    2575 scope.go:117] "RemoveContainer" containerID="d5684ce5b73cd69af2a2f8556eb0444388e86dbb45a207ed8121e4b0cfd430ec"
Sep 15 11:46:41.055943 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:41.055909    2575 scope.go:117] "RemoveContainer" containerID="0c650a23d3dc0b96b152ea8d88b299de29097c5e38c13c8529165af41d7e2d2b"
Sep 15 11:46:41.056368 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:46:41.056341    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c650a23d3dc0b96b152ea8d88b299de29097c5e38c13c8529165af41d7e2d2b\": container with ID starting with 0c650a23d3dc0b96b152ea8d88b299de29097c5e38c13c8529165af41d7e2d2b not found: ID does not exist" containerID="0c650a23d3dc0b96b152ea8d88b299de29097c5e38c13c8529165af41d7e2d2b"
Sep 15 11:46:41.056499 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:41.056374    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c650a23d3dc0b96b152ea8d88b299de29097c5e38c13c8529165af41d7e2d2b"} err="failed to get container status \"0c650a23d3dc0b96b152ea8d88b299de29097c5e38c13c8529165af41d7e2d2b\": rpc error: code = NotFound desc = could not find container \"0c650a23d3dc0b96b152ea8d88b299de29097c5e38c13c8529165af41d7e2d2b\": container with ID starting with 0c650a23d3dc0b96b152ea8d88b299de29097c5e38c13c8529165af41d7e2d2b not found: ID does not exist"
Sep 15 11:46:41.056499 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:41.056398    2575 scope.go:117] "RemoveContainer" containerID="d5684ce5b73cd69af2a2f8556eb0444388e86dbb45a207ed8121e4b0cfd430ec"
Sep 15 11:46:41.056736 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:46:41.056716    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5684ce5b73cd69af2a2f8556eb0444388e86dbb45a207ed8121e4b0cfd430ec\": container with ID starting with d5684ce5b73cd69af2a2f8556eb0444388e86dbb45a207ed8121e4b0cfd430ec not found: ID does not exist" containerID="d5684ce5b73cd69af2a2f8556eb0444388e86dbb45a207ed8121e4b0cfd430ec"
Sep 15 11:46:41.056809 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:41.056743    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5684ce5b73cd69af2a2f8556eb0444388e86dbb45a207ed8121e4b0cfd430ec"} err="failed to get container status \"d5684ce5b73cd69af2a2f8556eb0444388e86dbb45a207ed8121e4b0cfd430ec\": rpc error: code = NotFound desc = could not find container \"d5684ce5b73cd69af2a2f8556eb0444388e86dbb45a207ed8121e4b0cfd430ec\": container with ID starting with d5684ce5b73cd69af2a2f8556eb0444388e86dbb45a207ed8121e4b0cfd430ec not found: ID does not exist"
Sep 15 11:46:41.058730 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:41.058539    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"]
Sep 15 11:46:41.061571 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:41.061544    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795"]
Sep 15 11:46:42.094547 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:42.094508    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e9272d5-231d-425b-b15a-5fe8b64dec7f" path="/var/lib/kubelet/pods/4e9272d5-231d-425b-b15a-5fe8b64dec7f/volumes"
Sep 15 11:46:42.943553 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:42.943523    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7efa8b-74876948c6-4sq64"]
Sep 15 11:46:42.944019 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:42.944005    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="981d2e3c-8232-4a0f-bcf3-c13ad35d2007" containerName="istio-proxy"
Sep 15 11:46:42.944080 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:42.944021    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="981d2e3c-8232-4a0f-bcf3-c13ad35d2007" containerName="istio-proxy"
Sep 15 11:46:42.944080 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:42.944029    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d208efeb-be4d-4092-9b8b-1f3dca26a7e4" containerName="main"
Sep 15 11:46:42.944080 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:42.944035    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d208efeb-be4d-4092-9b8b-1f3dca26a7e4" containerName="main"
Sep 15 11:46:42.944080 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:42.944055    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e9272d5-231d-425b-b15a-5fe8b64dec7f" containerName="istio-proxy"
Sep 15 11:46:42.944080 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:42.944061    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e9272d5-231d-425b-b15a-5fe8b64dec7f" containerName="istio-proxy"
Sep 15 11:46:42.944080 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:42.944068    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="817afd82-9ae4-43ae-8ade-b3bf74be97c6" containerName="main"
Sep 15 11:46:42.944080 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:42.944073    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="817afd82-9ae4-43ae-8ade-b3bf74be97c6" containerName="main"
Sep 15 11:46:42.944293 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:42.944087    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e9272d5-231d-425b-b15a-5fe8b64dec7f" containerName="istio-proxy"
Sep 15 11:46:42.944293 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:42.944093    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e9272d5-231d-425b-b15a-5fe8b64dec7f" containerName="istio-proxy"
Sep 15 11:46:42.944293 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:42.944160    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="981d2e3c-8232-4a0f-bcf3-c13ad35d2007" containerName="istio-proxy"
Sep 15 11:46:42.944293 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:42.944168    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e9272d5-231d-425b-b15a-5fe8b64dec7f" containerName="istio-proxy"
Sep 15 11:46:42.944293 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:42.944194    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="817afd82-9ae4-43ae-8ade-b3bf74be97c6" containerName="main"
Sep 15 11:46:42.944293 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:42.944200    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="981d2e3c-8232-4a0f-bcf3-c13ad35d2007" containerName="istio-proxy"
Sep 15 11:46:42.944293 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:42.944210    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e9272d5-231d-425b-b15a-5fe8b64dec7f" containerName="istio-proxy"
Sep 15 11:46:42.944293 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:42.944215    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d208efeb-be4d-4092-9b8b-1f3dca26a7e4" containerName="main"
Sep 15 11:46:42.948952 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:42.948928    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7efa8b-74876948c6-4sq64"
Sep 15 11:46:42.951610 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:42.951582    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-7efa8b-serving-cert\""
Sep 15 11:46:42.964402 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:42.964369    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7efa8b-74876948c6-4sq64"]
Sep 15 11:46:43.050354 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:43.050318    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9b80036-c0e1-47e7-b06a-849ef1074f37-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-7efa8b-74876948c6-4sq64\" (UID: \"b9b80036-c0e1-47e7-b06a-849ef1074f37\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7efa8b-74876948c6-4sq64"
Sep 15 11:46:43.050553 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:43.050367    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n69rq\" (UniqueName: \"kubernetes.io/projected/b9b80036-c0e1-47e7-b06a-849ef1074f37-kube-api-access-n69rq\") pod \"maas-api-e2e-shared-a-w3-7efa8b-74876948c6-4sq64\" (UID: \"b9b80036-c0e1-47e7-b06a-849ef1074f37\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7efa8b-74876948c6-4sq64"
Sep 15 11:46:43.050553 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:43.050405    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9b80036-c0e1-47e7-b06a-849ef1074f37-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-7efa8b-74876948c6-4sq64\" (UID: \"b9b80036-c0e1-47e7-b06a-849ef1074f37\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7efa8b-74876948c6-4sq64"
Sep 15 11:46:43.050553 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:43.050442    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9b80036-c0e1-47e7-b06a-849ef1074f37-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-7efa8b-74876948c6-4sq64\" (UID: \"b9b80036-c0e1-47e7-b06a-849ef1074f37\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7efa8b-74876948c6-4sq64"
Sep 15 11:46:43.151326 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:43.151284    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9b80036-c0e1-47e7-b06a-849ef1074f37-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-7efa8b-74876948c6-4sq64\" (UID: \"b9b80036-c0e1-47e7-b06a-849ef1074f37\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7efa8b-74876948c6-4sq64"
Sep 15 11:46:43.151326 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:43.151331    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n69rq\" (UniqueName: \"kubernetes.io/projected/b9b80036-c0e1-47e7-b06a-849ef1074f37-kube-api-access-n69rq\") pod \"maas-api-e2e-shared-a-w3-7efa8b-74876948c6-4sq64\" (UID: \"b9b80036-c0e1-47e7-b06a-849ef1074f37\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7efa8b-74876948c6-4sq64"
Sep 15 11:46:43.151841 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:43.151353    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9b80036-c0e1-47e7-b06a-849ef1074f37-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-7efa8b-74876948c6-4sq64\" (UID: \"b9b80036-c0e1-47e7-b06a-849ef1074f37\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7efa8b-74876948c6-4sq64"
Sep 15 11:46:43.151841 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:43.151386    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9b80036-c0e1-47e7-b06a-849ef1074f37-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-7efa8b-74876948c6-4sq64\" (UID: \"b9b80036-c0e1-47e7-b06a-849ef1074f37\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7efa8b-74876948c6-4sq64"
Sep 15 11:46:43.152076 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:43.152053    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9b80036-c0e1-47e7-b06a-849ef1074f37-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-7efa8b-74876948c6-4sq64\" (UID: \"b9b80036-c0e1-47e7-b06a-849ef1074f37\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7efa8b-74876948c6-4sq64"
Sep 15 11:46:43.154054 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:43.154032    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9b80036-c0e1-47e7-b06a-849ef1074f37-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-7efa8b-74876948c6-4sq64\" (UID: \"b9b80036-c0e1-47e7-b06a-849ef1074f37\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7efa8b-74876948c6-4sq64"
Sep 15 11:46:43.154128 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:43.154071    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9b80036-c0e1-47e7-b06a-849ef1074f37-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-7efa8b-74876948c6-4sq64\" (UID: \"b9b80036-c0e1-47e7-b06a-849ef1074f37\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7efa8b-74876948c6-4sq64"
Sep 15 11:46:43.159254 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:43.159224    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n69rq\" (UniqueName: \"kubernetes.io/projected/b9b80036-c0e1-47e7-b06a-849ef1074f37-kube-api-access-n69rq\") pod \"maas-api-e2e-shared-a-w3-7efa8b-74876948c6-4sq64\" (UID: \"b9b80036-c0e1-47e7-b06a-849ef1074f37\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7efa8b-74876948c6-4sq64"
Sep 15 11:46:43.259984 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:43.259880    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7efa8b-74876948c6-4sq64"
Sep 15 11:46:43.546300 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:43.546267    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7efa8b-74876948c6-4sq64"]
Sep 15 11:46:43.548072 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:46:43.548035    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9b80036_c0e1_47e7_b06a_849ef1074f37.slice/crio-ab6df2c15c104281ee77a7abc0d177d4a5ef881131c151d9b66a5571a0ec02dc WatchSource:0}: Error finding container ab6df2c15c104281ee77a7abc0d177d4a5ef881131c151d9b66a5571a0ec02dc: Status 404 returned error can't find the container with id ab6df2c15c104281ee77a7abc0d177d4a5ef881131c151d9b66a5571a0ec02dc
Sep 15 11:46:43.549970 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:43.549946    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 11:46:44.057264 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:44.057225    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7efa8b-74876948c6-4sq64" event={"ID":"b9b80036-c0e1-47e7-b06a-849ef1074f37","Type":"ContainerStarted","Data":"ab6df2c15c104281ee77a7abc0d177d4a5ef881131c151d9b66a5571a0ec02dc"}
Sep 15 11:46:45.065610 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:45.065558    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7efa8b-74876948c6-4sq64" event={"ID":"b9b80036-c0e1-47e7-b06a-849ef1074f37","Type":"ContainerStarted","Data":"a2ea9ba6ffa47554cda8559c8b7b06c027e7465c7530d4da44aa1a1f52820271"}
Sep 15 11:46:45.066062 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:45.065630    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7efa8b-74876948c6-4sq64"
Sep 15 11:46:45.083600 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:45.083538    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7efa8b-74876948c6-4sq64" podStartSLOduration=2.6356409469999997 podStartE2EDuration="3.08351878s" totalImagesPullingTime="447.877833ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:46:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:46:45.081305137 +0000 UTC m=+1275.507635758" watchObservedRunningTime="2026-09-15 11:46:45.08351878 +0000 UTC m=+1275.509849375"
Sep 15 11:46:51.078109 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:46:51.078071    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7efa8b-74876948c6-4sq64"
Sep 15 11:47:09.867380 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:09.867338    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-6e996c/distinct-2-w0-6e996c-kserve-65666656f6-4wkkp"]
Sep 15 11:47:09.867886 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:09.867869    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="981d2e3c-8232-4a0f-bcf3-c13ad35d2007" containerName="istio-proxy"
Sep 15 11:47:09.867932 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:09.867888    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="981d2e3c-8232-4a0f-bcf3-c13ad35d2007" containerName="istio-proxy"
Sep 15 11:47:09.871318 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:09.871290    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-6e996c/distinct-2-w0-6e996c-kserve-65666656f6-4wkkp"
Sep 15 11:47:09.873383 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:09.873349    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-6e996c\"/\"distinct-2-w0-6e996c-kserve-self-signed-certs\""
Sep 15 11:47:09.880766 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:09.880739    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-6e996c/distinct-2-w0-6e996c-kserve-65666656f6-4wkkp"]
Sep 15 11:47:09.943156 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:09.943122    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8687db22-f87f-40e5-bd33-c2e6cf2d4509-tmp-dir\") pod \"distinct-2-w0-6e996c-kserve-65666656f6-4wkkp\" (UID: \"8687db22-f87f-40e5-bd33-c2e6cf2d4509\") " pod="e2e-models-e2e-worker-w0-6e996c/distinct-2-w0-6e996c-kserve-65666656f6-4wkkp"
Sep 15 11:47:09.943347 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:09.943182    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8687db22-f87f-40e5-bd33-c2e6cf2d4509-dshm\") pod \"distinct-2-w0-6e996c-kserve-65666656f6-4wkkp\" (UID: \"8687db22-f87f-40e5-bd33-c2e6cf2d4509\") " pod="e2e-models-e2e-worker-w0-6e996c/distinct-2-w0-6e996c-kserve-65666656f6-4wkkp"
Sep 15 11:47:09.943347 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:09.943215    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8687db22-f87f-40e5-bd33-c2e6cf2d4509-tls-certs\") pod \"distinct-2-w0-6e996c-kserve-65666656f6-4wkkp\" (UID: \"8687db22-f87f-40e5-bd33-c2e6cf2d4509\") " pod="e2e-models-e2e-worker-w0-6e996c/distinct-2-w0-6e996c-kserve-65666656f6-4wkkp"
Sep 15 11:47:09.943347 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:09.943308    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8687db22-f87f-40e5-bd33-c2e6cf2d4509-home\") pod \"distinct-2-w0-6e996c-kserve-65666656f6-4wkkp\" (UID: \"8687db22-f87f-40e5-bd33-c2e6cf2d4509\") " pod="e2e-models-e2e-worker-w0-6e996c/distinct-2-w0-6e996c-kserve-65666656f6-4wkkp"
Sep 15 11:47:09.943477 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:09.943356    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8687db22-f87f-40e5-bd33-c2e6cf2d4509-model-cache\") pod \"distinct-2-w0-6e996c-kserve-65666656f6-4wkkp\" (UID: \"8687db22-f87f-40e5-bd33-c2e6cf2d4509\") " pod="e2e-models-e2e-worker-w0-6e996c/distinct-2-w0-6e996c-kserve-65666656f6-4wkkp"
Sep 15 11:47:09.943477 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:09.943380    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rfbs\" (UniqueName: \"kubernetes.io/projected/8687db22-f87f-40e5-bd33-c2e6cf2d4509-kube-api-access-8rfbs\") pod \"distinct-2-w0-6e996c-kserve-65666656f6-4wkkp\" (UID: \"8687db22-f87f-40e5-bd33-c2e6cf2d4509\") " pod="e2e-models-e2e-worker-w0-6e996c/distinct-2-w0-6e996c-kserve-65666656f6-4wkkp"
Sep 15 11:47:10.044572 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:10.044526    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8687db22-f87f-40e5-bd33-c2e6cf2d4509-tmp-dir\") pod \"distinct-2-w0-6e996c-kserve-65666656f6-4wkkp\" (UID: \"8687db22-f87f-40e5-bd33-c2e6cf2d4509\") " pod="e2e-models-e2e-worker-w0-6e996c/distinct-2-w0-6e996c-kserve-65666656f6-4wkkp"
Sep 15 11:47:10.044572 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:10.044585    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8687db22-f87f-40e5-bd33-c2e6cf2d4509-dshm\") pod \"distinct-2-w0-6e996c-kserve-65666656f6-4wkkp\" (UID: \"8687db22-f87f-40e5-bd33-c2e6cf2d4509\") " pod="e2e-models-e2e-worker-w0-6e996c/distinct-2-w0-6e996c-kserve-65666656f6-4wkkp"
Sep 15 11:47:10.044878 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:10.044704    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8687db22-f87f-40e5-bd33-c2e6cf2d4509-tls-certs\") pod \"distinct-2-w0-6e996c-kserve-65666656f6-4wkkp\" (UID: \"8687db22-f87f-40e5-bd33-c2e6cf2d4509\") " pod="e2e-models-e2e-worker-w0-6e996c/distinct-2-w0-6e996c-kserve-65666656f6-4wkkp"
Sep 15 11:47:10.044878 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:10.044787    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8687db22-f87f-40e5-bd33-c2e6cf2d4509-home\") pod \"distinct-2-w0-6e996c-kserve-65666656f6-4wkkp\" (UID: \"8687db22-f87f-40e5-bd33-c2e6cf2d4509\") " pod="e2e-models-e2e-worker-w0-6e996c/distinct-2-w0-6e996c-kserve-65666656f6-4wkkp"
Sep 15 11:47:10.044878 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:10.044828    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8687db22-f87f-40e5-bd33-c2e6cf2d4509-model-cache\") pod \"distinct-2-w0-6e996c-kserve-65666656f6-4wkkp\" (UID: \"8687db22-f87f-40e5-bd33-c2e6cf2d4509\") " pod="e2e-models-e2e-worker-w0-6e996c/distinct-2-w0-6e996c-kserve-65666656f6-4wkkp"
Sep 15 11:47:10.044878 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:10.044851    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rfbs\" (UniqueName: \"kubernetes.io/projected/8687db22-f87f-40e5-bd33-c2e6cf2d4509-kube-api-access-8rfbs\") pod \"distinct-2-w0-6e996c-kserve-65666656f6-4wkkp\" (UID: \"8687db22-f87f-40e5-bd33-c2e6cf2d4509\") " pod="e2e-models-e2e-worker-w0-6e996c/distinct-2-w0-6e996c-kserve-65666656f6-4wkkp"
Sep 15 11:47:10.045117 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:10.045088    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8687db22-f87f-40e5-bd33-c2e6cf2d4509-tmp-dir\") pod \"distinct-2-w0-6e996c-kserve-65666656f6-4wkkp\" (UID: \"8687db22-f87f-40e5-bd33-c2e6cf2d4509\") " pod="e2e-models-e2e-worker-w0-6e996c/distinct-2-w0-6e996c-kserve-65666656f6-4wkkp"
Sep 15 11:47:10.045166 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:10.045128    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8687db22-f87f-40e5-bd33-c2e6cf2d4509-home\") pod \"distinct-2-w0-6e996c-kserve-65666656f6-4wkkp\" (UID: \"8687db22-f87f-40e5-bd33-c2e6cf2d4509\") " pod="e2e-models-e2e-worker-w0-6e996c/distinct-2-w0-6e996c-kserve-65666656f6-4wkkp"
Sep 15 11:47:10.045206 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:10.045181    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8687db22-f87f-40e5-bd33-c2e6cf2d4509-model-cache\") pod \"distinct-2-w0-6e996c-kserve-65666656f6-4wkkp\" (UID: \"8687db22-f87f-40e5-bd33-c2e6cf2d4509\") " pod="e2e-models-e2e-worker-w0-6e996c/distinct-2-w0-6e996c-kserve-65666656f6-4wkkp"
Sep 15 11:47:10.047076 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:10.047049    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8687db22-f87f-40e5-bd33-c2e6cf2d4509-dshm\") pod \"distinct-2-w0-6e996c-kserve-65666656f6-4wkkp\" (UID: \"8687db22-f87f-40e5-bd33-c2e6cf2d4509\") " pod="e2e-models-e2e-worker-w0-6e996c/distinct-2-w0-6e996c-kserve-65666656f6-4wkkp"
Sep 15 11:47:10.047384 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:10.047362    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8687db22-f87f-40e5-bd33-c2e6cf2d4509-tls-certs\") pod \"distinct-2-w0-6e996c-kserve-65666656f6-4wkkp\" (UID: \"8687db22-f87f-40e5-bd33-c2e6cf2d4509\") " pod="e2e-models-e2e-worker-w0-6e996c/distinct-2-w0-6e996c-kserve-65666656f6-4wkkp"
Sep 15 11:47:10.055155 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:10.055119    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rfbs\" (UniqueName: \"kubernetes.io/projected/8687db22-f87f-40e5-bd33-c2e6cf2d4509-kube-api-access-8rfbs\") pod \"distinct-2-w0-6e996c-kserve-65666656f6-4wkkp\" (UID: \"8687db22-f87f-40e5-bd33-c2e6cf2d4509\") " pod="e2e-models-e2e-worker-w0-6e996c/distinct-2-w0-6e996c-kserve-65666656f6-4wkkp"
Sep 15 11:47:10.183389 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:10.183295    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-6e996c/distinct-2-w0-6e996c-kserve-65666656f6-4wkkp"
Sep 15 11:47:10.463865 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:10.463829    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-6e996c/distinct-2-w0-6e996c-kserve-65666656f6-4wkkp"]
Sep 15 11:47:10.465266 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:47:10.465237    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8687db22_f87f_40e5_bd33_c2e6cf2d4509.slice/crio-3d6685c9acb307c9f7e620859f3c993fdedf7297ad41e041c131e20f2c76ce43 WatchSource:0}: Error finding container 3d6685c9acb307c9f7e620859f3c993fdedf7297ad41e041c131e20f2c76ce43: Status 404 returned error can't find the container with id 3d6685c9acb307c9f7e620859f3c993fdedf7297ad41e041c131e20f2c76ce43
Sep 15 11:47:11.241163 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:11.241126    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-6e996c/distinct-2-w0-6e996c-kserve-65666656f6-4wkkp" event={"ID":"8687db22-f87f-40e5-bd33-c2e6cf2d4509","Type":"ContainerStarted","Data":"13a79956c8652671e26bda34506249020a8138d3b719bf3f607afb753075ca7c"}
Sep 15 11:47:11.241637 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:11.241177    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-6e996c/distinct-2-w0-6e996c-kserve-65666656f6-4wkkp" event={"ID":"8687db22-f87f-40e5-bd33-c2e6cf2d4509","Type":"ContainerStarted","Data":"3d6685c9acb307c9f7e620859f3c993fdedf7297ad41e041c131e20f2c76ce43"}
Sep 15 11:47:11.261311 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:11.261238    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-6e996c/distinct-2-w0-6e996c-kserve-65666656f6-4wkkp" podStartSLOduration=2.261213206 podStartE2EDuration="2.261213206s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:47:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:47:11.260598683 +0000 UTC m=+1301.686929291" watchObservedRunningTime="2026-09-15 11:47:11.261213206 +0000 UTC m=+1301.687543803"
Sep 15 11:47:18.061809 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:18.061764    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2cc790-f76d6d74-47wwt"]
Sep 15 11:47:18.066019 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:18.065996    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2cc790-f76d6d74-47wwt"
Sep 15 11:47:18.068302 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:18.068277    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-2cc790-serving-cert\""
Sep 15 11:47:18.075276 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:18.075240    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2cc790-f76d6d74-47wwt"]
Sep 15 11:47:18.239628 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:18.239590    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70810daa-c6ab-4571-beb6-a363f6af32a5-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-2cc790-f76d6d74-47wwt\" (UID: \"70810daa-c6ab-4571-beb6-a363f6af32a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2cc790-f76d6d74-47wwt"
Sep 15 11:47:18.239628 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:18.239634    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c487h\" (UniqueName: \"kubernetes.io/projected/70810daa-c6ab-4571-beb6-a363f6af32a5-kube-api-access-c487h\") pod \"maas-api-e2e-shared-b-w3-2cc790-f76d6d74-47wwt\" (UID: \"70810daa-c6ab-4571-beb6-a363f6af32a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2cc790-f76d6d74-47wwt"
Sep 15 11:47:18.239883 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:18.239689    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70810daa-c6ab-4571-beb6-a363f6af32a5-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-2cc790-f76d6d74-47wwt\" (UID: \"70810daa-c6ab-4571-beb6-a363f6af32a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2cc790-f76d6d74-47wwt"
Sep 15 11:47:18.239883 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:18.239770    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70810daa-c6ab-4571-beb6-a363f6af32a5-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-2cc790-f76d6d74-47wwt\" (UID: \"70810daa-c6ab-4571-beb6-a363f6af32a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2cc790-f76d6d74-47wwt"
Sep 15 11:47:18.341042 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:18.340996    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70810daa-c6ab-4571-beb6-a363f6af32a5-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-2cc790-f76d6d74-47wwt\" (UID: \"70810daa-c6ab-4571-beb6-a363f6af32a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2cc790-f76d6d74-47wwt"
Sep 15 11:47:18.341042 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:18.341046    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c487h\" (UniqueName: \"kubernetes.io/projected/70810daa-c6ab-4571-beb6-a363f6af32a5-kube-api-access-c487h\") pod \"maas-api-e2e-shared-b-w3-2cc790-f76d6d74-47wwt\" (UID: \"70810daa-c6ab-4571-beb6-a363f6af32a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2cc790-f76d6d74-47wwt"
Sep 15 11:47:18.341351 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:18.341090    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70810daa-c6ab-4571-beb6-a363f6af32a5-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-2cc790-f76d6d74-47wwt\" (UID: \"70810daa-c6ab-4571-beb6-a363f6af32a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2cc790-f76d6d74-47wwt"
Sep 15 11:47:18.341351 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:18.341126    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70810daa-c6ab-4571-beb6-a363f6af32a5-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-2cc790-f76d6d74-47wwt\" (UID: \"70810daa-c6ab-4571-beb6-a363f6af32a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2cc790-f76d6d74-47wwt"
Sep 15 11:47:18.341781 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:18.341756    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70810daa-c6ab-4571-beb6-a363f6af32a5-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-2cc790-f76d6d74-47wwt\" (UID: \"70810daa-c6ab-4571-beb6-a363f6af32a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2cc790-f76d6d74-47wwt"
Sep 15 11:47:18.343732 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:18.343699    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70810daa-c6ab-4571-beb6-a363f6af32a5-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-2cc790-f76d6d74-47wwt\" (UID: \"70810daa-c6ab-4571-beb6-a363f6af32a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2cc790-f76d6d74-47wwt"
Sep 15 11:47:18.343847 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:18.343744    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70810daa-c6ab-4571-beb6-a363f6af32a5-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-2cc790-f76d6d74-47wwt\" (UID: \"70810daa-c6ab-4571-beb6-a363f6af32a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2cc790-f76d6d74-47wwt"
Sep 15 11:47:18.358072 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:18.358038    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c487h\" (UniqueName: \"kubernetes.io/projected/70810daa-c6ab-4571-beb6-a363f6af32a5-kube-api-access-c487h\") pod \"maas-api-e2e-shared-b-w3-2cc790-f76d6d74-47wwt\" (UID: \"70810daa-c6ab-4571-beb6-a363f6af32a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2cc790-f76d6d74-47wwt"
Sep 15 11:47:18.381083 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:18.381040    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2cc790-f76d6d74-47wwt"
Sep 15 11:47:18.661784 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:18.661748    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2cc790-f76d6d74-47wwt"]
Sep 15 11:47:18.662750 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:47:18.662719    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70810daa_c6ab_4571_beb6_a363f6af32a5.slice/crio-5ccd459a263c7d71b3693ef4fec3cdd1013f03a353e5f7c5fcb687c6c8e73fff WatchSource:0}: Error finding container 5ccd459a263c7d71b3693ef4fec3cdd1013f03a353e5f7c5fcb687c6c8e73fff: Status 404 returned error can't find the container with id 5ccd459a263c7d71b3693ef4fec3cdd1013f03a353e5f7c5fcb687c6c8e73fff
Sep 15 11:47:19.298582 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:19.298477    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2cc790-f76d6d74-47wwt" event={"ID":"70810daa-c6ab-4571-beb6-a363f6af32a5","Type":"ContainerStarted","Data":"12a72ce08559981850459b8f067b881b78425e5874177d265983b886455d5035"}
Sep 15 11:47:19.298994 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:19.298671    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2cc790-f76d6d74-47wwt"
Sep 15 11:47:19.298994 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:19.298691    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2cc790-f76d6d74-47wwt" event={"ID":"70810daa-c6ab-4571-beb6-a363f6af32a5","Type":"ContainerStarted","Data":"5ccd459a263c7d71b3693ef4fec3cdd1013f03a353e5f7c5fcb687c6c8e73fff"}
Sep 15 11:47:19.318649 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:19.318588    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2cc790-f76d6d74-47wwt" podStartSLOduration=0.973416539 podStartE2EDuration="1.318569292s" totalImagesPullingTime="345.152753ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:47:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:47:19.317108024 +0000 UTC m=+1309.743438636" watchObservedRunningTime="2026-09-15 11:47:19.318569292 +0000 UTC m=+1309.744899888"
Sep 15 11:47:20.183448 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:20.183399    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-6e996c/distinct-2-w0-6e996c-kserve-65666656f6-4wkkp"
Sep 15 11:47:20.183707 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:20.183468    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-6e996c/distinct-2-w0-6e996c-kserve-65666656f6-4wkkp"
Sep 15 11:47:20.196675 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:20.196631    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-6e996c/distinct-2-w0-6e996c-kserve-65666656f6-4wkkp"
Sep 15 11:47:20.317498 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:20.317453    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-6e996c/distinct-2-w0-6e996c-kserve-65666656f6-4wkkp"
Sep 15 11:47:25.311716 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:25.311683    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2cc790-f76d6d74-47wwt"
Sep 15 11:47:30.710794 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:47:30.704589    2575 scope.go:117] "RemoveContainer" containerID="4edc6155c489ba2711ddd01208b4b4c27205354560c8b010f447be805edb3344"
Sep 15 11:48:03.782409 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:03.782309    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-b8fbdd/e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs"]
Sep 15 11:48:15.949042 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:15.948998    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-7efa8b/auth-test-model-7efa8b-kserve-65f58b5555-2jtvx"]
Sep 15 11:48:15.952880 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:15.952859    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-7efa8b/auth-test-model-7efa8b-kserve-65f58b5555-2jtvx"
Sep 15 11:48:15.956190 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:15.956159    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-7efa8b\"/\"openshift-service-ca.crt\""
Sep 15 11:48:15.956341 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:15.956159    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-7efa8b\"/\"kube-root-ca.crt\""
Sep 15 11:48:15.956341 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:15.956230    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-7efa8b\"/\"auth-test-model-7efa8b-kserve-self-signed-certs\""
Sep 15 11:48:15.956341 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:15.956255    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-7efa8b\"/\"default-dockercfg-l8jb7\""
Sep 15 11:48:15.966557 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:15.966524    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-7efa8b/auth-test-model-7efa8b-kserve-65f58b5555-2jtvx"]
Sep 15 11:48:16.054983 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:16.054926    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/414686ee-be96-4007-a988-b5a18dc58938-tmp-dir\") pod \"auth-test-model-7efa8b-kserve-65f58b5555-2jtvx\" (UID: \"414686ee-be96-4007-a988-b5a18dc58938\") " pod="ai-tenant-e2e-shared-a-w3-7efa8b/auth-test-model-7efa8b-kserve-65f58b5555-2jtvx"
Sep 15 11:48:16.055197 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:16.055008    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/414686ee-be96-4007-a988-b5a18dc58938-model-cache\") pod \"auth-test-model-7efa8b-kserve-65f58b5555-2jtvx\" (UID: \"414686ee-be96-4007-a988-b5a18dc58938\") " pod="ai-tenant-e2e-shared-a-w3-7efa8b/auth-test-model-7efa8b-kserve-65f58b5555-2jtvx"
Sep 15 11:48:16.055197 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:16.055103    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/414686ee-be96-4007-a988-b5a18dc58938-tls-certs\") pod \"auth-test-model-7efa8b-kserve-65f58b5555-2jtvx\" (UID: \"414686ee-be96-4007-a988-b5a18dc58938\") " pod="ai-tenant-e2e-shared-a-w3-7efa8b/auth-test-model-7efa8b-kserve-65f58b5555-2jtvx"
Sep 15 11:48:16.055197 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:16.055152    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/414686ee-be96-4007-a988-b5a18dc58938-dshm\") pod \"auth-test-model-7efa8b-kserve-65f58b5555-2jtvx\" (UID: \"414686ee-be96-4007-a988-b5a18dc58938\") " pod="ai-tenant-e2e-shared-a-w3-7efa8b/auth-test-model-7efa8b-kserve-65f58b5555-2jtvx"
Sep 15 11:48:16.055327 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:16.055264    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/414686ee-be96-4007-a988-b5a18dc58938-home\") pod \"auth-test-model-7efa8b-kserve-65f58b5555-2jtvx\" (UID: \"414686ee-be96-4007-a988-b5a18dc58938\") " pod="ai-tenant-e2e-shared-a-w3-7efa8b/auth-test-model-7efa8b-kserve-65f58b5555-2jtvx"
Sep 15 11:48:16.055327 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:16.055303    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85xbf\" (UniqueName: \"kubernetes.io/projected/414686ee-be96-4007-a988-b5a18dc58938-kube-api-access-85xbf\") pod \"auth-test-model-7efa8b-kserve-65f58b5555-2jtvx\" (UID: \"414686ee-be96-4007-a988-b5a18dc58938\") " pod="ai-tenant-e2e-shared-a-w3-7efa8b/auth-test-model-7efa8b-kserve-65f58b5555-2jtvx"
Sep 15 11:48:16.155932 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:16.155893    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85xbf\" (UniqueName: \"kubernetes.io/projected/414686ee-be96-4007-a988-b5a18dc58938-kube-api-access-85xbf\") pod \"auth-test-model-7efa8b-kserve-65f58b5555-2jtvx\" (UID: \"414686ee-be96-4007-a988-b5a18dc58938\") " pod="ai-tenant-e2e-shared-a-w3-7efa8b/auth-test-model-7efa8b-kserve-65f58b5555-2jtvx"
Sep 15 11:48:16.156156 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:16.155952    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/414686ee-be96-4007-a988-b5a18dc58938-tmp-dir\") pod \"auth-test-model-7efa8b-kserve-65f58b5555-2jtvx\" (UID: \"414686ee-be96-4007-a988-b5a18dc58938\") " pod="ai-tenant-e2e-shared-a-w3-7efa8b/auth-test-model-7efa8b-kserve-65f58b5555-2jtvx"
Sep 15 11:48:16.156156 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:16.156005    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/414686ee-be96-4007-a988-b5a18dc58938-model-cache\") pod \"auth-test-model-7efa8b-kserve-65f58b5555-2jtvx\" (UID: \"414686ee-be96-4007-a988-b5a18dc58938\") " pod="ai-tenant-e2e-shared-a-w3-7efa8b/auth-test-model-7efa8b-kserve-65f58b5555-2jtvx"
Sep 15 11:48:16.156156 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:16.156037    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/414686ee-be96-4007-a988-b5a18dc58938-tls-certs\") pod \"auth-test-model-7efa8b-kserve-65f58b5555-2jtvx\" (UID: \"414686ee-be96-4007-a988-b5a18dc58938\") " pod="ai-tenant-e2e-shared-a-w3-7efa8b/auth-test-model-7efa8b-kserve-65f58b5555-2jtvx"
Sep 15 11:48:16.156156 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:16.156061    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/414686ee-be96-4007-a988-b5a18dc58938-dshm\") pod \"auth-test-model-7efa8b-kserve-65f58b5555-2jtvx\" (UID: \"414686ee-be96-4007-a988-b5a18dc58938\") " pod="ai-tenant-e2e-shared-a-w3-7efa8b/auth-test-model-7efa8b-kserve-65f58b5555-2jtvx"
Sep 15 11:48:16.156156 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:16.156130    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/414686ee-be96-4007-a988-b5a18dc58938-home\") pod \"auth-test-model-7efa8b-kserve-65f58b5555-2jtvx\" (UID: \"414686ee-be96-4007-a988-b5a18dc58938\") " pod="ai-tenant-e2e-shared-a-w3-7efa8b/auth-test-model-7efa8b-kserve-65f58b5555-2jtvx"
Sep 15 11:48:16.156436 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:16.156388    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/414686ee-be96-4007-a988-b5a18dc58938-tmp-dir\") pod \"auth-test-model-7efa8b-kserve-65f58b5555-2jtvx\" (UID: \"414686ee-be96-4007-a988-b5a18dc58938\") " pod="ai-tenant-e2e-shared-a-w3-7efa8b/auth-test-model-7efa8b-kserve-65f58b5555-2jtvx"
Sep 15 11:48:16.156499 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:16.156480    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/414686ee-be96-4007-a988-b5a18dc58938-model-cache\") pod \"auth-test-model-7efa8b-kserve-65f58b5555-2jtvx\" (UID: \"414686ee-be96-4007-a988-b5a18dc58938\") " pod="ai-tenant-e2e-shared-a-w3-7efa8b/auth-test-model-7efa8b-kserve-65f58b5555-2jtvx"
Sep 15 11:48:16.156575 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:16.156554    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/414686ee-be96-4007-a988-b5a18dc58938-home\") pod \"auth-test-model-7efa8b-kserve-65f58b5555-2jtvx\" (UID: \"414686ee-be96-4007-a988-b5a18dc58938\") " pod="ai-tenant-e2e-shared-a-w3-7efa8b/auth-test-model-7efa8b-kserve-65f58b5555-2jtvx"
Sep 15 11:48:16.158448 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:16.158427    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/414686ee-be96-4007-a988-b5a18dc58938-dshm\") pod \"auth-test-model-7efa8b-kserve-65f58b5555-2jtvx\" (UID: \"414686ee-be96-4007-a988-b5a18dc58938\") " pod="ai-tenant-e2e-shared-a-w3-7efa8b/auth-test-model-7efa8b-kserve-65f58b5555-2jtvx"
Sep 15 11:48:16.158639 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:16.158620    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/414686ee-be96-4007-a988-b5a18dc58938-tls-certs\") pod \"auth-test-model-7efa8b-kserve-65f58b5555-2jtvx\" (UID: \"414686ee-be96-4007-a988-b5a18dc58938\") " pod="ai-tenant-e2e-shared-a-w3-7efa8b/auth-test-model-7efa8b-kserve-65f58b5555-2jtvx"
Sep 15 11:48:16.163532 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:16.163498    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85xbf\" (UniqueName: \"kubernetes.io/projected/414686ee-be96-4007-a988-b5a18dc58938-kube-api-access-85xbf\") pod \"auth-test-model-7efa8b-kserve-65f58b5555-2jtvx\" (UID: \"414686ee-be96-4007-a988-b5a18dc58938\") " pod="ai-tenant-e2e-shared-a-w3-7efa8b/auth-test-model-7efa8b-kserve-65f58b5555-2jtvx"
Sep 15 11:48:16.264564 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:16.264469    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-7efa8b/auth-test-model-7efa8b-kserve-65f58b5555-2jtvx"
Sep 15 11:48:16.548207 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:16.548170    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-7efa8b/auth-test-model-7efa8b-kserve-65f58b5555-2jtvx"]
Sep 15 11:48:16.549415 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:48:16.549376    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod414686ee_be96_4007_a988_b5a18dc58938.slice/crio-9dad9a16b57d537d5a6b6d43abb3ee2e8e59502bc34d0901a9e6b889f7fa46b5 WatchSource:0}: Error finding container 9dad9a16b57d537d5a6b6d43abb3ee2e8e59502bc34d0901a9e6b889f7fa46b5: Status 404 returned error can't find the container with id 9dad9a16b57d537d5a6b6d43abb3ee2e8e59502bc34d0901a9e6b889f7fa46b5
Sep 15 11:48:16.675259 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:16.675225    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-7efa8b/auth-test-model-7efa8b-kserve-65f58b5555-2jtvx" event={"ID":"414686ee-be96-4007-a988-b5a18dc58938","Type":"ContainerStarted","Data":"3cd4f31d302d416abc452880ed4daf930cf1e4d660cf7eeafea8a628ea1678a1"}
Sep 15 11:48:16.675434 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:16.675271    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-7efa8b/auth-test-model-7efa8b-kserve-65f58b5555-2jtvx" event={"ID":"414686ee-be96-4007-a988-b5a18dc58938","Type":"ContainerStarted","Data":"9dad9a16b57d537d5a6b6d43abb3ee2e8e59502bc34d0901a9e6b889f7fa46b5"}
Sep 15 11:48:16.694115 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:16.694058    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-7efa8b/auth-test-model-7efa8b-kserve-65f58b5555-2jtvx" podStartSLOduration=1.6940351809999998 podStartE2EDuration="1.694035181s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:48:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:48:16.691648959 +0000 UTC m=+1367.117979558" watchObservedRunningTime="2026-09-15 11:48:16.694035181 +0000 UTC m=+1367.120365777"
Sep 15 11:48:18.805106 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:18.805058    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-b8fbdd/e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs" podUID="d62e3b8d-b1fd-424a-acde-90576844bb74" containerName="main" containerID="cri-o://0fc1d0e7c0f3f2c03301f19d1d623cdf8bfd736a3c1a9d22b160d01b735eae9c" gracePeriod=45
Sep 15 11:48:19.056333 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:19.056263    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-b8fbdd/e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs"
Sep 15 11:48:19.193208 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:19.193162    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d62e3b8d-b1fd-424a-acde-90576844bb74-tmp-dir\") pod \"d62e3b8d-b1fd-424a-acde-90576844bb74\" (UID: \"d62e3b8d-b1fd-424a-acde-90576844bb74\") "
Sep 15 11:48:19.193208 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:19.193211    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d62e3b8d-b1fd-424a-acde-90576844bb74-dshm\") pod \"d62e3b8d-b1fd-424a-acde-90576844bb74\" (UID: \"d62e3b8d-b1fd-424a-acde-90576844bb74\") "
Sep 15 11:48:19.193465 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:19.193245    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfshc\" (UniqueName: \"kubernetes.io/projected/d62e3b8d-b1fd-424a-acde-90576844bb74-kube-api-access-xfshc\") pod \"d62e3b8d-b1fd-424a-acde-90576844bb74\" (UID: \"d62e3b8d-b1fd-424a-acde-90576844bb74\") "
Sep 15 11:48:19.193465 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:19.193266    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d62e3b8d-b1fd-424a-acde-90576844bb74-home\") pod \"d62e3b8d-b1fd-424a-acde-90576844bb74\" (UID: \"d62e3b8d-b1fd-424a-acde-90576844bb74\") "
Sep 15 11:48:19.193577 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:19.193504    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d62e3b8d-b1fd-424a-acde-90576844bb74-model-cache\") pod \"d62e3b8d-b1fd-424a-acde-90576844bb74\" (UID: \"d62e3b8d-b1fd-424a-acde-90576844bb74\") "
Sep 15 11:48:19.193637 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:19.193564    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d62e3b8d-b1fd-424a-acde-90576844bb74-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d62e3b8d-b1fd-424a-acde-90576844bb74" (UID: "d62e3b8d-b1fd-424a-acde-90576844bb74"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:48:19.193637 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:19.193604    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d62e3b8d-b1fd-424a-acde-90576844bb74-home" (OuterVolumeSpecName: "home") pod "d62e3b8d-b1fd-424a-acde-90576844bb74" (UID: "d62e3b8d-b1fd-424a-acde-90576844bb74"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:48:19.193637 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:19.193630    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d62e3b8d-b1fd-424a-acde-90576844bb74-tls-certs\") pod \"d62e3b8d-b1fd-424a-acde-90576844bb74\" (UID: \"d62e3b8d-b1fd-424a-acde-90576844bb74\") "
Sep 15 11:48:19.193817 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:19.193765    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d62e3b8d-b1fd-424a-acde-90576844bb74-model-cache" (OuterVolumeSpecName: "model-cache") pod "d62e3b8d-b1fd-424a-acde-90576844bb74" (UID: "d62e3b8d-b1fd-424a-acde-90576844bb74"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:48:19.194120 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:19.194099    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d62e3b8d-b1fd-424a-acde-90576844bb74-model-cache\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:48:19.194203 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:19.194124    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d62e3b8d-b1fd-424a-acde-90576844bb74-tmp-dir\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:48:19.194203 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:19.194136    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d62e3b8d-b1fd-424a-acde-90576844bb74-home\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:48:19.195644 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:19.195618    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d62e3b8d-b1fd-424a-acde-90576844bb74-dshm" (OuterVolumeSpecName: "dshm") pod "d62e3b8d-b1fd-424a-acde-90576844bb74" (UID: "d62e3b8d-b1fd-424a-acde-90576844bb74"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:48:19.195815 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:19.195731    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d62e3b8d-b1fd-424a-acde-90576844bb74-kube-api-access-xfshc" (OuterVolumeSpecName: "kube-api-access-xfshc") pod "d62e3b8d-b1fd-424a-acde-90576844bb74" (UID: "d62e3b8d-b1fd-424a-acde-90576844bb74"). InnerVolumeSpecName "kube-api-access-xfshc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:48:19.195878 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:19.195832    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d62e3b8d-b1fd-424a-acde-90576844bb74-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d62e3b8d-b1fd-424a-acde-90576844bb74" (UID: "d62e3b8d-b1fd-424a-acde-90576844bb74"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:48:19.295590 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:19.295545    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfshc\" (UniqueName: \"kubernetes.io/projected/d62e3b8d-b1fd-424a-acde-90576844bb74-kube-api-access-xfshc\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:48:19.295590 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:19.295582    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d62e3b8d-b1fd-424a-acde-90576844bb74-tls-certs\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:48:19.295590 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:19.295592    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d62e3b8d-b1fd-424a-acde-90576844bb74-dshm\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:48:19.697551 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:19.697507    2575 generic.go:356] "Generic (PLEG): container finished" podID="d62e3b8d-b1fd-424a-acde-90576844bb74" containerID="0fc1d0e7c0f3f2c03301f19d1d623cdf8bfd736a3c1a9d22b160d01b735eae9c" exitCode=0
Sep 15 11:48:19.697753 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:19.697615    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-b8fbdd/e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs"
Sep 15 11:48:19.697753 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:19.697634    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-b8fbdd/e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs" event={"ID":"d62e3b8d-b1fd-424a-acde-90576844bb74","Type":"ContainerDied","Data":"0fc1d0e7c0f3f2c03301f19d1d623cdf8bfd736a3c1a9d22b160d01b735eae9c"}
Sep 15 11:48:19.697753 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:19.697706    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-b8fbdd/e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs" event={"ID":"d62e3b8d-b1fd-424a-acde-90576844bb74","Type":"ContainerDied","Data":"795987bc6825c1eaf091c1708b474708a7c23c9cb8edb4f994e043255eb1560b"}
Sep 15 11:48:19.697753 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:19.697737    2575 scope.go:117] "RemoveContainer" containerID="0fc1d0e7c0f3f2c03301f19d1d623cdf8bfd736a3c1a9d22b160d01b735eae9c"
Sep 15 11:48:19.708937 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:19.708914    2575 scope.go:117] "RemoveContainer" containerID="0fc1d0e7c0f3f2c03301f19d1d623cdf8bfd736a3c1a9d22b160d01b735eae9c"
Sep 15 11:48:19.709292 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:48:19.709272    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fc1d0e7c0f3f2c03301f19d1d623cdf8bfd736a3c1a9d22b160d01b735eae9c\": container with ID starting with 0fc1d0e7c0f3f2c03301f19d1d623cdf8bfd736a3c1a9d22b160d01b735eae9c not found: ID does not exist" containerID="0fc1d0e7c0f3f2c03301f19d1d623cdf8bfd736a3c1a9d22b160d01b735eae9c"
Sep 15 11:48:19.709345 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:19.709304    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fc1d0e7c0f3f2c03301f19d1d623cdf8bfd736a3c1a9d22b160d01b735eae9c"} err="failed to get container status \"0fc1d0e7c0f3f2c03301f19d1d623cdf8bfd736a3c1a9d22b160d01b735eae9c\": rpc error: code = NotFound desc = could not find container \"0fc1d0e7c0f3f2c03301f19d1d623cdf8bfd736a3c1a9d22b160d01b735eae9c\": container with ID starting with 0fc1d0e7c0f3f2c03301f19d1d623cdf8bfd736a3c1a9d22b160d01b735eae9c not found: ID does not exist"
Sep 15 11:48:19.722258 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:19.722217    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-b8fbdd/e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs"]
Sep 15 11:48:19.726305 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:19.726269    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-b8fbdd/e2e-conflict-a-bc0d44e9-kserve-bd9cfffc8-9q5cs"]
Sep 15 11:48:20.095820 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:20.095783    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d62e3b8d-b1fd-424a-acde-90576844bb74" path="/var/lib/kubelet/pods/d62e3b8d-b1fd-424a-acde-90576844bb74/volumes"
Sep 15 11:48:26.265604 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:26.265562    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-7efa8b/auth-test-model-7efa8b-kserve-65f58b5555-2jtvx"
Sep 15 11:48:26.266040 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:26.265639    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-7efa8b/auth-test-model-7efa8b-kserve-65f58b5555-2jtvx"
Sep 15 11:48:26.278962 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:26.278925    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-7efa8b/auth-test-model-7efa8b-kserve-65f58b5555-2jtvx"
Sep 15 11:48:26.755026 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:26.754995    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-7efa8b/auth-test-model-7efa8b-kserve-65f58b5555-2jtvx"
Sep 15 11:48:34.247934 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:34.247895    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-b8fbdd/distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4"]
Sep 15 11:48:34.248487 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:34.248436    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d62e3b8d-b1fd-424a-acde-90576844bb74" containerName="main"
Sep 15 11:48:34.248487 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:34.248455    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d62e3b8d-b1fd-424a-acde-90576844bb74" containerName="main"
Sep 15 11:48:34.248642 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:34.248626    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d62e3b8d-b1fd-424a-acde-90576844bb74" containerName="main"
Sep 15 11:48:34.253107 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:34.253082    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-b8fbdd/distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4"
Sep 15 11:48:34.255461 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:34.255432    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-b8fbdd\"/\"distinct-w4-b8fbdd-kserve-self-signed-certs\""
Sep 15 11:48:34.263155 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:34.263121    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-b8fbdd/distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4"]
Sep 15 11:48:34.371018 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:34.370977    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/442873e9-2d63-4b4a-a5ec-40cb8f933063-home\") pod \"distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4\" (UID: \"442873e9-2d63-4b4a-a5ec-40cb8f933063\") " pod="e2e-models-e2e-worker-w4-b8fbdd/distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4"
Sep 15 11:48:34.371018 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:34.371017    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pnpx\" (UniqueName: \"kubernetes.io/projected/442873e9-2d63-4b4a-a5ec-40cb8f933063-kube-api-access-4pnpx\") pod \"distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4\" (UID: \"442873e9-2d63-4b4a-a5ec-40cb8f933063\") " pod="e2e-models-e2e-worker-w4-b8fbdd/distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4"
Sep 15 11:48:34.371241 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:34.371047    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/442873e9-2d63-4b4a-a5ec-40cb8f933063-dshm\") pod \"distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4\" (UID: \"442873e9-2d63-4b4a-a5ec-40cb8f933063\") " pod="e2e-models-e2e-worker-w4-b8fbdd/distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4"
Sep 15 11:48:34.371241 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:34.371113    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/442873e9-2d63-4b4a-a5ec-40cb8f933063-model-cache\") pod \"distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4\" (UID: \"442873e9-2d63-4b4a-a5ec-40cb8f933063\") " pod="e2e-models-e2e-worker-w4-b8fbdd/distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4"
Sep 15 11:48:34.371241 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:34.371163    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/442873e9-2d63-4b4a-a5ec-40cb8f933063-tmp-dir\") pod \"distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4\" (UID: \"442873e9-2d63-4b4a-a5ec-40cb8f933063\") " pod="e2e-models-e2e-worker-w4-b8fbdd/distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4"
Sep 15 11:48:34.371241 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:34.371217    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/442873e9-2d63-4b4a-a5ec-40cb8f933063-tls-certs\") pod \"distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4\" (UID: \"442873e9-2d63-4b4a-a5ec-40cb8f933063\") " pod="e2e-models-e2e-worker-w4-b8fbdd/distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4"
Sep 15 11:48:34.472029 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:34.471982    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/442873e9-2d63-4b4a-a5ec-40cb8f933063-tls-certs\") pod \"distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4\" (UID: \"442873e9-2d63-4b4a-a5ec-40cb8f933063\") " pod="e2e-models-e2e-worker-w4-b8fbdd/distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4"
Sep 15 11:48:34.472207 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:34.472069    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/442873e9-2d63-4b4a-a5ec-40cb8f933063-home\") pod \"distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4\" (UID: \"442873e9-2d63-4b4a-a5ec-40cb8f933063\") " pod="e2e-models-e2e-worker-w4-b8fbdd/distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4"
Sep 15 11:48:34.472207 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:34.472094    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pnpx\" (UniqueName: \"kubernetes.io/projected/442873e9-2d63-4b4a-a5ec-40cb8f933063-kube-api-access-4pnpx\") pod \"distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4\" (UID: \"442873e9-2d63-4b4a-a5ec-40cb8f933063\") " pod="e2e-models-e2e-worker-w4-b8fbdd/distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4"
Sep 15 11:48:34.472207 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:34.472120    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/442873e9-2d63-4b4a-a5ec-40cb8f933063-dshm\") pod \"distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4\" (UID: \"442873e9-2d63-4b4a-a5ec-40cb8f933063\") " pod="e2e-models-e2e-worker-w4-b8fbdd/distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4"
Sep 15 11:48:34.472207 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:34.472191    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/442873e9-2d63-4b4a-a5ec-40cb8f933063-model-cache\") pod \"distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4\" (UID: \"442873e9-2d63-4b4a-a5ec-40cb8f933063\") " pod="e2e-models-e2e-worker-w4-b8fbdd/distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4"
Sep 15 11:48:34.472504 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:34.472222    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/442873e9-2d63-4b4a-a5ec-40cb8f933063-tmp-dir\") pod \"distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4\" (UID: \"442873e9-2d63-4b4a-a5ec-40cb8f933063\") " pod="e2e-models-e2e-worker-w4-b8fbdd/distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4"
Sep 15 11:48:34.472616 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:34.472591    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/442873e9-2d63-4b4a-a5ec-40cb8f933063-home\") pod \"distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4\" (UID: \"442873e9-2d63-4b4a-a5ec-40cb8f933063\") " pod="e2e-models-e2e-worker-w4-b8fbdd/distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4"
Sep 15 11:48:34.472718 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:34.472619    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/442873e9-2d63-4b4a-a5ec-40cb8f933063-tmp-dir\") pod \"distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4\" (UID: \"442873e9-2d63-4b4a-a5ec-40cb8f933063\") " pod="e2e-models-e2e-worker-w4-b8fbdd/distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4"
Sep 15 11:48:34.472782 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:34.472728    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/442873e9-2d63-4b4a-a5ec-40cb8f933063-model-cache\") pod \"distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4\" (UID: \"442873e9-2d63-4b4a-a5ec-40cb8f933063\") " pod="e2e-models-e2e-worker-w4-b8fbdd/distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4"
Sep 15 11:48:34.474475 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:34.474455    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/442873e9-2d63-4b4a-a5ec-40cb8f933063-dshm\") pod \"distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4\" (UID: \"442873e9-2d63-4b4a-a5ec-40cb8f933063\") " pod="e2e-models-e2e-worker-w4-b8fbdd/distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4"
Sep 15 11:48:34.474698 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:34.474676    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/442873e9-2d63-4b4a-a5ec-40cb8f933063-tls-certs\") pod \"distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4\" (UID: \"442873e9-2d63-4b4a-a5ec-40cb8f933063\") " pod="e2e-models-e2e-worker-w4-b8fbdd/distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4"
Sep 15 11:48:34.479713 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:34.479636    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pnpx\" (UniqueName: \"kubernetes.io/projected/442873e9-2d63-4b4a-a5ec-40cb8f933063-kube-api-access-4pnpx\") pod \"distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4\" (UID: \"442873e9-2d63-4b4a-a5ec-40cb8f933063\") " pod="e2e-models-e2e-worker-w4-b8fbdd/distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4"
Sep 15 11:48:34.564394 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:34.564290    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-b8fbdd/distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4"
Sep 15 11:48:34.845017 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:34.844975    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-b8fbdd/distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4"]
Sep 15 11:48:34.846261 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:48:34.846220    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod442873e9_2d63_4b4a_a5ec_40cb8f933063.slice/crio-06a3705358eca51d94b139ad38240da47991812aa947febb85b4e9940fb4e92f WatchSource:0}: Error finding container 06a3705358eca51d94b139ad38240da47991812aa947febb85b4e9940fb4e92f: Status 404 returned error can't find the container with id 06a3705358eca51d94b139ad38240da47991812aa947febb85b4e9940fb4e92f
Sep 15 11:48:35.806008 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:35.805957    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-b8fbdd/distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4" event={"ID":"442873e9-2d63-4b4a-a5ec-40cb8f933063","Type":"ContainerStarted","Data":"cb77292f82911ece454475f75a2b4bc5f7aa34edd87d057841c8887dfb6e7403"}
Sep 15 11:48:35.806008 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:35.806011    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-b8fbdd/distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4" event={"ID":"442873e9-2d63-4b4a-a5ec-40cb8f933063","Type":"ContainerStarted","Data":"06a3705358eca51d94b139ad38240da47991812aa947febb85b4e9940fb4e92f"}
Sep 15 11:48:35.824116 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:35.824044    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-b8fbdd/distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4" podStartSLOduration=1.824020569 podStartE2EDuration="1.824020569s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:48:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:48:35.822855817 +0000 UTC m=+1386.249186426" watchObservedRunningTime="2026-09-15 11:48:35.824020569 +0000 UTC m=+1386.250351167"
Sep 15 11:48:44.565386 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:44.565340    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-b8fbdd/distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4"
Sep 15 11:48:44.565848 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:44.565403    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-b8fbdd/distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4"
Sep 15 11:48:44.578380 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:44.578347    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-b8fbdd/distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4"
Sep 15 11:48:44.874381 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:44.874346    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-b8fbdd/distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4"
Sep 15 11:48:45.774878 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:45.774836    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-baee2b93-86c695f8d5-v796c"]
Sep 15 11:48:45.775399 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:45.775076    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-baee2b93-86c695f8d5-v796c" podUID="5d7178e6-9d58-4803-b60f-7b14a30ab686" containerName="maas-api" containerID="cri-o://623d133db40eea67cc96bc3eee7b638bfcb43e763927277fd42312ea3ada7e93" gracePeriod=30
Sep 15 11:48:46.050560 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:46.050532    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-baee2b93-86c695f8d5-v796c"
Sep 15 11:48:46.202516 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:46.202468    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d7178e6-9d58-4803-b60f-7b14a30ab686-openshift-service-ca\") pod \"5d7178e6-9d58-4803-b60f-7b14a30ab686\" (UID: \"5d7178e6-9d58-4803-b60f-7b14a30ab686\") "
Sep 15 11:48:46.202778 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:46.202613    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d7178e6-9d58-4803-b60f-7b14a30ab686-metrics-certs\") pod \"5d7178e6-9d58-4803-b60f-7b14a30ab686\" (UID: \"5d7178e6-9d58-4803-b60f-7b14a30ab686\") "
Sep 15 11:48:46.202778 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:46.202641    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x45qb\" (UniqueName: \"kubernetes.io/projected/5d7178e6-9d58-4803-b60f-7b14a30ab686-kube-api-access-x45qb\") pod \"5d7178e6-9d58-4803-b60f-7b14a30ab686\" (UID: \"5d7178e6-9d58-4803-b60f-7b14a30ab686\") "
Sep 15 11:48:46.202778 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:46.202700    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d7178e6-9d58-4803-b60f-7b14a30ab686-maas-api-tls\") pod \"5d7178e6-9d58-4803-b60f-7b14a30ab686\" (UID: \"5d7178e6-9d58-4803-b60f-7b14a30ab686\") "
Sep 15 11:48:46.202986 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:46.202906    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d7178e6-9d58-4803-b60f-7b14a30ab686-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5d7178e6-9d58-4803-b60f-7b14a30ab686" (UID: "5d7178e6-9d58-4803-b60f-7b14a30ab686"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:48:46.203211 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:46.203186    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d7178e6-9d58-4803-b60f-7b14a30ab686-openshift-service-ca\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:48:46.205066 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:46.205029    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d7178e6-9d58-4803-b60f-7b14a30ab686-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5d7178e6-9d58-4803-b60f-7b14a30ab686" (UID: "5d7178e6-9d58-4803-b60f-7b14a30ab686"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:48:46.205066 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:46.205046    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d7178e6-9d58-4803-b60f-7b14a30ab686-kube-api-access-x45qb" (OuterVolumeSpecName: "kube-api-access-x45qb") pod "5d7178e6-9d58-4803-b60f-7b14a30ab686" (UID: "5d7178e6-9d58-4803-b60f-7b14a30ab686"). InnerVolumeSpecName "kube-api-access-x45qb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:48:46.205232 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:46.205051    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d7178e6-9d58-4803-b60f-7b14a30ab686-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5d7178e6-9d58-4803-b60f-7b14a30ab686" (UID: "5d7178e6-9d58-4803-b60f-7b14a30ab686"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:48:46.303995 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:46.303895    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d7178e6-9d58-4803-b60f-7b14a30ab686-metrics-certs\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:48:46.303995 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:46.303928    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x45qb\" (UniqueName: \"kubernetes.io/projected/5d7178e6-9d58-4803-b60f-7b14a30ab686-kube-api-access-x45qb\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:48:46.303995 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:46.303939    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d7178e6-9d58-4803-b60f-7b14a30ab686-maas-api-tls\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:48:46.877990 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:46.877952    2575 generic.go:356] "Generic (PLEG): container finished" podID="5d7178e6-9d58-4803-b60f-7b14a30ab686" containerID="623d133db40eea67cc96bc3eee7b638bfcb43e763927277fd42312ea3ada7e93" exitCode=0
Sep 15 11:48:46.878570 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:46.878006    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-baee2b93-86c695f8d5-v796c"
Sep 15 11:48:46.878570 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:46.878039    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-baee2b93-86c695f8d5-v796c" event={"ID":"5d7178e6-9d58-4803-b60f-7b14a30ab686","Type":"ContainerDied","Data":"623d133db40eea67cc96bc3eee7b638bfcb43e763927277fd42312ea3ada7e93"}
Sep 15 11:48:46.878570 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:46.878108    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-baee2b93-86c695f8d5-v796c" event={"ID":"5d7178e6-9d58-4803-b60f-7b14a30ab686","Type":"ContainerDied","Data":"b9f0e09393e99dc159f06989609d0073ffb34243bd3ea78da9020355711458fe"}
Sep 15 11:48:46.878570 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:46.878144    2575 scope.go:117] "RemoveContainer" containerID="623d133db40eea67cc96bc3eee7b638bfcb43e763927277fd42312ea3ada7e93"
Sep 15 11:48:46.889447 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:46.889424    2575 scope.go:117] "RemoveContainer" containerID="623d133db40eea67cc96bc3eee7b638bfcb43e763927277fd42312ea3ada7e93"
Sep 15 11:48:46.889845 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:48:46.889817    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"623d133db40eea67cc96bc3eee7b638bfcb43e763927277fd42312ea3ada7e93\": container with ID starting with 623d133db40eea67cc96bc3eee7b638bfcb43e763927277fd42312ea3ada7e93 not found: ID does not exist" containerID="623d133db40eea67cc96bc3eee7b638bfcb43e763927277fd42312ea3ada7e93"
Sep 15 11:48:46.889927 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:46.889855    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"623d133db40eea67cc96bc3eee7b638bfcb43e763927277fd42312ea3ada7e93"} err="failed to get container status \"623d133db40eea67cc96bc3eee7b638bfcb43e763927277fd42312ea3ada7e93\": rpc error: code = NotFound desc = could not find container \"623d133db40eea67cc96bc3eee7b638bfcb43e763927277fd42312ea3ada7e93\": container with ID starting with 623d133db40eea67cc96bc3eee7b638bfcb43e763927277fd42312ea3ada7e93 not found: ID does not exist"
Sep 15 11:48:46.900198 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:46.900165    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-baee2b93-86c695f8d5-v796c"]
Sep 15 11:48:46.904398 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:46.904368    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-baee2b93-86c695f8d5-v796c"]
Sep 15 11:48:48.095073 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:48:48.095041    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d7178e6-9d58-4803-b60f-7b14a30ab686" path="/var/lib/kubelet/pods/5d7178e6-9d58-4803-b60f-7b14a30ab686/volumes"
Sep 15 11:49:03.257134 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:49:03.257086    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-2cc790/auth-test-model-2cc790-kserve-7f64d4b859-r9dt9"]
Sep 15 11:49:03.257611 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:49:03.257596    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d7178e6-9d58-4803-b60f-7b14a30ab686" containerName="maas-api"
Sep 15 11:49:03.257611 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:49:03.257612    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d7178e6-9d58-4803-b60f-7b14a30ab686" containerName="maas-api"
Sep 15 11:49:03.257743 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:49:03.257721    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d7178e6-9d58-4803-b60f-7b14a30ab686" containerName="maas-api"
Sep 15 11:49:03.261188 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:49:03.261155    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-2cc790/auth-test-model-2cc790-kserve-7f64d4b859-r9dt9"
Sep 15 11:49:03.264447 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:49:03.264414    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-2cc790\"/\"openshift-service-ca.crt\""
Sep 15 11:49:03.264628 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:49:03.264470    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-2cc790\"/\"kube-root-ca.crt\""
Sep 15 11:49:03.264628 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:49:03.264489    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-2cc790\"/\"default-dockercfg-987px\""
Sep 15 11:49:03.264628 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:49:03.264512    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-2cc790\"/\"auth-test-model-2cc790-kserve-self-signed-certs\""
Sep 15 11:49:03.270751 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:49:03.269731    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-2cc790/auth-test-model-2cc790-kserve-7f64d4b859-r9dt9"]
Sep 15 11:49:03.383050 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:49:03.383004    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6990fda7-6441-4a18-a7c9-2689a933d388-home\") pod \"auth-test-model-2cc790-kserve-7f64d4b859-r9dt9\" (UID: \"6990fda7-6441-4a18-a7c9-2689a933d388\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/auth-test-model-2cc790-kserve-7f64d4b859-r9dt9"
Sep 15 11:49:03.383050 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:49:03.383054    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6990fda7-6441-4a18-a7c9-2689a933d388-tmp-dir\") pod \"auth-test-model-2cc790-kserve-7f64d4b859-r9dt9\" (UID: \"6990fda7-6441-4a18-a7c9-2689a933d388\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/auth-test-model-2cc790-kserve-7f64d4b859-r9dt9"
Sep 15 11:49:03.383274 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:49:03.383147    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6990fda7-6441-4a18-a7c9-2689a933d388-model-cache\") pod \"auth-test-model-2cc790-kserve-7f64d4b859-r9dt9\" (UID: \"6990fda7-6441-4a18-a7c9-2689a933d388\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/auth-test-model-2cc790-kserve-7f64d4b859-r9dt9"
Sep 15 11:49:03.383274 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:49:03.383170    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksgpb\" (UniqueName: \"kubernetes.io/projected/6990fda7-6441-4a18-a7c9-2689a933d388-kube-api-access-ksgpb\") pod \"auth-test-model-2cc790-kserve-7f64d4b859-r9dt9\" (UID: \"6990fda7-6441-4a18-a7c9-2689a933d388\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/auth-test-model-2cc790-kserve-7f64d4b859-r9dt9"
Sep 15 11:49:03.383274 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:49:03.383259    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6990fda7-6441-4a18-a7c9-2689a933d388-tls-certs\") pod \"auth-test-model-2cc790-kserve-7f64d4b859-r9dt9\" (UID: \"6990fda7-6441-4a18-a7c9-2689a933d388\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/auth-test-model-2cc790-kserve-7f64d4b859-r9dt9"
Sep 15 11:49:03.383381 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:49:03.383315    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6990fda7-6441-4a18-a7c9-2689a933d388-dshm\") pod \"auth-test-model-2cc790-kserve-7f64d4b859-r9dt9\" (UID: \"6990fda7-6441-4a18-a7c9-2689a933d388\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/auth-test-model-2cc790-kserve-7f64d4b859-r9dt9"
Sep 15 11:49:03.484728 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:49:03.484681    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6990fda7-6441-4a18-a7c9-2689a933d388-tls-certs\") pod \"auth-test-model-2cc790-kserve-7f64d4b859-r9dt9\" (UID: \"6990fda7-6441-4a18-a7c9-2689a933d388\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/auth-test-model-2cc790-kserve-7f64d4b859-r9dt9"
Sep 15 11:49:03.484910 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:49:03.484759    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6990fda7-6441-4a18-a7c9-2689a933d388-dshm\") pod \"auth-test-model-2cc790-kserve-7f64d4b859-r9dt9\" (UID: \"6990fda7-6441-4a18-a7c9-2689a933d388\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/auth-test-model-2cc790-kserve-7f64d4b859-r9dt9"
Sep 15 11:49:03.484910 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:49:03.484823    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6990fda7-6441-4a18-a7c9-2689a933d388-home\") pod \"auth-test-model-2cc790-kserve-7f64d4b859-r9dt9\" (UID: \"6990fda7-6441-4a18-a7c9-2689a933d388\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/auth-test-model-2cc790-kserve-7f64d4b859-r9dt9"
Sep 15 11:49:03.484910 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:49:03.484858    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6990fda7-6441-4a18-a7c9-2689a933d388-tmp-dir\") pod \"auth-test-model-2cc790-kserve-7f64d4b859-r9dt9\" (UID: \"6990fda7-6441-4a18-a7c9-2689a933d388\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/auth-test-model-2cc790-kserve-7f64d4b859-r9dt9"
Sep 15 11:49:03.485034 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:49:03.484966    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6990fda7-6441-4a18-a7c9-2689a933d388-model-cache\") pod \"auth-test-model-2cc790-kserve-7f64d4b859-r9dt9\" (UID: \"6990fda7-6441-4a18-a7c9-2689a933d388\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/auth-test-model-2cc790-kserve-7f64d4b859-r9dt9"
Sep 15 11:49:03.485034 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:49:03.485002    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksgpb\" (UniqueName: \"kubernetes.io/projected/6990fda7-6441-4a18-a7c9-2689a933d388-kube-api-access-ksgpb\") pod \"auth-test-model-2cc790-kserve-7f64d4b859-r9dt9\" (UID: \"6990fda7-6441-4a18-a7c9-2689a933d388\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/auth-test-model-2cc790-kserve-7f64d4b859-r9dt9"
Sep 15 11:49:03.485295 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:49:03.485270    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6990fda7-6441-4a18-a7c9-2689a933d388-home\") pod \"auth-test-model-2cc790-kserve-7f64d4b859-r9dt9\" (UID: \"6990fda7-6441-4a18-a7c9-2689a933d388\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/auth-test-model-2cc790-kserve-7f64d4b859-r9dt9"
Sep 15 11:49:03.485406 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:49:03.485297    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6990fda7-6441-4a18-a7c9-2689a933d388-model-cache\") pod \"auth-test-model-2cc790-kserve-7f64d4b859-r9dt9\" (UID: \"6990fda7-6441-4a18-a7c9-2689a933d388\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/auth-test-model-2cc790-kserve-7f64d4b859-r9dt9"
Sep 15 11:49:03.485406 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:49:03.485326    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6990fda7-6441-4a18-a7c9-2689a933d388-tmp-dir\") pod \"auth-test-model-2cc790-kserve-7f64d4b859-r9dt9\" (UID: \"6990fda7-6441-4a18-a7c9-2689a933d388\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/auth-test-model-2cc790-kserve-7f64d4b859-r9dt9"
Sep 15 11:49:03.487150 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:49:03.487116    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6990fda7-6441-4a18-a7c9-2689a933d388-dshm\") pod \"auth-test-model-2cc790-kserve-7f64d4b859-r9dt9\" (UID: \"6990fda7-6441-4a18-a7c9-2689a933d388\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/auth-test-model-2cc790-kserve-7f64d4b859-r9dt9"
Sep 15 11:49:03.487394 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:49:03.487376    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6990fda7-6441-4a18-a7c9-2689a933d388-tls-certs\") pod \"auth-test-model-2cc790-kserve-7f64d4b859-r9dt9\" (UID: \"6990fda7-6441-4a18-a7c9-2689a933d388\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/auth-test-model-2cc790-kserve-7f64d4b859-r9dt9"
Sep 15 11:49:03.492971 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:49:03.492943    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksgpb\" (UniqueName: \"kubernetes.io/projected/6990fda7-6441-4a18-a7c9-2689a933d388-kube-api-access-ksgpb\") pod \"auth-test-model-2cc790-kserve-7f64d4b859-r9dt9\" (UID: \"6990fda7-6441-4a18-a7c9-2689a933d388\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/auth-test-model-2cc790-kserve-7f64d4b859-r9dt9"
Sep 15 11:49:03.574487 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:49:03.574446    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-2cc790/auth-test-model-2cc790-kserve-7f64d4b859-r9dt9"
Sep 15 11:49:03.851067 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:49:03.851038    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-2cc790/auth-test-model-2cc790-kserve-7f64d4b859-r9dt9"]
Sep 15 11:49:03.852371 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:49:03.852343    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6990fda7_6441_4a18_a7c9_2689a933d388.slice/crio-a7e79a88b07c7acd97b1610e2311abb9ed04cea5d3e0e9bc5a05f3baa66c8579 WatchSource:0}: Error finding container a7e79a88b07c7acd97b1610e2311abb9ed04cea5d3e0e9bc5a05f3baa66c8579: Status 404 returned error can't find the container with id a7e79a88b07c7acd97b1610e2311abb9ed04cea5d3e0e9bc5a05f3baa66c8579
Sep 15 11:49:03.990625 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:49:03.990587    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-2cc790/auth-test-model-2cc790-kserve-7f64d4b859-r9dt9" event={"ID":"6990fda7-6441-4a18-a7c9-2689a933d388","Type":"ContainerStarted","Data":"d67eeca5939b4c4267f3ecdffeadc8605199c25272c2932446958cf084cc99be"}
Sep 15 11:49:03.990826 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:49:03.990635    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-2cc790/auth-test-model-2cc790-kserve-7f64d4b859-r9dt9" event={"ID":"6990fda7-6441-4a18-a7c9-2689a933d388","Type":"ContainerStarted","Data":"a7e79a88b07c7acd97b1610e2311abb9ed04cea5d3e0e9bc5a05f3baa66c8579"}
Sep 15 11:49:04.008846 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:49:04.008786    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-2cc790/auth-test-model-2cc790-kserve-7f64d4b859-r9dt9" podStartSLOduration=1.008763963 podStartE2EDuration="1.008763963s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:49:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:49:04.005953521 +0000 UTC m=+1414.432284123" watchObservedRunningTime="2026-09-15 11:49:04.008763963 +0000 UTC m=+1414.435094559"
Sep 15 11:49:13.575366 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:49:13.575326    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-2cc790/auth-test-model-2cc790-kserve-7f64d4b859-r9dt9"
Sep 15 11:49:13.575366 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:49:13.575377    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-2cc790/auth-test-model-2cc790-kserve-7f64d4b859-r9dt9"
Sep 15 11:49:13.588437 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:49:13.588393    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-2cc790/auth-test-model-2cc790-kserve-7f64d4b859-r9dt9"
Sep 15 11:49:14.067693 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:49:14.067576    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-2cc790/auth-test-model-2cc790-kserve-7f64d4b859-r9dt9"
Sep 15 11:51:17.066495 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:17.066394    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln"]
Sep 15 11:51:17.070723 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:17.070694    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln"
Sep 15 11:51:17.072987 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:17.072963    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-2f0e97-serving-cert\""
Sep 15 11:51:17.080755 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:17.080720    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2-openshift-service-ca\") pod \"maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln\" (UID: \"f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln"
Sep 15 11:51:17.080966 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:17.080941    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2-metrics-certs\") pod \"maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln\" (UID: \"f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln"
Sep 15 11:51:17.081128 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:17.081104    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2-maas-api-tls\") pod \"maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln\" (UID: \"f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln"
Sep 15 11:51:17.081255 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:17.081139    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hldsm\" (UniqueName: \"kubernetes.io/projected/f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2-kube-api-access-hldsm\") pod \"maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln\" (UID: \"f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln"
Sep 15 11:51:17.083409 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:17.083384    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln"]
Sep 15 11:51:17.181945 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:17.181911    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2-openshift-service-ca\") pod \"maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln\" (UID: \"f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln"
Sep 15 11:51:17.182171 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:17.181955    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2-metrics-certs\") pod \"maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln\" (UID: \"f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln"
Sep 15 11:51:17.182171 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:17.182079    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2-maas-api-tls\") pod \"maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln\" (UID: \"f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln"
Sep 15 11:51:17.182171 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:51:17.182163    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-2f0e97-serving-cert: secret "maas-api-e2e-api-b-2f0e97-serving-cert" not found
Sep 15 11:51:17.182365 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:51:17.182228    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2-maas-api-tls podName:f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2 nodeName:}" failed. No retries permitted until 2026-09-15 11:51:17.682207358 +0000 UTC m=+1548.108537936 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2-maas-api-tls") pod "maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln" (UID: "f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2") : secret "maas-api-e2e-api-b-2f0e97-serving-cert" not found
Sep 15 11:51:17.182454 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:17.182433    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hldsm\" (UniqueName: \"kubernetes.io/projected/f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2-kube-api-access-hldsm\") pod \"maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln\" (UID: \"f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln"
Sep 15 11:51:17.182769 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:17.182744    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2-openshift-service-ca\") pod \"maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln\" (UID: \"f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln"
Sep 15 11:51:17.184892 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:17.184867    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2-metrics-certs\") pod \"maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln\" (UID: \"f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln"
Sep 15 11:51:17.192598 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:17.192566    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hldsm\" (UniqueName: \"kubernetes.io/projected/f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2-kube-api-access-hldsm\") pod \"maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln\" (UID: \"f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln"
Sep 15 11:51:17.686891 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:17.686800    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2-maas-api-tls\") pod \"maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln\" (UID: \"f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln"
Sep 15 11:51:17.689499 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:17.689454    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2-maas-api-tls\") pod \"maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln\" (UID: \"f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln"
Sep 15 11:51:17.983034 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:17.982922    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln"
Sep 15 11:51:18.280457 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:18.280429    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln"]
Sep 15 11:51:18.282633 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:51:18.282603    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3ea1a0b_e27a_46bc_8f1e_3690dd64dbe2.slice/crio-1f1891d9d1f9b10cce3214560b2a4c93721eedd10e61b1360e67e8c957f1155a WatchSource:0}: Error finding container 1f1891d9d1f9b10cce3214560b2a4c93721eedd10e61b1360e67e8c957f1155a: Status 404 returned error can't find the container with id 1f1891d9d1f9b10cce3214560b2a4c93721eedd10e61b1360e67e8c957f1155a
Sep 15 11:51:18.905324 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:18.905273    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln" event={"ID":"f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2","Type":"ContainerStarted","Data":"0b27754d7b83773a63099d05c6a423c5a6c7381bca5dbf6788fb66e9d6585468"}
Sep 15 11:51:18.905518 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:18.905337    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln" event={"ID":"f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2","Type":"ContainerStarted","Data":"1f1891d9d1f9b10cce3214560b2a4c93721eedd10e61b1360e67e8c957f1155a"}
Sep 15 11:51:18.905518 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:18.905362    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln"
Sep 15 11:51:18.926270 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:18.926197    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln" podStartSLOduration=1.521794802 podStartE2EDuration="1.926174131s" totalImagesPullingTime="404.379329ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:51:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:51:18.923447974 +0000 UTC m=+1549.349778570" watchObservedRunningTime="2026-09-15 11:51:18.926174131 +0000 UTC m=+1549.352504729"
Sep 15 11:51:21.979464 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:21.979422    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-6e996c/distinct-2-w0-6e996c-kserve-65666656f6-4wkkp"]
Sep 15 11:51:21.985205 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:21.985169    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-6e996c/distinct-w0-6e996c-kserve-846f8969b7-956r5"]
Sep 15 11:51:22.002732 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:22.002686    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-6e996c/premium-w0-6e996c-kserve-568c8f4784-q9r2n"]
Sep 15 11:51:24.918771 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:24.918740    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln"
Sep 15 11:51:30.793293 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:30.793259    2575 scope.go:117] "RemoveContainer" containerID="25fb1d9c5a83e39f045148ec4d02724755e36ebd10499796bb98ac3dbd4155e2"
Sep 15 11:51:33.082871 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:33.082827    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-6e996c-29824545-7hrrt"]
Sep 15 11:51:33.086046 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:33.086015    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-6e996c-29824545-7hrrt"]
Sep 15 11:51:33.114733 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:33.114694    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-6e996c-95fc4785d-5dt6z"]
Sep 15 11:51:33.115210 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:33.114926    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-6e996c-95fc4785d-5dt6z" podUID="594ad813-675e-4fdb-a380-dba18fb562ca" containerName="payload-pre-processing" containerID="cri-o://35313b315335f1c1d2c3bf216eea425d4712a1e14c7e84cd76a903026090ae94" gracePeriod=30
Sep 15 11:51:33.377938 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:33.377903    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-6e996c-95fc4785d-5dt6z"
Sep 15 11:51:33.462394 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:33.462354    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/594ad813-675e-4fdb-a380-dba18fb562ca-plugins-config-volume\") pod \"594ad813-675e-4fdb-a380-dba18fb562ca\" (UID: \"594ad813-675e-4fdb-a380-dba18fb562ca\") "
Sep 15 11:51:33.462611 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:33.462529    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdzx5\" (UniqueName: \"kubernetes.io/projected/594ad813-675e-4fdb-a380-dba18fb562ca-kube-api-access-gdzx5\") pod \"594ad813-675e-4fdb-a380-dba18fb562ca\" (UID: \"594ad813-675e-4fdb-a380-dba18fb562ca\") "
Sep 15 11:51:33.462866 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:33.462842    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/594ad813-675e-4fdb-a380-dba18fb562ca-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "594ad813-675e-4fdb-a380-dba18fb562ca" (UID: "594ad813-675e-4fdb-a380-dba18fb562ca"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:51:33.462984 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:33.462970    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/594ad813-675e-4fdb-a380-dba18fb562ca-plugins-config-volume\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:51:33.464836 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:33.464803    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/594ad813-675e-4fdb-a380-dba18fb562ca-kube-api-access-gdzx5" (OuterVolumeSpecName: "kube-api-access-gdzx5") pod "594ad813-675e-4fdb-a380-dba18fb562ca" (UID: "594ad813-675e-4fdb-a380-dba18fb562ca"). InnerVolumeSpecName "kube-api-access-gdzx5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:51:33.564265 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:33.564213    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdzx5\" (UniqueName: \"kubernetes.io/projected/594ad813-675e-4fdb-a380-dba18fb562ca-kube-api-access-gdzx5\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:51:34.013084 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:34.013053    2575 generic.go:356] "Generic (PLEG): container finished" podID="594ad813-675e-4fdb-a380-dba18fb562ca" containerID="35313b315335f1c1d2c3bf216eea425d4712a1e14c7e84cd76a903026090ae94" exitCode=0
Sep 15 11:51:34.013307 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:34.013102    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-6e996c-95fc4785d-5dt6z"
Sep 15 11:51:34.013307 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:34.013124    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-6e996c-95fc4785d-5dt6z" event={"ID":"594ad813-675e-4fdb-a380-dba18fb562ca","Type":"ContainerDied","Data":"35313b315335f1c1d2c3bf216eea425d4712a1e14c7e84cd76a903026090ae94"}
Sep 15 11:51:34.013307 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:34.013191    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-6e996c-95fc4785d-5dt6z" event={"ID":"594ad813-675e-4fdb-a380-dba18fb562ca","Type":"ContainerDied","Data":"d7b2be65548be9034399953d8c7b235bab6e0f4cbb666c76e9f226e176ed9d7e"}
Sep 15 11:51:34.013307 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:34.013228    2575 scope.go:117] "RemoveContainer" containerID="35313b315335f1c1d2c3bf216eea425d4712a1e14c7e84cd76a903026090ae94"
Sep 15 11:51:34.024110 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:34.024091    2575 scope.go:117] "RemoveContainer" containerID="35313b315335f1c1d2c3bf216eea425d4712a1e14c7e84cd76a903026090ae94"
Sep 15 11:51:34.024378 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:51:34.024357    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35313b315335f1c1d2c3bf216eea425d4712a1e14c7e84cd76a903026090ae94\": container with ID starting with 35313b315335f1c1d2c3bf216eea425d4712a1e14c7e84cd76a903026090ae94 not found: ID does not exist" containerID="35313b315335f1c1d2c3bf216eea425d4712a1e14c7e84cd76a903026090ae94"
Sep 15 11:51:34.024444 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:34.024394    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35313b315335f1c1d2c3bf216eea425d4712a1e14c7e84cd76a903026090ae94"} err="failed to get container status \"35313b315335f1c1d2c3bf216eea425d4712a1e14c7e84cd76a903026090ae94\": rpc error: code = NotFound desc = could not find container \"35313b315335f1c1d2c3bf216eea425d4712a1e14c7e84cd76a903026090ae94\": container with ID starting with 35313b315335f1c1d2c3bf216eea425d4712a1e14c7e84cd76a903026090ae94 not found: ID does not exist"
Sep 15 11:51:34.038394 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:34.038355    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-6e996c-95fc4785d-5dt6z"]
Sep 15 11:51:34.048545 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:34.048509    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-6e996c-95fc4785d-5dt6z"]
Sep 15 11:51:34.096754 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:34.096714    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28e6506e-6947-4c57-bd3b-38c78e5e95a5" path="/var/lib/kubelet/pods/28e6506e-6947-4c57-bd3b-38c78e5e95a5/volumes"
Sep 15 11:51:34.097380 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:34.097356    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="594ad813-675e-4fdb-a380-dba18fb562ca" path="/var/lib/kubelet/pods/594ad813-675e-4fdb-a380-dba18fb562ca/volumes"
Sep 15 11:51:37.001125 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.001074    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-6e996c/distinct-2-w0-6e996c-kserve-65666656f6-4wkkp" podUID="8687db22-f87f-40e5-bd33-c2e6cf2d4509" containerName="main" containerID="cri-o://13a79956c8652671e26bda34506249020a8138d3b719bf3f607afb753075ca7c" gracePeriod=45
Sep 15 11:51:37.006486 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.006447    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-6e996c/distinct-w0-6e996c-kserve-846f8969b7-956r5" podUID="c747b133-059b-4acc-a048-0e40df3a9cd1" containerName="main" containerID="cri-o://1c2ff9a8463e02a389fa73cb3f98ba6eec16139b7daa28e828628ce934bff420" gracePeriod=45
Sep 15 11:51:37.030105 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.030065    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-6e996c/premium-w0-6e996c-kserve-568c8f4784-q9r2n" podUID="e95847f2-211e-4264-8ca8-8e5dc9a756fd" containerName="main" containerID="cri-o://692ea447f4c96104e46e2620a787662931702881e541fae05e7a71b288483707" gracePeriod=45
Sep 15 11:51:37.334410 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.334356    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-6e996c/distinct-2-w0-6e996c-kserve-65666656f6-4wkkp"
Sep 15 11:51:37.338817 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.338788    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-6e996c/distinct-w0-6e996c-kserve-846f8969b7-956r5"
Sep 15 11:51:37.343624 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.343593    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-6e996c/premium-w0-6e996c-kserve-568c8f4784-q9r2n"
Sep 15 11:51:37.406535 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.406501    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8687db22-f87f-40e5-bd33-c2e6cf2d4509-dshm\") pod \"8687db22-f87f-40e5-bd33-c2e6cf2d4509\" (UID: \"8687db22-f87f-40e5-bd33-c2e6cf2d4509\") "
Sep 15 11:51:37.406723 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.406552    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e95847f2-211e-4264-8ca8-8e5dc9a756fd-model-cache\") pod \"e95847f2-211e-4264-8ca8-8e5dc9a756fd\" (UID: \"e95847f2-211e-4264-8ca8-8e5dc9a756fd\") "
Sep 15 11:51:37.406723 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.406585    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c747b133-059b-4acc-a048-0e40df3a9cd1-tmp-dir\") pod \"c747b133-059b-4acc-a048-0e40df3a9cd1\" (UID: \"c747b133-059b-4acc-a048-0e40df3a9cd1\") "
Sep 15 11:51:37.406723 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.406611    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e95847f2-211e-4264-8ca8-8e5dc9a756fd-tmp-dir\") pod \"e95847f2-211e-4264-8ca8-8e5dc9a756fd\" (UID: \"e95847f2-211e-4264-8ca8-8e5dc9a756fd\") "
Sep 15 11:51:37.406723 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.406664    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8687db22-f87f-40e5-bd33-c2e6cf2d4509-model-cache\") pod \"8687db22-f87f-40e5-bd33-c2e6cf2d4509\" (UID: \"8687db22-f87f-40e5-bd33-c2e6cf2d4509\") "
Sep 15 11:51:37.406723 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.406689    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e95847f2-211e-4264-8ca8-8e5dc9a756fd-tls-certs\") pod \"e95847f2-211e-4264-8ca8-8e5dc9a756fd\" (UID: \"e95847f2-211e-4264-8ca8-8e5dc9a756fd\") "
Sep 15 11:51:37.406723 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.406712    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4bpz\" (UniqueName: \"kubernetes.io/projected/c747b133-059b-4acc-a048-0e40df3a9cd1-kube-api-access-r4bpz\") pod \"c747b133-059b-4acc-a048-0e40df3a9cd1\" (UID: \"c747b133-059b-4acc-a048-0e40df3a9cd1\") "
Sep 15 11:51:37.407076 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.406747    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c747b133-059b-4acc-a048-0e40df3a9cd1-tls-certs\") pod \"c747b133-059b-4acc-a048-0e40df3a9cd1\" (UID: \"c747b133-059b-4acc-a048-0e40df3a9cd1\") "
Sep 15 11:51:37.407076 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.406926    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c747b133-059b-4acc-a048-0e40df3a9cd1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c747b133-059b-4acc-a048-0e40df3a9cd1" (UID: "c747b133-059b-4acc-a048-0e40df3a9cd1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:37.407076 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.407007    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c747b133-059b-4acc-a048-0e40df3a9cd1-dshm\") pod \"c747b133-059b-4acc-a048-0e40df3a9cd1\" (UID: \"c747b133-059b-4acc-a048-0e40df3a9cd1\") "
Sep 15 11:51:37.407076 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.407068    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c747b133-059b-4acc-a048-0e40df3a9cd1-model-cache\") pod \"c747b133-059b-4acc-a048-0e40df3a9cd1\" (UID: \"c747b133-059b-4acc-a048-0e40df3a9cd1\") "
Sep 15 11:51:37.407293 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.407109    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e95847f2-211e-4264-8ca8-8e5dc9a756fd-home\") pod \"e95847f2-211e-4264-8ca8-8e5dc9a756fd\" (UID: \"e95847f2-211e-4264-8ca8-8e5dc9a756fd\") "
Sep 15 11:51:37.407293 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.407162    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8687db22-f87f-40e5-bd33-c2e6cf2d4509-tmp-dir\") pod \"8687db22-f87f-40e5-bd33-c2e6cf2d4509\" (UID: \"8687db22-f87f-40e5-bd33-c2e6cf2d4509\") "
Sep 15 11:51:37.407293 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.407191    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8687db22-f87f-40e5-bd33-c2e6cf2d4509-tls-certs\") pod \"8687db22-f87f-40e5-bd33-c2e6cf2d4509\" (UID: \"8687db22-f87f-40e5-bd33-c2e6cf2d4509\") "
Sep 15 11:51:37.407293 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.407217    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rfbs\" (UniqueName: \"kubernetes.io/projected/8687db22-f87f-40e5-bd33-c2e6cf2d4509-kube-api-access-8rfbs\") pod \"8687db22-f87f-40e5-bd33-c2e6cf2d4509\" (UID: \"8687db22-f87f-40e5-bd33-c2e6cf2d4509\") "
Sep 15 11:51:37.407293 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.407254    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c747b133-059b-4acc-a048-0e40df3a9cd1-home\") pod \"c747b133-059b-4acc-a048-0e40df3a9cd1\" (UID: \"c747b133-059b-4acc-a048-0e40df3a9cd1\") "
Sep 15 11:51:37.407293 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.407290    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e95847f2-211e-4264-8ca8-8e5dc9a756fd-dshm\") pod \"e95847f2-211e-4264-8ca8-8e5dc9a756fd\" (UID: \"e95847f2-211e-4264-8ca8-8e5dc9a756fd\") "
Sep 15 11:51:37.407575 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.407343    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqh8n\" (UniqueName: \"kubernetes.io/projected/e95847f2-211e-4264-8ca8-8e5dc9a756fd-kube-api-access-bqh8n\") pod \"e95847f2-211e-4264-8ca8-8e5dc9a756fd\" (UID: \"e95847f2-211e-4264-8ca8-8e5dc9a756fd\") "
Sep 15 11:51:37.407575 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.407402    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8687db22-f87f-40e5-bd33-c2e6cf2d4509-home\") pod \"8687db22-f87f-40e5-bd33-c2e6cf2d4509\" (UID: \"8687db22-f87f-40e5-bd33-c2e6cf2d4509\") "
Sep 15 11:51:37.407575 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.407519    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e95847f2-211e-4264-8ca8-8e5dc9a756fd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e95847f2-211e-4264-8ca8-8e5dc9a756fd" (UID: "e95847f2-211e-4264-8ca8-8e5dc9a756fd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:37.407793 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.407758    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8687db22-f87f-40e5-bd33-c2e6cf2d4509-model-cache" (OuterVolumeSpecName: "model-cache") pod "8687db22-f87f-40e5-bd33-c2e6cf2d4509" (UID: "8687db22-f87f-40e5-bd33-c2e6cf2d4509"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:37.408194 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.407898    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8687db22-f87f-40e5-bd33-c2e6cf2d4509-home" (OuterVolumeSpecName: "home") pod "8687db22-f87f-40e5-bd33-c2e6cf2d4509" (UID: "8687db22-f87f-40e5-bd33-c2e6cf2d4509"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:37.408194 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.407987    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c747b133-059b-4acc-a048-0e40df3a9cd1-tmp-dir\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:51:37.408194 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.408008    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e95847f2-211e-4264-8ca8-8e5dc9a756fd-tmp-dir\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:51:37.408194 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.408022    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8687db22-f87f-40e5-bd33-c2e6cf2d4509-model-cache\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:51:37.408194 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.408073    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e95847f2-211e-4264-8ca8-8e5dc9a756fd-model-cache" (OuterVolumeSpecName: "model-cache") pod "e95847f2-211e-4264-8ca8-8e5dc9a756fd" (UID: "e95847f2-211e-4264-8ca8-8e5dc9a756fd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:37.409280 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.408451    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8687db22-f87f-40e5-bd33-c2e6cf2d4509-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8687db22-f87f-40e5-bd33-c2e6cf2d4509" (UID: "8687db22-f87f-40e5-bd33-c2e6cf2d4509"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:37.409280 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.408459    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e95847f2-211e-4264-8ca8-8e5dc9a756fd-home" (OuterVolumeSpecName: "home") pod "e95847f2-211e-4264-8ca8-8e5dc9a756fd" (UID: "e95847f2-211e-4264-8ca8-8e5dc9a756fd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:37.409280 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.408999    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c747b133-059b-4acc-a048-0e40df3a9cd1-model-cache" (OuterVolumeSpecName: "model-cache") pod "c747b133-059b-4acc-a048-0e40df3a9cd1" (UID: "c747b133-059b-4acc-a048-0e40df3a9cd1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:37.409453 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.409291    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c747b133-059b-4acc-a048-0e40df3a9cd1-home" (OuterVolumeSpecName: "home") pod "c747b133-059b-4acc-a048-0e40df3a9cd1" (UID: "c747b133-059b-4acc-a048-0e40df3a9cd1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:37.410014 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.409986    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8687db22-f87f-40e5-bd33-c2e6cf2d4509-dshm" (OuterVolumeSpecName: "dshm") pod "8687db22-f87f-40e5-bd33-c2e6cf2d4509" (UID: "8687db22-f87f-40e5-bd33-c2e6cf2d4509"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:37.410106 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.410060    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c747b133-059b-4acc-a048-0e40df3a9cd1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c747b133-059b-4acc-a048-0e40df3a9cd1" (UID: "c747b133-059b-4acc-a048-0e40df3a9cd1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:51:37.410223 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.410187    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c747b133-059b-4acc-a048-0e40df3a9cd1-kube-api-access-r4bpz" (OuterVolumeSpecName: "kube-api-access-r4bpz") pod "c747b133-059b-4acc-a048-0e40df3a9cd1" (UID: "c747b133-059b-4acc-a048-0e40df3a9cd1"). InnerVolumeSpecName "kube-api-access-r4bpz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:51:37.410344 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.410284    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e95847f2-211e-4264-8ca8-8e5dc9a756fd-dshm" (OuterVolumeSpecName: "dshm") pod "e95847f2-211e-4264-8ca8-8e5dc9a756fd" (UID: "e95847f2-211e-4264-8ca8-8e5dc9a756fd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:37.411214 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.411182    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e95847f2-211e-4264-8ca8-8e5dc9a756fd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e95847f2-211e-4264-8ca8-8e5dc9a756fd" (UID: "e95847f2-211e-4264-8ca8-8e5dc9a756fd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:51:37.411495 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.411477    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8687db22-f87f-40e5-bd33-c2e6cf2d4509-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8687db22-f87f-40e5-bd33-c2e6cf2d4509" (UID: "8687db22-f87f-40e5-bd33-c2e6cf2d4509"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:51:37.411853 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.411827    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c747b133-059b-4acc-a048-0e40df3a9cd1-dshm" (OuterVolumeSpecName: "dshm") pod "c747b133-059b-4acc-a048-0e40df3a9cd1" (UID: "c747b133-059b-4acc-a048-0e40df3a9cd1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:51:37.411960 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.411832    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e95847f2-211e-4264-8ca8-8e5dc9a756fd-kube-api-access-bqh8n" (OuterVolumeSpecName: "kube-api-access-bqh8n") pod "e95847f2-211e-4264-8ca8-8e5dc9a756fd" (UID: "e95847f2-211e-4264-8ca8-8e5dc9a756fd"). InnerVolumeSpecName "kube-api-access-bqh8n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:51:37.412255 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.412234    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8687db22-f87f-40e5-bd33-c2e6cf2d4509-kube-api-access-8rfbs" (OuterVolumeSpecName: "kube-api-access-8rfbs") pod "8687db22-f87f-40e5-bd33-c2e6cf2d4509" (UID: "8687db22-f87f-40e5-bd33-c2e6cf2d4509"). InnerVolumeSpecName "kube-api-access-8rfbs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:51:37.509228 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.509182    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c747b133-059b-4acc-a048-0e40df3a9cd1-home\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:51:37.509228 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.509220    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e95847f2-211e-4264-8ca8-8e5dc9a756fd-dshm\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:51:37.509228 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.509230    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqh8n\" (UniqueName: \"kubernetes.io/projected/e95847f2-211e-4264-8ca8-8e5dc9a756fd-kube-api-access-bqh8n\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:51:37.509228 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.509242    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8687db22-f87f-40e5-bd33-c2e6cf2d4509-home\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:51:37.509519 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.509250    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8687db22-f87f-40e5-bd33-c2e6cf2d4509-dshm\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:51:37.509519 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.509259    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e95847f2-211e-4264-8ca8-8e5dc9a756fd-model-cache\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:51:37.509519 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.509266    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e95847f2-211e-4264-8ca8-8e5dc9a756fd-tls-certs\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:51:37.509519 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.509274    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4bpz\" (UniqueName: \"kubernetes.io/projected/c747b133-059b-4acc-a048-0e40df3a9cd1-kube-api-access-r4bpz\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:51:37.509519 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.509282    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c747b133-059b-4acc-a048-0e40df3a9cd1-tls-certs\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:51:37.509519 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.509290    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c747b133-059b-4acc-a048-0e40df3a9cd1-dshm\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:51:37.509519 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.509297    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c747b133-059b-4acc-a048-0e40df3a9cd1-model-cache\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:51:37.509519 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.509305    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e95847f2-211e-4264-8ca8-8e5dc9a756fd-home\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:51:37.509519 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.509312    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8687db22-f87f-40e5-bd33-c2e6cf2d4509-tmp-dir\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:51:37.509519 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.509321    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8687db22-f87f-40e5-bd33-c2e6cf2d4509-tls-certs\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:51:37.509519 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:37.509328    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rfbs\" (UniqueName: \"kubernetes.io/projected/8687db22-f87f-40e5-bd33-c2e6cf2d4509-kube-api-access-8rfbs\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:51:38.041778 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:38.041736    2575 generic.go:356] "Generic (PLEG): container finished" podID="c747b133-059b-4acc-a048-0e40df3a9cd1" containerID="1c2ff9a8463e02a389fa73cb3f98ba6eec16139b7daa28e828628ce934bff420" exitCode=0
Sep 15 11:51:38.042211 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:38.041813    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-6e996c/distinct-w0-6e996c-kserve-846f8969b7-956r5"
Sep 15 11:51:38.042211 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:38.041822    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-6e996c/distinct-w0-6e996c-kserve-846f8969b7-956r5" event={"ID":"c747b133-059b-4acc-a048-0e40df3a9cd1","Type":"ContainerDied","Data":"1c2ff9a8463e02a389fa73cb3f98ba6eec16139b7daa28e828628ce934bff420"}
Sep 15 11:51:38.042211 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:38.041871    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-6e996c/distinct-w0-6e996c-kserve-846f8969b7-956r5" event={"ID":"c747b133-059b-4acc-a048-0e40df3a9cd1","Type":"ContainerDied","Data":"80cd7832c36d31032779a9e9ccd8cddfb78e02f108fc3910aba732261077cfed"}
Sep 15 11:51:38.042211 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:38.041891    2575 scope.go:117] "RemoveContainer" containerID="1c2ff9a8463e02a389fa73cb3f98ba6eec16139b7daa28e828628ce934bff420"
Sep 15 11:51:38.043703 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:38.043674    2575 generic.go:356] "Generic (PLEG): container finished" podID="e95847f2-211e-4264-8ca8-8e5dc9a756fd" containerID="692ea447f4c96104e46e2620a787662931702881e541fae05e7a71b288483707" exitCode=0
Sep 15 11:51:38.043846 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:38.043712    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-6e996c/premium-w0-6e996c-kserve-568c8f4784-q9r2n"
Sep 15 11:51:38.043846 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:38.043764    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-6e996c/premium-w0-6e996c-kserve-568c8f4784-q9r2n" event={"ID":"e95847f2-211e-4264-8ca8-8e5dc9a756fd","Type":"ContainerDied","Data":"692ea447f4c96104e46e2620a787662931702881e541fae05e7a71b288483707"}
Sep 15 11:51:38.043846 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:38.043803    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-6e996c/premium-w0-6e996c-kserve-568c8f4784-q9r2n" event={"ID":"e95847f2-211e-4264-8ca8-8e5dc9a756fd","Type":"ContainerDied","Data":"7bb1cf3aeff102fae58eb1203431697ec286ab350747352c24d0c6df2861f49c"}
Sep 15 11:51:38.045463 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:38.045439    2575 generic.go:356] "Generic (PLEG): container finished" podID="8687db22-f87f-40e5-bd33-c2e6cf2d4509" containerID="13a79956c8652671e26bda34506249020a8138d3b719bf3f607afb753075ca7c" exitCode=0
Sep 15 11:51:38.045614 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:38.045561    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-6e996c/distinct-2-w0-6e996c-kserve-65666656f6-4wkkp" event={"ID":"8687db22-f87f-40e5-bd33-c2e6cf2d4509","Type":"ContainerDied","Data":"13a79956c8652671e26bda34506249020a8138d3b719bf3f607afb753075ca7c"}
Sep 15 11:51:38.045614 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:38.045571    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-6e996c/distinct-2-w0-6e996c-kserve-65666656f6-4wkkp"
Sep 15 11:51:38.045614 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:38.045597    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-6e996c/distinct-2-w0-6e996c-kserve-65666656f6-4wkkp" event={"ID":"8687db22-f87f-40e5-bd33-c2e6cf2d4509","Type":"ContainerDied","Data":"3d6685c9acb307c9f7e620859f3c993fdedf7297ad41e041c131e20f2c76ce43"}
Sep 15 11:51:38.055251 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:38.055229    2575 scope.go:117] "RemoveContainer" containerID="1c2ff9a8463e02a389fa73cb3f98ba6eec16139b7daa28e828628ce934bff420"
Sep 15 11:51:38.055570 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:51:38.055552    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c2ff9a8463e02a389fa73cb3f98ba6eec16139b7daa28e828628ce934bff420\": container with ID starting with 1c2ff9a8463e02a389fa73cb3f98ba6eec16139b7daa28e828628ce934bff420 not found: ID does not exist" containerID="1c2ff9a8463e02a389fa73cb3f98ba6eec16139b7daa28e828628ce934bff420"
Sep 15 11:51:38.055619 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:38.055578    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c2ff9a8463e02a389fa73cb3f98ba6eec16139b7daa28e828628ce934bff420"} err="failed to get container status \"1c2ff9a8463e02a389fa73cb3f98ba6eec16139b7daa28e828628ce934bff420\": rpc error: code = NotFound desc = could not find container \"1c2ff9a8463e02a389fa73cb3f98ba6eec16139b7daa28e828628ce934bff420\": container with ID starting with 1c2ff9a8463e02a389fa73cb3f98ba6eec16139b7daa28e828628ce934bff420 not found: ID does not exist"
Sep 15 11:51:38.055619 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:38.055594    2575 scope.go:117] "RemoveContainer" containerID="692ea447f4c96104e46e2620a787662931702881e541fae05e7a71b288483707"
Sep 15 11:51:38.065548 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:38.065522    2575 scope.go:117] "RemoveContainer" containerID="692ea447f4c96104e46e2620a787662931702881e541fae05e7a71b288483707"
Sep 15 11:51:38.065964 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:51:38.065940    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"692ea447f4c96104e46e2620a787662931702881e541fae05e7a71b288483707\": container with ID starting with 692ea447f4c96104e46e2620a787662931702881e541fae05e7a71b288483707 not found: ID does not exist" containerID="692ea447f4c96104e46e2620a787662931702881e541fae05e7a71b288483707"
Sep 15 11:51:38.066090 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:38.065972    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"692ea447f4c96104e46e2620a787662931702881e541fae05e7a71b288483707"} err="failed to get container status \"692ea447f4c96104e46e2620a787662931702881e541fae05e7a71b288483707\": rpc error: code = NotFound desc = could not find container \"692ea447f4c96104e46e2620a787662931702881e541fae05e7a71b288483707\": container with ID starting with 692ea447f4c96104e46e2620a787662931702881e541fae05e7a71b288483707 not found: ID does not exist"
Sep 15 11:51:38.066090 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:38.065991    2575 scope.go:117] "RemoveContainer" containerID="13a79956c8652671e26bda34506249020a8138d3b719bf3f607afb753075ca7c"
Sep 15 11:51:38.068435 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:38.068406    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-6e996c/premium-w0-6e996c-kserve-568c8f4784-q9r2n"]
Sep 15 11:51:38.074838 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:38.074807    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-6e996c/premium-w0-6e996c-kserve-568c8f4784-q9r2n"]
Sep 15 11:51:38.075986 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:38.075965    2575 scope.go:117] "RemoveContainer" containerID="13a79956c8652671e26bda34506249020a8138d3b719bf3f607afb753075ca7c"
Sep 15 11:51:38.076334 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:51:38.076311    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13a79956c8652671e26bda34506249020a8138d3b719bf3f607afb753075ca7c\": container with ID starting with 13a79956c8652671e26bda34506249020a8138d3b719bf3f607afb753075ca7c not found: ID does not exist" containerID="13a79956c8652671e26bda34506249020a8138d3b719bf3f607afb753075ca7c"
Sep 15 11:51:38.076410 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:38.076343    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13a79956c8652671e26bda34506249020a8138d3b719bf3f607afb753075ca7c"} err="failed to get container status \"13a79956c8652671e26bda34506249020a8138d3b719bf3f607afb753075ca7c\": rpc error: code = NotFound desc = could not find container \"13a79956c8652671e26bda34506249020a8138d3b719bf3f607afb753075ca7c\": container with ID starting with 13a79956c8652671e26bda34506249020a8138d3b719bf3f607afb753075ca7c not found: ID does not exist"
Sep 15 11:51:38.086280 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:38.086243    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-6e996c/distinct-w0-6e996c-kserve-846f8969b7-956r5"]
Sep 15 11:51:38.094666 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:38.094630    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e95847f2-211e-4264-8ca8-8e5dc9a756fd" path="/var/lib/kubelet/pods/e95847f2-211e-4264-8ca8-8e5dc9a756fd/volumes"
Sep 15 11:51:38.095441 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:38.095416    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-6e996c/distinct-w0-6e996c-kserve-846f8969b7-956r5"]
Sep 15 11:51:38.111076 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:38.111044    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-6e996c/distinct-2-w0-6e996c-kserve-65666656f6-4wkkp"]
Sep 15 11:51:38.113878 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:38.113856    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-6e996c/distinct-2-w0-6e996c-kserve-65666656f6-4wkkp"]
Sep 15 11:51:40.094531 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:40.094495    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8687db22-f87f-40e5-bd33-c2e6cf2d4509" path="/var/lib/kubelet/pods/8687db22-f87f-40e5-bd33-c2e6cf2d4509/volumes"
Sep 15 11:51:40.094966 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:51:40.094951    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c747b133-059b-4acc-a048-0e40df3a9cd1" path="/var/lib/kubelet/pods/c747b133-059b-4acc-a048-0e40df3a9cd1/volumes"
Sep 15 11:52:11.961794 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:11.961756    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-b8fbdd/distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4"]
Sep 15 11:52:11.979415 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:11.979380    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-b8fbdd/simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d"]
Sep 15 11:52:13.255835 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:13.255793    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln"]
Sep 15 11:52:13.256355 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:13.256071    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln" podUID="f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2" containerName="maas-api" containerID="cri-o://0b27754d7b83773a63099d05c6a423c5a6c7381bca5dbf6788fb66e9d6585468" gracePeriod=30
Sep 15 11:52:13.520551 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:13.520477    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln"
Sep 15 11:52:13.597465 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:13.597410    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2-openshift-service-ca\") pod \"f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2\" (UID: \"f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2\") "
Sep 15 11:52:13.597687 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:13.597477    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2-maas-api-tls\") pod \"f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2\" (UID: \"f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2\") "
Sep 15 11:52:13.597687 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:13.597559    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hldsm\" (UniqueName: \"kubernetes.io/projected/f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2-kube-api-access-hldsm\") pod \"f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2\" (UID: \"f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2\") "
Sep 15 11:52:13.597687 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:13.597597    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2-metrics-certs\") pod \"f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2\" (UID: \"f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2\") "
Sep 15 11:52:13.597925 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:13.597894    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2" (UID: "f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:52:13.599881 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:13.599853    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2" (UID: "f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:52:13.600022 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:13.600002    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2-kube-api-access-hldsm" (OuterVolumeSpecName: "kube-api-access-hldsm") pod "f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2" (UID: "f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2"). InnerVolumeSpecName "kube-api-access-hldsm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:52:13.600078 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:13.600023    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2" (UID: "f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:52:13.699184 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:13.699139    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2-metrics-certs\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:52:13.699184 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:13.699177    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2-openshift-service-ca\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:52:13.699184 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:13.699187    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2-maas-api-tls\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:52:13.699184 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:13.699195    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hldsm\" (UniqueName: \"kubernetes.io/projected/f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2-kube-api-access-hldsm\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:52:14.285481 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:14.285442    2575 generic.go:356] "Generic (PLEG): container finished" podID="f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2" containerID="0b27754d7b83773a63099d05c6a423c5a6c7381bca5dbf6788fb66e9d6585468" exitCode=0
Sep 15 11:52:14.285935 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:14.285511    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln"
Sep 15 11:52:14.285935 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:14.285527    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln" event={"ID":"f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2","Type":"ContainerDied","Data":"0b27754d7b83773a63099d05c6a423c5a6c7381bca5dbf6788fb66e9d6585468"}
Sep 15 11:52:14.285935 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:14.285605    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln" event={"ID":"f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2","Type":"ContainerDied","Data":"1f1891d9d1f9b10cce3214560b2a4c93721eedd10e61b1360e67e8c957f1155a"}
Sep 15 11:52:14.285935 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:14.285628    2575 scope.go:117] "RemoveContainer" containerID="0b27754d7b83773a63099d05c6a423c5a6c7381bca5dbf6788fb66e9d6585468"
Sep 15 11:52:14.295928 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:14.295901    2575 scope.go:117] "RemoveContainer" containerID="0b27754d7b83773a63099d05c6a423c5a6c7381bca5dbf6788fb66e9d6585468"
Sep 15 11:52:14.296265 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:52:14.296244    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b27754d7b83773a63099d05c6a423c5a6c7381bca5dbf6788fb66e9d6585468\": container with ID starting with 0b27754d7b83773a63099d05c6a423c5a6c7381bca5dbf6788fb66e9d6585468 not found: ID does not exist" containerID="0b27754d7b83773a63099d05c6a423c5a6c7381bca5dbf6788fb66e9d6585468"
Sep 15 11:52:14.296336 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:14.296276    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b27754d7b83773a63099d05c6a423c5a6c7381bca5dbf6788fb66e9d6585468"} err="failed to get container status \"0b27754d7b83773a63099d05c6a423c5a6c7381bca5dbf6788fb66e9d6585468\": rpc error: code = NotFound desc = could not find container \"0b27754d7b83773a63099d05c6a423c5a6c7381bca5dbf6788fb66e9d6585468\": container with ID starting with 0b27754d7b83773a63099d05c6a423c5a6c7381bca5dbf6788fb66e9d6585468 not found: ID does not exist"
Sep 15 11:52:14.303793 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:14.303760    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln"]
Sep 15 11:52:14.308527 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:14.308489    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2f0e97-954c44ff5-qrrln"]
Sep 15 11:52:16.094778 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:16.094742    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2" path="/var/lib/kubelet/pods/f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2/volumes"
Sep 15 11:52:23.281600 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:23.281502    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8fbdd-86cb944585-8cn2b"]
Sep 15 11:52:23.282200 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:23.281797    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8fbdd-86cb944585-8cn2b" podUID="24f4cf43-5dd9-4a3d-bf08-882f2940bec1" containerName="maas-api" containerID="cri-o://aafca81e2424eb95f0e24379847fbf2f781ebb8e726da68ce5b66bf3722690f5" gracePeriod=30
Sep 15 11:52:23.540427 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:23.540359    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8fbdd-86cb944585-8cn2b"
Sep 15 11:52:23.603137 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:23.603098    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24f4cf43-5dd9-4a3d-bf08-882f2940bec1-openshift-service-ca\") pod \"24f4cf43-5dd9-4a3d-bf08-882f2940bec1\" (UID: \"24f4cf43-5dd9-4a3d-bf08-882f2940bec1\") "
Sep 15 11:52:23.603318 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:23.603159    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24f4cf43-5dd9-4a3d-bf08-882f2940bec1-maas-api-tls\") pod \"24f4cf43-5dd9-4a3d-bf08-882f2940bec1\" (UID: \"24f4cf43-5dd9-4a3d-bf08-882f2940bec1\") "
Sep 15 11:52:23.603318 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:23.603189    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvlvd\" (UniqueName: \"kubernetes.io/projected/24f4cf43-5dd9-4a3d-bf08-882f2940bec1-kube-api-access-dvlvd\") pod \"24f4cf43-5dd9-4a3d-bf08-882f2940bec1\" (UID: \"24f4cf43-5dd9-4a3d-bf08-882f2940bec1\") "
Sep 15 11:52:23.603318 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:23.603244    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24f4cf43-5dd9-4a3d-bf08-882f2940bec1-metrics-certs\") pod \"24f4cf43-5dd9-4a3d-bf08-882f2940bec1\" (UID: \"24f4cf43-5dd9-4a3d-bf08-882f2940bec1\") "
Sep 15 11:52:23.603536 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:23.603506    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24f4cf43-5dd9-4a3d-bf08-882f2940bec1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "24f4cf43-5dd9-4a3d-bf08-882f2940bec1" (UID: "24f4cf43-5dd9-4a3d-bf08-882f2940bec1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:52:23.603715 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:23.603700    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24f4cf43-5dd9-4a3d-bf08-882f2940bec1-openshift-service-ca\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:52:23.605472 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:23.605440    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24f4cf43-5dd9-4a3d-bf08-882f2940bec1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "24f4cf43-5dd9-4a3d-bf08-882f2940bec1" (UID: "24f4cf43-5dd9-4a3d-bf08-882f2940bec1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:52:23.605596 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:23.605446    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24f4cf43-5dd9-4a3d-bf08-882f2940bec1-kube-api-access-dvlvd" (OuterVolumeSpecName: "kube-api-access-dvlvd") pod "24f4cf43-5dd9-4a3d-bf08-882f2940bec1" (UID: "24f4cf43-5dd9-4a3d-bf08-882f2940bec1"). InnerVolumeSpecName "kube-api-access-dvlvd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:52:23.605596 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:23.605451    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24f4cf43-5dd9-4a3d-bf08-882f2940bec1-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "24f4cf43-5dd9-4a3d-bf08-882f2940bec1" (UID: "24f4cf43-5dd9-4a3d-bf08-882f2940bec1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:52:23.704548 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:23.704512    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24f4cf43-5dd9-4a3d-bf08-882f2940bec1-maas-api-tls\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:52:23.704548 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:23.704546    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvlvd\" (UniqueName: \"kubernetes.io/projected/24f4cf43-5dd9-4a3d-bf08-882f2940bec1-kube-api-access-dvlvd\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:52:23.704548 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:23.704558    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24f4cf43-5dd9-4a3d-bf08-882f2940bec1-metrics-certs\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:52:24.356498 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:24.356402    2575 generic.go:356] "Generic (PLEG): container finished" podID="24f4cf43-5dd9-4a3d-bf08-882f2940bec1" containerID="aafca81e2424eb95f0e24379847fbf2f781ebb8e726da68ce5b66bf3722690f5" exitCode=0
Sep 15 11:52:24.356498 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:24.356446    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8fbdd-86cb944585-8cn2b" event={"ID":"24f4cf43-5dd9-4a3d-bf08-882f2940bec1","Type":"ContainerDied","Data":"aafca81e2424eb95f0e24379847fbf2f781ebb8e726da68ce5b66bf3722690f5"}
Sep 15 11:52:24.357063 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:24.356499    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8fbdd-86cb944585-8cn2b" event={"ID":"24f4cf43-5dd9-4a3d-bf08-882f2940bec1","Type":"ContainerDied","Data":"fc88f290df2844085629f915e7bcfa6d2d3da9b6e049688a6a4dd54468c389f2"}
Sep 15 11:52:24.357063 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:24.356524    2575 scope.go:117] "RemoveContainer" containerID="aafca81e2424eb95f0e24379847fbf2f781ebb8e726da68ce5b66bf3722690f5"
Sep 15 11:52:24.357063 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:24.356451    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8fbdd-86cb944585-8cn2b"
Sep 15 11:52:24.370532 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:24.370501    2575 scope.go:117] "RemoveContainer" containerID="aafca81e2424eb95f0e24379847fbf2f781ebb8e726da68ce5b66bf3722690f5"
Sep 15 11:52:24.371029 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:52:24.370997    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aafca81e2424eb95f0e24379847fbf2f781ebb8e726da68ce5b66bf3722690f5\": container with ID starting with aafca81e2424eb95f0e24379847fbf2f781ebb8e726da68ce5b66bf3722690f5 not found: ID does not exist" containerID="aafca81e2424eb95f0e24379847fbf2f781ebb8e726da68ce5b66bf3722690f5"
Sep 15 11:52:24.371141 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:24.371042    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aafca81e2424eb95f0e24379847fbf2f781ebb8e726da68ce5b66bf3722690f5"} err="failed to get container status \"aafca81e2424eb95f0e24379847fbf2f781ebb8e726da68ce5b66bf3722690f5\": rpc error: code = NotFound desc = could not find container \"aafca81e2424eb95f0e24379847fbf2f781ebb8e726da68ce5b66bf3722690f5\": container with ID starting with aafca81e2424eb95f0e24379847fbf2f781ebb8e726da68ce5b66bf3722690f5 not found: ID does not exist"
Sep 15 11:52:24.375405 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:24.375365    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8fbdd-86cb944585-8cn2b"]
Sep 15 11:52:24.378959 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:24.378931    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8fbdd-86cb944585-8cn2b"]
Sep 15 11:52:26.095432 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:26.095388    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24f4cf43-5dd9-4a3d-bf08-882f2940bec1" path="/var/lib/kubelet/pods/24f4cf43-5dd9-4a3d-bf08-882f2940bec1/volumes"
Sep 15 11:52:26.983981 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:26.983918    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-b8fbdd/distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4" podUID="442873e9-2d63-4b4a-a5ec-40cb8f933063" containerName="main" containerID="cri-o://cb77292f82911ece454475f75a2b4bc5f7aa34edd87d057841c8887dfb6e7403" gracePeriod=45
Sep 15 11:52:27.001891 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.001835    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-b8fbdd/simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d" podUID="b85d5566-9d5e-4497-bf9e-3c847157c7ae" containerName="main" containerID="cri-o://814bf556dd7f8f7f3ccb27ad85e02bb6b4fff499315ce9501ffde14c3497907e" gracePeriod=45
Sep 15 11:52:27.282937 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.282905    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-b8fbdd/distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4"
Sep 15 11:52:27.286724 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.286696    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-b8fbdd/simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d"
Sep 15 11:52:27.343382 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.343351    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b85d5566-9d5e-4497-bf9e-3c847157c7ae-home\") pod \"b85d5566-9d5e-4497-bf9e-3c847157c7ae\" (UID: \"b85d5566-9d5e-4497-bf9e-3c847157c7ae\") "
Sep 15 11:52:27.343382 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.343393    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/442873e9-2d63-4b4a-a5ec-40cb8f933063-dshm\") pod \"442873e9-2d63-4b4a-a5ec-40cb8f933063\" (UID: \"442873e9-2d63-4b4a-a5ec-40cb8f933063\") "
Sep 15 11:52:27.343619 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.343433    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4pnpx\" (UniqueName: \"kubernetes.io/projected/442873e9-2d63-4b4a-a5ec-40cb8f933063-kube-api-access-4pnpx\") pod \"442873e9-2d63-4b4a-a5ec-40cb8f933063\" (UID: \"442873e9-2d63-4b4a-a5ec-40cb8f933063\") "
Sep 15 11:52:27.343619 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.343451    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b85d5566-9d5e-4497-bf9e-3c847157c7ae-tmp-dir\") pod \"b85d5566-9d5e-4497-bf9e-3c847157c7ae\" (UID: \"b85d5566-9d5e-4497-bf9e-3c847157c7ae\") "
Sep 15 11:52:27.343619 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.343470    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b85d5566-9d5e-4497-bf9e-3c847157c7ae-dshm\") pod \"b85d5566-9d5e-4497-bf9e-3c847157c7ae\" (UID: \"b85d5566-9d5e-4497-bf9e-3c847157c7ae\") "
Sep 15 11:52:27.343619 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.343499    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgs8d\" (UniqueName: \"kubernetes.io/projected/b85d5566-9d5e-4497-bf9e-3c847157c7ae-kube-api-access-mgs8d\") pod \"b85d5566-9d5e-4497-bf9e-3c847157c7ae\" (UID: \"b85d5566-9d5e-4497-bf9e-3c847157c7ae\") "
Sep 15 11:52:27.343619 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.343526    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b85d5566-9d5e-4497-bf9e-3c847157c7ae-model-cache\") pod \"b85d5566-9d5e-4497-bf9e-3c847157c7ae\" (UID: \"b85d5566-9d5e-4497-bf9e-3c847157c7ae\") "
Sep 15 11:52:27.343619 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.343560    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/442873e9-2d63-4b4a-a5ec-40cb8f933063-tmp-dir\") pod \"442873e9-2d63-4b4a-a5ec-40cb8f933063\" (UID: \"442873e9-2d63-4b4a-a5ec-40cb8f933063\") "
Sep 15 11:52:27.343970 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.343673    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b85d5566-9d5e-4497-bf9e-3c847157c7ae-home" (OuterVolumeSpecName: "home") pod "b85d5566-9d5e-4497-bf9e-3c847157c7ae" (UID: "b85d5566-9d5e-4497-bf9e-3c847157c7ae"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:52:27.343970 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.343688    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b85d5566-9d5e-4497-bf9e-3c847157c7ae-tls-certs\") pod \"b85d5566-9d5e-4497-bf9e-3c847157c7ae\" (UID: \"b85d5566-9d5e-4497-bf9e-3c847157c7ae\") "
Sep 15 11:52:27.343970 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.343762    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/442873e9-2d63-4b4a-a5ec-40cb8f933063-home\") pod \"442873e9-2d63-4b4a-a5ec-40cb8f933063\" (UID: \"442873e9-2d63-4b4a-a5ec-40cb8f933063\") "
Sep 15 11:52:27.343970 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.343767    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b85d5566-9d5e-4497-bf9e-3c847157c7ae-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b85d5566-9d5e-4497-bf9e-3c847157c7ae" (UID: "b85d5566-9d5e-4497-bf9e-3c847157c7ae"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:52:27.343970 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.343864    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/442873e9-2d63-4b4a-a5ec-40cb8f933063-tls-certs\") pod \"442873e9-2d63-4b4a-a5ec-40cb8f933063\" (UID: \"442873e9-2d63-4b4a-a5ec-40cb8f933063\") "
Sep 15 11:52:27.343970 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.343907    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/442873e9-2d63-4b4a-a5ec-40cb8f933063-model-cache\") pod \"442873e9-2d63-4b4a-a5ec-40cb8f933063\" (UID: \"442873e9-2d63-4b4a-a5ec-40cb8f933063\") "
Sep 15 11:52:27.344278 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.343998    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/442873e9-2d63-4b4a-a5ec-40cb8f933063-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "442873e9-2d63-4b4a-a5ec-40cb8f933063" (UID: "442873e9-2d63-4b4a-a5ec-40cb8f933063"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:52:27.344278 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.344201    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/442873e9-2d63-4b4a-a5ec-40cb8f933063-home" (OuterVolumeSpecName: "home") pod "442873e9-2d63-4b4a-a5ec-40cb8f933063" (UID: "442873e9-2d63-4b4a-a5ec-40cb8f933063"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:52:27.344400 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.344298    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b85d5566-9d5e-4497-bf9e-3c847157c7ae-model-cache" (OuterVolumeSpecName: "model-cache") pod "b85d5566-9d5e-4497-bf9e-3c847157c7ae" (UID: "b85d5566-9d5e-4497-bf9e-3c847157c7ae"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:52:27.344400 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.344319    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b85d5566-9d5e-4497-bf9e-3c847157c7ae-tmp-dir\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:52:27.344400 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.344340    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/442873e9-2d63-4b4a-a5ec-40cb8f933063-tmp-dir\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:52:27.344400 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.344353    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/442873e9-2d63-4b4a-a5ec-40cb8f933063-home\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:52:27.344400 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.344365    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b85d5566-9d5e-4497-bf9e-3c847157c7ae-home\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:52:27.344778 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.344641    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/442873e9-2d63-4b4a-a5ec-40cb8f933063-model-cache" (OuterVolumeSpecName: "model-cache") pod "442873e9-2d63-4b4a-a5ec-40cb8f933063" (UID: "442873e9-2d63-4b4a-a5ec-40cb8f933063"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:52:27.346411 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.346356    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b85d5566-9d5e-4497-bf9e-3c847157c7ae-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b85d5566-9d5e-4497-bf9e-3c847157c7ae" (UID: "b85d5566-9d5e-4497-bf9e-3c847157c7ae"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:52:27.346411 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.346386    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/442873e9-2d63-4b4a-a5ec-40cb8f933063-kube-api-access-4pnpx" (OuterVolumeSpecName: "kube-api-access-4pnpx") pod "442873e9-2d63-4b4a-a5ec-40cb8f933063" (UID: "442873e9-2d63-4b4a-a5ec-40cb8f933063"). InnerVolumeSpecName "kube-api-access-4pnpx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:52:27.346790 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.346645    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/442873e9-2d63-4b4a-a5ec-40cb8f933063-dshm" (OuterVolumeSpecName: "dshm") pod "442873e9-2d63-4b4a-a5ec-40cb8f933063" (UID: "442873e9-2d63-4b4a-a5ec-40cb8f933063"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:52:27.346893 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.346766    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/442873e9-2d63-4b4a-a5ec-40cb8f933063-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "442873e9-2d63-4b4a-a5ec-40cb8f933063" (UID: "442873e9-2d63-4b4a-a5ec-40cb8f933063"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:52:27.346936 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.346903    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b85d5566-9d5e-4497-bf9e-3c847157c7ae-kube-api-access-mgs8d" (OuterVolumeSpecName: "kube-api-access-mgs8d") pod "b85d5566-9d5e-4497-bf9e-3c847157c7ae" (UID: "b85d5566-9d5e-4497-bf9e-3c847157c7ae"). InnerVolumeSpecName "kube-api-access-mgs8d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:52:27.347695 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.347635    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b85d5566-9d5e-4497-bf9e-3c847157c7ae-dshm" (OuterVolumeSpecName: "dshm") pod "b85d5566-9d5e-4497-bf9e-3c847157c7ae" (UID: "b85d5566-9d5e-4497-bf9e-3c847157c7ae"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:52:27.379389 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.379354    2575 generic.go:356] "Generic (PLEG): container finished" podID="442873e9-2d63-4b4a-a5ec-40cb8f933063" containerID="cb77292f82911ece454475f75a2b4bc5f7aa34edd87d057841c8887dfb6e7403" exitCode=0
Sep 15 11:52:27.379570 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.379399    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-b8fbdd/distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4"
Sep 15 11:52:27.379570 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.379435    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-b8fbdd/distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4" event={"ID":"442873e9-2d63-4b4a-a5ec-40cb8f933063","Type":"ContainerDied","Data":"cb77292f82911ece454475f75a2b4bc5f7aa34edd87d057841c8887dfb6e7403"}
Sep 15 11:52:27.379570 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.379487    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-b8fbdd/distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4" event={"ID":"442873e9-2d63-4b4a-a5ec-40cb8f933063","Type":"ContainerDied","Data":"06a3705358eca51d94b139ad38240da47991812aa947febb85b4e9940fb4e92f"}
Sep 15 11:52:27.379570 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.379506    2575 scope.go:117] "RemoveContainer" containerID="cb77292f82911ece454475f75a2b4bc5f7aa34edd87d057841c8887dfb6e7403"
Sep 15 11:52:27.381259 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.381232    2575 generic.go:356] "Generic (PLEG): container finished" podID="b85d5566-9d5e-4497-bf9e-3c847157c7ae" containerID="814bf556dd7f8f7f3ccb27ad85e02bb6b4fff499315ce9501ffde14c3497907e" exitCode=0
Sep 15 11:52:27.381378 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.381282    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-b8fbdd/simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d" event={"ID":"b85d5566-9d5e-4497-bf9e-3c847157c7ae","Type":"ContainerDied","Data":"814bf556dd7f8f7f3ccb27ad85e02bb6b4fff499315ce9501ffde14c3497907e"}
Sep 15 11:52:27.381378 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.381291    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-b8fbdd/simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d"
Sep 15 11:52:27.381378 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.381314    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-b8fbdd/simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d" event={"ID":"b85d5566-9d5e-4497-bf9e-3c847157c7ae","Type":"ContainerDied","Data":"7add0a32a50ab1cf718000322c50882ae1fc1caf058e97d0034b82237760d3a2"}
Sep 15 11:52:27.390105 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.390036    2575 scope.go:117] "RemoveContainer" containerID="cb77292f82911ece454475f75a2b4bc5f7aa34edd87d057841c8887dfb6e7403"
Sep 15 11:52:27.390473 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:52:27.390426    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb77292f82911ece454475f75a2b4bc5f7aa34edd87d057841c8887dfb6e7403\": container with ID starting with cb77292f82911ece454475f75a2b4bc5f7aa34edd87d057841c8887dfb6e7403 not found: ID does not exist" containerID="cb77292f82911ece454475f75a2b4bc5f7aa34edd87d057841c8887dfb6e7403"
Sep 15 11:52:27.390568 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.390480    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb77292f82911ece454475f75a2b4bc5f7aa34edd87d057841c8887dfb6e7403"} err="failed to get container status \"cb77292f82911ece454475f75a2b4bc5f7aa34edd87d057841c8887dfb6e7403\": rpc error: code = NotFound desc = could not find container \"cb77292f82911ece454475f75a2b4bc5f7aa34edd87d057841c8887dfb6e7403\": container with ID starting with cb77292f82911ece454475f75a2b4bc5f7aa34edd87d057841c8887dfb6e7403 not found: ID does not exist"
Sep 15 11:52:27.390568 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.390499    2575 scope.go:117] "RemoveContainer" containerID="814bf556dd7f8f7f3ccb27ad85e02bb6b4fff499315ce9501ffde14c3497907e"
Sep 15 11:52:27.400271 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.400248    2575 scope.go:117] "RemoveContainer" containerID="814bf556dd7f8f7f3ccb27ad85e02bb6b4fff499315ce9501ffde14c3497907e"
Sep 15 11:52:27.400626 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:52:27.400602    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"814bf556dd7f8f7f3ccb27ad85e02bb6b4fff499315ce9501ffde14c3497907e\": container with ID starting with 814bf556dd7f8f7f3ccb27ad85e02bb6b4fff499315ce9501ffde14c3497907e not found: ID does not exist" containerID="814bf556dd7f8f7f3ccb27ad85e02bb6b4fff499315ce9501ffde14c3497907e"
Sep 15 11:52:27.400720 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.400636    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"814bf556dd7f8f7f3ccb27ad85e02bb6b4fff499315ce9501ffde14c3497907e"} err="failed to get container status \"814bf556dd7f8f7f3ccb27ad85e02bb6b4fff499315ce9501ffde14c3497907e\": rpc error: code = NotFound desc = could not find container \"814bf556dd7f8f7f3ccb27ad85e02bb6b4fff499315ce9501ffde14c3497907e\": container with ID starting with 814bf556dd7f8f7f3ccb27ad85e02bb6b4fff499315ce9501ffde14c3497907e not found: ID does not exist"
Sep 15 11:52:27.405837 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.405802    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-b8fbdd/distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4"]
Sep 15 11:52:27.408588 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.408564    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-b8fbdd/distinct-w4-b8fbdd-kserve-684cf4bfd9-xtvw4"]
Sep 15 11:52:27.416896 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.416871    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-b8fbdd/simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d"]
Sep 15 11:52:27.423154 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.423111    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-b8fbdd/simulator-w4-b8fbdd-kserve-6848b7b767-jwx6d"]
Sep 15 11:52:27.445182 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.445138    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b85d5566-9d5e-4497-bf9e-3c847157c7ae-tls-certs\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:52:27.445182 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.445171    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/442873e9-2d63-4b4a-a5ec-40cb8f933063-tls-certs\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:52:27.445182 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.445181    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/442873e9-2d63-4b4a-a5ec-40cb8f933063-model-cache\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:52:27.445182 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.445188    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/442873e9-2d63-4b4a-a5ec-40cb8f933063-dshm\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:52:27.445511 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.445197    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pnpx\" (UniqueName: \"kubernetes.io/projected/442873e9-2d63-4b4a-a5ec-40cb8f933063-kube-api-access-4pnpx\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:52:27.445511 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.445206    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b85d5566-9d5e-4497-bf9e-3c847157c7ae-dshm\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:52:27.445511 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.445216    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgs8d\" (UniqueName: \"kubernetes.io/projected/b85d5566-9d5e-4497-bf9e-3c847157c7ae-kube-api-access-mgs8d\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:52:27.445511 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:27.445225    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b85d5566-9d5e-4497-bf9e-3c847157c7ae-model-cache\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:52:28.095086 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:28.095042    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="442873e9-2d63-4b4a-a5ec-40cb8f933063" path="/var/lib/kubelet/pods/442873e9-2d63-4b4a-a5ec-40cb8f933063/volumes"
Sep 15 11:52:28.095594 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:28.095571    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b85d5566-9d5e-4497-bf9e-3c847157c7ae" path="/var/lib/kubelet/pods/b85d5566-9d5e-4497-bf9e-3c847157c7ae/volumes"
Sep 15 11:52:30.821924 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:30.821889    2575 scope.go:117] "RemoveContainer" containerID="b1a710688b1ddb888fa6a9963fbc6833531748de58f692c90333985dada8bd74"
Sep 15 11:52:31.435899 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:31.435854    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-5a8d6f-29824545-sqsms"]
Sep 15 11:52:31.438681 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:31.438607    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-5a8d6f-29824545-sqsms"]
Sep 15 11:52:32.094771 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:32.094732    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5f15be2-f897-40ce-a00c-1d2f2537ae42" path="/var/lib/kubelet/pods/c5f15be2-f897-40ce-a00c-1d2f2537ae42/volumes"
Sep 15 11:52:48.920986 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:48.920941    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r"]
Sep 15 11:52:48.921679 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:48.921224    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r" podUID="a7bc61c5-d351-449c-9086-27016d1be019" containerName="maas-api" containerID="cri-o://9324f74ed5838b898eccf854cbb0a28ffce50a3548e8b8c67a677cbe81fa1300" gracePeriod=30
Sep 15 11:52:49.180223 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:49.180142    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r"
Sep 15 11:52:49.274079 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:49.274049    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7bc61c5-d351-449c-9086-27016d1be019-openshift-service-ca\") pod \"a7bc61c5-d351-449c-9086-27016d1be019\" (UID: \"a7bc61c5-d351-449c-9086-27016d1be019\") "
Sep 15 11:52:49.274279 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:49.274093    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6l65z\" (UniqueName: \"kubernetes.io/projected/a7bc61c5-d351-449c-9086-27016d1be019-kube-api-access-6l65z\") pod \"a7bc61c5-d351-449c-9086-27016d1be019\" (UID: \"a7bc61c5-d351-449c-9086-27016d1be019\") "
Sep 15 11:52:49.274279 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:49.274176    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7bc61c5-d351-449c-9086-27016d1be019-metrics-certs\") pod \"a7bc61c5-d351-449c-9086-27016d1be019\" (UID: \"a7bc61c5-d351-449c-9086-27016d1be019\") "
Sep 15 11:52:49.274403 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:49.274290    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7bc61c5-d351-449c-9086-27016d1be019-maas-api-tls\") pod \"a7bc61c5-d351-449c-9086-27016d1be019\" (UID: \"a7bc61c5-d351-449c-9086-27016d1be019\") "
Sep 15 11:52:49.274513 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:49.274485    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7bc61c5-d351-449c-9086-27016d1be019-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a7bc61c5-d351-449c-9086-27016d1be019" (UID: "a7bc61c5-d351-449c-9086-27016d1be019"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:52:49.274637 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:49.274621    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7bc61c5-d351-449c-9086-27016d1be019-openshift-service-ca\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:52:49.276443 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:49.276398    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7bc61c5-d351-449c-9086-27016d1be019-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a7bc61c5-d351-449c-9086-27016d1be019" (UID: "a7bc61c5-d351-449c-9086-27016d1be019"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:52:49.276443 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:49.276416    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7bc61c5-d351-449c-9086-27016d1be019-kube-api-access-6l65z" (OuterVolumeSpecName: "kube-api-access-6l65z") pod "a7bc61c5-d351-449c-9086-27016d1be019" (UID: "a7bc61c5-d351-449c-9086-27016d1be019"). InnerVolumeSpecName "kube-api-access-6l65z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:52:49.276675 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:49.276491    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7bc61c5-d351-449c-9086-27016d1be019-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a7bc61c5-d351-449c-9086-27016d1be019" (UID: "a7bc61c5-d351-449c-9086-27016d1be019"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:52:49.375252 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:49.375212    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7bc61c5-d351-449c-9086-27016d1be019-maas-api-tls\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:52:49.375252 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:49.375247    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6l65z\" (UniqueName: \"kubernetes.io/projected/a7bc61c5-d351-449c-9086-27016d1be019-kube-api-access-6l65z\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:52:49.375252 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:49.375258    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7bc61c5-d351-449c-9086-27016d1be019-metrics-certs\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:52:49.523887 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:49.523793    2575 generic.go:356] "Generic (PLEG): container finished" podID="a7bc61c5-d351-449c-9086-27016d1be019" containerID="9324f74ed5838b898eccf854cbb0a28ffce50a3548e8b8c67a677cbe81fa1300" exitCode=0
Sep 15 11:52:49.523887 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:49.523846    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r"
Sep 15 11:52:49.524103 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:49.523876    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r" event={"ID":"a7bc61c5-d351-449c-9086-27016d1be019","Type":"ContainerDied","Data":"9324f74ed5838b898eccf854cbb0a28ffce50a3548e8b8c67a677cbe81fa1300"}
Sep 15 11:52:49.524103 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:49.523943    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r" event={"ID":"a7bc61c5-d351-449c-9086-27016d1be019","Type":"ContainerDied","Data":"4da852ed9a374d81f305833fd8df815437086cdfad70a2e76b17f50bc9bcbd62"}
Sep 15 11:52:49.524103 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:49.523974    2575 scope.go:117] "RemoveContainer" containerID="9324f74ed5838b898eccf854cbb0a28ffce50a3548e8b8c67a677cbe81fa1300"
Sep 15 11:52:49.534588 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:49.534567    2575 scope.go:117] "RemoveContainer" containerID="9324f74ed5838b898eccf854cbb0a28ffce50a3548e8b8c67a677cbe81fa1300"
Sep 15 11:52:49.534899 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:52:49.534877    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9324f74ed5838b898eccf854cbb0a28ffce50a3548e8b8c67a677cbe81fa1300\": container with ID starting with 9324f74ed5838b898eccf854cbb0a28ffce50a3548e8b8c67a677cbe81fa1300 not found: ID does not exist" containerID="9324f74ed5838b898eccf854cbb0a28ffce50a3548e8b8c67a677cbe81fa1300"
Sep 15 11:52:49.534960 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:49.534909    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9324f74ed5838b898eccf854cbb0a28ffce50a3548e8b8c67a677cbe81fa1300"} err="failed to get container status \"9324f74ed5838b898eccf854cbb0a28ffce50a3548e8b8c67a677cbe81fa1300\": rpc error: code = NotFound desc = could not find container \"9324f74ed5838b898eccf854cbb0a28ffce50a3548e8b8c67a677cbe81fa1300\": container with ID starting with 9324f74ed5838b898eccf854cbb0a28ffce50a3548e8b8c67a677cbe81fa1300 not found: ID does not exist"
Sep 15 11:52:49.558212 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:49.558170    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r"]
Sep 15 11:52:49.576156 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:49.576117    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-d63075-5df7b8cd86-8fc8r"]
Sep 15 11:52:50.094039 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:52:50.094002    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7bc61c5-d351-449c-9086-27016d1be019" path="/var/lib/kubelet/pods/a7bc61c5-d351-449c-9086-27016d1be019/volumes"
Sep 15 11:53:08.306434 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:08.306392    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-7efa8b/auth-test-model-7efa8b-kserve-65f58b5555-2jtvx"]
Sep 15 11:53:09.531434 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:09.531393    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-2cc790/auth-test-model-2cc790-kserve-7f64d4b859-r9dt9"]
Sep 15 11:53:23.327135 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:23.327083    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-7efa8b/auth-test-model-7efa8b-kserve-65f58b5555-2jtvx" podUID="414686ee-be96-4007-a988-b5a18dc58938" containerName="main" containerID="cri-o://3cd4f31d302d416abc452880ed4daf930cf1e4d660cf7eeafea8a628ea1678a1" gracePeriod=45
Sep 15 11:53:23.584843 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:23.584774    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-7efa8b/auth-test-model-7efa8b-kserve-65f58b5555-2jtvx"
Sep 15 11:53:23.722050 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:23.722009    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/414686ee-be96-4007-a988-b5a18dc58938-dshm\") pod \"414686ee-be96-4007-a988-b5a18dc58938\" (UID: \"414686ee-be96-4007-a988-b5a18dc58938\") "
Sep 15 11:53:23.722230 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:23.722060    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/414686ee-be96-4007-a988-b5a18dc58938-tmp-dir\") pod \"414686ee-be96-4007-a988-b5a18dc58938\" (UID: \"414686ee-be96-4007-a988-b5a18dc58938\") "
Sep 15 11:53:23.722230 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:23.722080    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/414686ee-be96-4007-a988-b5a18dc58938-tls-certs\") pod \"414686ee-be96-4007-a988-b5a18dc58938\" (UID: \"414686ee-be96-4007-a988-b5a18dc58938\") "
Sep 15 11:53:23.722230 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:23.722152    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85xbf\" (UniqueName: \"kubernetes.io/projected/414686ee-be96-4007-a988-b5a18dc58938-kube-api-access-85xbf\") pod \"414686ee-be96-4007-a988-b5a18dc58938\" (UID: \"414686ee-be96-4007-a988-b5a18dc58938\") "
Sep 15 11:53:23.722366 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:23.722277    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/414686ee-be96-4007-a988-b5a18dc58938-home\") pod \"414686ee-be96-4007-a988-b5a18dc58938\" (UID: \"414686ee-be96-4007-a988-b5a18dc58938\") "
Sep 15 11:53:23.722366 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:23.722348    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/414686ee-be96-4007-a988-b5a18dc58938-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "414686ee-be96-4007-a988-b5a18dc58938" (UID: "414686ee-be96-4007-a988-b5a18dc58938"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:53:23.722482 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:23.722375    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/414686ee-be96-4007-a988-b5a18dc58938-model-cache\") pod \"414686ee-be96-4007-a988-b5a18dc58938\" (UID: \"414686ee-be96-4007-a988-b5a18dc58938\") "
Sep 15 11:53:23.722578 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:23.722532    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/414686ee-be96-4007-a988-b5a18dc58938-home" (OuterVolumeSpecName: "home") pod "414686ee-be96-4007-a988-b5a18dc58938" (UID: "414686ee-be96-4007-a988-b5a18dc58938"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:53:23.722578 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:23.722575    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/414686ee-be96-4007-a988-b5a18dc58938-model-cache" (OuterVolumeSpecName: "model-cache") pod "414686ee-be96-4007-a988-b5a18dc58938" (UID: "414686ee-be96-4007-a988-b5a18dc58938"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:53:23.722849 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:23.722821    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/414686ee-be96-4007-a988-b5a18dc58938-tmp-dir\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:53:23.722849 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:23.722846    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/414686ee-be96-4007-a988-b5a18dc58938-home\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:53:23.723038 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:23.722857    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/414686ee-be96-4007-a988-b5a18dc58938-model-cache\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:53:23.724477 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:23.724452    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/414686ee-be96-4007-a988-b5a18dc58938-dshm" (OuterVolumeSpecName: "dshm") pod "414686ee-be96-4007-a988-b5a18dc58938" (UID: "414686ee-be96-4007-a988-b5a18dc58938"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:53:23.724570 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:23.724454    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/414686ee-be96-4007-a988-b5a18dc58938-kube-api-access-85xbf" (OuterVolumeSpecName: "kube-api-access-85xbf") pod "414686ee-be96-4007-a988-b5a18dc58938" (UID: "414686ee-be96-4007-a988-b5a18dc58938"). InnerVolumeSpecName "kube-api-access-85xbf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:53:23.724570 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:23.724485    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/414686ee-be96-4007-a988-b5a18dc58938-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "414686ee-be96-4007-a988-b5a18dc58938" (UID: "414686ee-be96-4007-a988-b5a18dc58938"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:53:23.740604 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:23.740572    2575 generic.go:356] "Generic (PLEG): container finished" podID="414686ee-be96-4007-a988-b5a18dc58938" containerID="3cd4f31d302d416abc452880ed4daf930cf1e4d660cf7eeafea8a628ea1678a1" exitCode=0
Sep 15 11:53:23.740816 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:23.740615    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-7efa8b/auth-test-model-7efa8b-kserve-65f58b5555-2jtvx"
Sep 15 11:53:23.740816 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:23.740679    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-7efa8b/auth-test-model-7efa8b-kserve-65f58b5555-2jtvx" event={"ID":"414686ee-be96-4007-a988-b5a18dc58938","Type":"ContainerDied","Data":"3cd4f31d302d416abc452880ed4daf930cf1e4d660cf7eeafea8a628ea1678a1"}
Sep 15 11:53:23.740816 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:23.740726    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-7efa8b/auth-test-model-7efa8b-kserve-65f58b5555-2jtvx" event={"ID":"414686ee-be96-4007-a988-b5a18dc58938","Type":"ContainerDied","Data":"9dad9a16b57d537d5a6b6d43abb3ee2e8e59502bc34d0901a9e6b889f7fa46b5"}
Sep 15 11:53:23.740816 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:23.740747    2575 scope.go:117] "RemoveContainer" containerID="3cd4f31d302d416abc452880ed4daf930cf1e4d660cf7eeafea8a628ea1678a1"
Sep 15 11:53:23.751180 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:23.751159    2575 scope.go:117] "RemoveContainer" containerID="3cd4f31d302d416abc452880ed4daf930cf1e4d660cf7eeafea8a628ea1678a1"
Sep 15 11:53:23.751577 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:53:23.751556    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cd4f31d302d416abc452880ed4daf930cf1e4d660cf7eeafea8a628ea1678a1\": container with ID starting with 3cd4f31d302d416abc452880ed4daf930cf1e4d660cf7eeafea8a628ea1678a1 not found: ID does not exist" containerID="3cd4f31d302d416abc452880ed4daf930cf1e4d660cf7eeafea8a628ea1678a1"
Sep 15 11:53:23.751627 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:23.751588    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cd4f31d302d416abc452880ed4daf930cf1e4d660cf7eeafea8a628ea1678a1"} err="failed to get container status \"3cd4f31d302d416abc452880ed4daf930cf1e4d660cf7eeafea8a628ea1678a1\": rpc error: code = NotFound desc = could not find container \"3cd4f31d302d416abc452880ed4daf930cf1e4d660cf7eeafea8a628ea1678a1\": container with ID starting with 3cd4f31d302d416abc452880ed4daf930cf1e4d660cf7eeafea8a628ea1678a1 not found: ID does not exist"
Sep 15 11:53:23.762356 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:23.762314    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-7efa8b/auth-test-model-7efa8b-kserve-65f58b5555-2jtvx"]
Sep 15 11:53:23.765962 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:23.765930    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-7efa8b/auth-test-model-7efa8b-kserve-65f58b5555-2jtvx"]
Sep 15 11:53:23.823744 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:23.823707    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/414686ee-be96-4007-a988-b5a18dc58938-dshm\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:53:23.823744 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:23.823739    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/414686ee-be96-4007-a988-b5a18dc58938-tls-certs\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:53:23.823744 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:23.823749    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85xbf\" (UniqueName: \"kubernetes.io/projected/414686ee-be96-4007-a988-b5a18dc58938-kube-api-access-85xbf\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:53:24.094641 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:24.094590    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="414686ee-be96-4007-a988-b5a18dc58938" path="/var/lib/kubelet/pods/414686ee-be96-4007-a988-b5a18dc58938/volumes"
Sep 15 11:53:24.552399 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:24.552291    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-2cc790/auth-test-model-2cc790-kserve-7f64d4b859-r9dt9" podUID="6990fda7-6441-4a18-a7c9-2689a933d388" containerName="main" containerID="cri-o://d67eeca5939b4c4267f3ecdffeadc8605199c25272c2932446958cf084cc99be" gracePeriod=45
Sep 15 11:53:24.761167 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:24.761126    2575 generic.go:356] "Generic (PLEG): container finished" podID="6990fda7-6441-4a18-a7c9-2689a933d388" containerID="d67eeca5939b4c4267f3ecdffeadc8605199c25272c2932446958cf084cc99be" exitCode=0
Sep 15 11:53:24.761329 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:24.761208    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-2cc790/auth-test-model-2cc790-kserve-7f64d4b859-r9dt9" event={"ID":"6990fda7-6441-4a18-a7c9-2689a933d388","Type":"ContainerDied","Data":"d67eeca5939b4c4267f3ecdffeadc8605199c25272c2932446958cf084cc99be"}
Sep 15 11:53:24.815931 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:24.815853    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-2cc790/auth-test-model-2cc790-kserve-7f64d4b859-r9dt9"
Sep 15 11:53:24.934160 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:24.934121    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ksgpb\" (UniqueName: \"kubernetes.io/projected/6990fda7-6441-4a18-a7c9-2689a933d388-kube-api-access-ksgpb\") pod \"6990fda7-6441-4a18-a7c9-2689a933d388\" (UID: \"6990fda7-6441-4a18-a7c9-2689a933d388\") "
Sep 15 11:53:24.934373 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:24.934176    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6990fda7-6441-4a18-a7c9-2689a933d388-model-cache\") pod \"6990fda7-6441-4a18-a7c9-2689a933d388\" (UID: \"6990fda7-6441-4a18-a7c9-2689a933d388\") "
Sep 15 11:53:24.934373 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:24.934194    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6990fda7-6441-4a18-a7c9-2689a933d388-dshm\") pod \"6990fda7-6441-4a18-a7c9-2689a933d388\" (UID: \"6990fda7-6441-4a18-a7c9-2689a933d388\") "
Sep 15 11:53:24.934373 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:24.934215    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6990fda7-6441-4a18-a7c9-2689a933d388-tmp-dir\") pod \"6990fda7-6441-4a18-a7c9-2689a933d388\" (UID: \"6990fda7-6441-4a18-a7c9-2689a933d388\") "
Sep 15 11:53:24.934373 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:24.934250    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6990fda7-6441-4a18-a7c9-2689a933d388-home\") pod \"6990fda7-6441-4a18-a7c9-2689a933d388\" (UID: \"6990fda7-6441-4a18-a7c9-2689a933d388\") "
Sep 15 11:53:24.934373 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:24.934367    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6990fda7-6441-4a18-a7c9-2689a933d388-tls-certs\") pod \"6990fda7-6441-4a18-a7c9-2689a933d388\" (UID: \"6990fda7-6441-4a18-a7c9-2689a933d388\") "
Sep 15 11:53:24.934634 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:24.934463    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6990fda7-6441-4a18-a7c9-2689a933d388-model-cache" (OuterVolumeSpecName: "model-cache") pod "6990fda7-6441-4a18-a7c9-2689a933d388" (UID: "6990fda7-6441-4a18-a7c9-2689a933d388"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:53:24.934634 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:24.934493    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6990fda7-6441-4a18-a7c9-2689a933d388-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6990fda7-6441-4a18-a7c9-2689a933d388" (UID: "6990fda7-6441-4a18-a7c9-2689a933d388"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:53:24.934634 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:24.934580    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6990fda7-6441-4a18-a7c9-2689a933d388-home" (OuterVolumeSpecName: "home") pod "6990fda7-6441-4a18-a7c9-2689a933d388" (UID: "6990fda7-6441-4a18-a7c9-2689a933d388"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:53:24.934808 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:24.934777    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6990fda7-6441-4a18-a7c9-2689a933d388-model-cache\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:53:24.934865 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:24.934817    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6990fda7-6441-4a18-a7c9-2689a933d388-tmp-dir\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:53:24.934865 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:24.934826    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6990fda7-6441-4a18-a7c9-2689a933d388-home\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:53:24.936600 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:24.936565    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6990fda7-6441-4a18-a7c9-2689a933d388-dshm" (OuterVolumeSpecName: "dshm") pod "6990fda7-6441-4a18-a7c9-2689a933d388" (UID: "6990fda7-6441-4a18-a7c9-2689a933d388"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:53:24.936600 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:24.936579    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6990fda7-6441-4a18-a7c9-2689a933d388-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6990fda7-6441-4a18-a7c9-2689a933d388" (UID: "6990fda7-6441-4a18-a7c9-2689a933d388"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:53:24.936780 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:24.936630    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6990fda7-6441-4a18-a7c9-2689a933d388-kube-api-access-ksgpb" (OuterVolumeSpecName: "kube-api-access-ksgpb") pod "6990fda7-6441-4a18-a7c9-2689a933d388" (UID: "6990fda7-6441-4a18-a7c9-2689a933d388"). InnerVolumeSpecName "kube-api-access-ksgpb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:53:25.035858 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:25.035810    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6990fda7-6441-4a18-a7c9-2689a933d388-tls-certs\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:53:25.035858 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:25.035845    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ksgpb\" (UniqueName: \"kubernetes.io/projected/6990fda7-6441-4a18-a7c9-2689a933d388-kube-api-access-ksgpb\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:53:25.035858 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:25.035856    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6990fda7-6441-4a18-a7c9-2689a933d388-dshm\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:53:25.768689 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:25.768639    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-2cc790/auth-test-model-2cc790-kserve-7f64d4b859-r9dt9"
Sep 15 11:53:25.769137 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:25.768688    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-2cc790/auth-test-model-2cc790-kserve-7f64d4b859-r9dt9" event={"ID":"6990fda7-6441-4a18-a7c9-2689a933d388","Type":"ContainerDied","Data":"a7e79a88b07c7acd97b1610e2311abb9ed04cea5d3e0e9bc5a05f3baa66c8579"}
Sep 15 11:53:25.769137 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:25.768739    2575 scope.go:117] "RemoveContainer" containerID="d67eeca5939b4c4267f3ecdffeadc8605199c25272c2932446958cf084cc99be"
Sep 15 11:53:25.790849 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:25.790807    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-2cc790/auth-test-model-2cc790-kserve-7f64d4b859-r9dt9"]
Sep 15 11:53:25.798197 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:25.798158    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-2cc790/auth-test-model-2cc790-kserve-7f64d4b859-r9dt9"]
Sep 15 11:53:26.094214 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:26.094173    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6990fda7-6441-4a18-a7c9-2689a933d388" path="/var/lib/kubelet/pods/6990fda7-6441-4a18-a7c9-2689a933d388/volumes"
Sep 15 11:53:30.886307 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:30.886272    2575 scope.go:117] "RemoveContainer" containerID="2e0af1df352b061cc5c205b10b6df0633f269fe6c5322a50a61fc9effec7f808"
Sep 15 11:53:33.145525 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.145476    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-7efa8b/sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp"]
Sep 15 11:53:33.146097 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.146077    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2" containerName="maas-api"
Sep 15 11:53:33.146152 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.146098    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2" containerName="maas-api"
Sep 15 11:53:33.146152 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.146112    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6990fda7-6441-4a18-a7c9-2689a933d388" containerName="main"
Sep 15 11:53:33.146152 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.146121    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6990fda7-6441-4a18-a7c9-2689a933d388" containerName="main"
Sep 15 11:53:33.146152 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.146134    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="442873e9-2d63-4b4a-a5ec-40cb8f933063" containerName="main"
Sep 15 11:53:33.146152 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.146139    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="442873e9-2d63-4b4a-a5ec-40cb8f933063" containerName="main"
Sep 15 11:53:33.146152 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.146148    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b85d5566-9d5e-4497-bf9e-3c847157c7ae" containerName="main"
Sep 15 11:53:33.146152 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.146154    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b85d5566-9d5e-4497-bf9e-3c847157c7ae" containerName="main"
Sep 15 11:53:33.146410 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.146168    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e95847f2-211e-4264-8ca8-8e5dc9a756fd" containerName="main"
Sep 15 11:53:33.146410 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.146175    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e95847f2-211e-4264-8ca8-8e5dc9a756fd" containerName="main"
Sep 15 11:53:33.146410 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.146181    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c747b133-059b-4acc-a048-0e40df3a9cd1" containerName="main"
Sep 15 11:53:33.146410 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.146186    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c747b133-059b-4acc-a048-0e40df3a9cd1" containerName="main"
Sep 15 11:53:33.146410 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.146195    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8687db22-f87f-40e5-bd33-c2e6cf2d4509" containerName="main"
Sep 15 11:53:33.146410 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.146206    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8687db22-f87f-40e5-bd33-c2e6cf2d4509" containerName="main"
Sep 15 11:53:33.146410 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.146215    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="414686ee-be96-4007-a988-b5a18dc58938" containerName="main"
Sep 15 11:53:33.146410 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.146220    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="414686ee-be96-4007-a988-b5a18dc58938" containerName="main"
Sep 15 11:53:33.146410 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.146228    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24f4cf43-5dd9-4a3d-bf08-882f2940bec1" containerName="maas-api"
Sep 15 11:53:33.146410 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.146232    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="24f4cf43-5dd9-4a3d-bf08-882f2940bec1" containerName="maas-api"
Sep 15 11:53:33.146410 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.146240    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="594ad813-675e-4fdb-a380-dba18fb562ca" containerName="payload-pre-processing"
Sep 15 11:53:33.146410 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.146245    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="594ad813-675e-4fdb-a380-dba18fb562ca" containerName="payload-pre-processing"
Sep 15 11:53:33.146410 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.146251    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7bc61c5-d351-449c-9086-27016d1be019" containerName="maas-api"
Sep 15 11:53:33.146410 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.146257    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7bc61c5-d351-449c-9086-27016d1be019" containerName="maas-api"
Sep 15 11:53:33.146410 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.146336    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e95847f2-211e-4264-8ca8-8e5dc9a756fd" containerName="main"
Sep 15 11:53:33.146410 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.146345    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="442873e9-2d63-4b4a-a5ec-40cb8f933063" containerName="main"
Sep 15 11:53:33.146410 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.146352    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="594ad813-675e-4fdb-a380-dba18fb562ca" containerName="payload-pre-processing"
Sep 15 11:53:33.146410 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.146359    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="414686ee-be96-4007-a988-b5a18dc58938" containerName="main"
Sep 15 11:53:33.146410 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.146366    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6990fda7-6441-4a18-a7c9-2689a933d388" containerName="main"
Sep 15 11:53:33.146410 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.146373    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="24f4cf43-5dd9-4a3d-bf08-882f2940bec1" containerName="maas-api"
Sep 15 11:53:33.146410 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.146378    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8687db22-f87f-40e5-bd33-c2e6cf2d4509" containerName="main"
Sep 15 11:53:33.146410 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.146383    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c747b133-059b-4acc-a048-0e40df3a9cd1" containerName="main"
Sep 15 11:53:33.146410 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.146389    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7bc61c5-d351-449c-9086-27016d1be019" containerName="maas-api"
Sep 15 11:53:33.146410 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.146395    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3ea1a0b-e27a-46bc-8f1e-3690dd64dbe2" containerName="maas-api"
Sep 15 11:53:33.146410 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.146400    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b85d5566-9d5e-4497-bf9e-3c847157c7ae" containerName="main"
Sep 15 11:53:33.149583 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.149563    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-7efa8b/sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp"
Sep 15 11:53:33.151846 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.151816    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-7efa8b\"/\"openshift-service-ca.crt\""
Sep 15 11:53:33.151987 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.151850    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-7efa8b\"/\"kube-root-ca.crt\""
Sep 15 11:53:33.152712 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.152683    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-7efa8b\"/\"sub-test-model-7efa8b-kserve-self-signed-certs\""
Sep 15 11:53:33.152817 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.152729    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-7efa8b\"/\"default-dockercfg-l8jb7\""
Sep 15 11:53:33.159694 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.159608    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-7efa8b/sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp"]
Sep 15 11:53:33.317370 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.317321    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22d7b6cc-85c6-431f-8070-3b8061de6ed8-tmp-dir\") pod \"sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp\" (UID: \"22d7b6cc-85c6-431f-8070-3b8061de6ed8\") " pod="ai-tenant-e2e-shared-a-w3-7efa8b/sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp"
Sep 15 11:53:33.317370 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.317370    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22d7b6cc-85c6-431f-8070-3b8061de6ed8-tls-certs\") pod \"sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp\" (UID: \"22d7b6cc-85c6-431f-8070-3b8061de6ed8\") " pod="ai-tenant-e2e-shared-a-w3-7efa8b/sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp"
Sep 15 11:53:33.317595 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.317394    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22d7b6cc-85c6-431f-8070-3b8061de6ed8-model-cache\") pod \"sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp\" (UID: \"22d7b6cc-85c6-431f-8070-3b8061de6ed8\") " pod="ai-tenant-e2e-shared-a-w3-7efa8b/sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp"
Sep 15 11:53:33.317595 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.317473    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbdhq\" (UniqueName: \"kubernetes.io/projected/22d7b6cc-85c6-431f-8070-3b8061de6ed8-kube-api-access-gbdhq\") pod \"sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp\" (UID: \"22d7b6cc-85c6-431f-8070-3b8061de6ed8\") " pod="ai-tenant-e2e-shared-a-w3-7efa8b/sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp"
Sep 15 11:53:33.317595 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.317520    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/22d7b6cc-85c6-431f-8070-3b8061de6ed8-dshm\") pod \"sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp\" (UID: \"22d7b6cc-85c6-431f-8070-3b8061de6ed8\") " pod="ai-tenant-e2e-shared-a-w3-7efa8b/sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp"
Sep 15 11:53:33.317595 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.317570    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/22d7b6cc-85c6-431f-8070-3b8061de6ed8-home\") pod \"sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp\" (UID: \"22d7b6cc-85c6-431f-8070-3b8061de6ed8\") " pod="ai-tenant-e2e-shared-a-w3-7efa8b/sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp"
Sep 15 11:53:33.418548 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.418448    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22d7b6cc-85c6-431f-8070-3b8061de6ed8-tmp-dir\") pod \"sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp\" (UID: \"22d7b6cc-85c6-431f-8070-3b8061de6ed8\") " pod="ai-tenant-e2e-shared-a-w3-7efa8b/sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp"
Sep 15 11:53:33.418548 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.418510    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22d7b6cc-85c6-431f-8070-3b8061de6ed8-tls-certs\") pod \"sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp\" (UID: \"22d7b6cc-85c6-431f-8070-3b8061de6ed8\") " pod="ai-tenant-e2e-shared-a-w3-7efa8b/sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp"
Sep 15 11:53:33.418548 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.418546    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22d7b6cc-85c6-431f-8070-3b8061de6ed8-model-cache\") pod \"sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp\" (UID: \"22d7b6cc-85c6-431f-8070-3b8061de6ed8\") " pod="ai-tenant-e2e-shared-a-w3-7efa8b/sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp"
Sep 15 11:53:33.418818 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.418595    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbdhq\" (UniqueName: \"kubernetes.io/projected/22d7b6cc-85c6-431f-8070-3b8061de6ed8-kube-api-access-gbdhq\") pod \"sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp\" (UID: \"22d7b6cc-85c6-431f-8070-3b8061de6ed8\") " pod="ai-tenant-e2e-shared-a-w3-7efa8b/sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp"
Sep 15 11:53:33.418818 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.418631    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/22d7b6cc-85c6-431f-8070-3b8061de6ed8-dshm\") pod \"sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp\" (UID: \"22d7b6cc-85c6-431f-8070-3b8061de6ed8\") " pod="ai-tenant-e2e-shared-a-w3-7efa8b/sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp"
Sep 15 11:53:33.418818 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.418727    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/22d7b6cc-85c6-431f-8070-3b8061de6ed8-home\") pod \"sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp\" (UID: \"22d7b6cc-85c6-431f-8070-3b8061de6ed8\") " pod="ai-tenant-e2e-shared-a-w3-7efa8b/sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp"
Sep 15 11:53:33.418954 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.418932    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22d7b6cc-85c6-431f-8070-3b8061de6ed8-tmp-dir\") pod \"sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp\" (UID: \"22d7b6cc-85c6-431f-8070-3b8061de6ed8\") " pod="ai-tenant-e2e-shared-a-w3-7efa8b/sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp"
Sep 15 11:53:33.419013 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.418980    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22d7b6cc-85c6-431f-8070-3b8061de6ed8-model-cache\") pod \"sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp\" (UID: \"22d7b6cc-85c6-431f-8070-3b8061de6ed8\") " pod="ai-tenant-e2e-shared-a-w3-7efa8b/sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp"
Sep 15 11:53:33.419173 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.419151    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/22d7b6cc-85c6-431f-8070-3b8061de6ed8-home\") pod \"sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp\" (UID: \"22d7b6cc-85c6-431f-8070-3b8061de6ed8\") " pod="ai-tenant-e2e-shared-a-w3-7efa8b/sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp"
Sep 15 11:53:33.421014 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.420993    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/22d7b6cc-85c6-431f-8070-3b8061de6ed8-dshm\") pod \"sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp\" (UID: \"22d7b6cc-85c6-431f-8070-3b8061de6ed8\") " pod="ai-tenant-e2e-shared-a-w3-7efa8b/sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp"
Sep 15 11:53:33.421192 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.421176    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22d7b6cc-85c6-431f-8070-3b8061de6ed8-tls-certs\") pod \"sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp\" (UID: \"22d7b6cc-85c6-431f-8070-3b8061de6ed8\") " pod="ai-tenant-e2e-shared-a-w3-7efa8b/sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp"
Sep 15 11:53:33.428101 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.428077    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbdhq\" (UniqueName: \"kubernetes.io/projected/22d7b6cc-85c6-431f-8070-3b8061de6ed8-kube-api-access-gbdhq\") pod \"sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp\" (UID: \"22d7b6cc-85c6-431f-8070-3b8061de6ed8\") " pod="ai-tenant-e2e-shared-a-w3-7efa8b/sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp"
Sep 15 11:53:33.462256 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.462204    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-7efa8b/sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp"
Sep 15 11:53:33.738620 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.738586    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-7efa8b/sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp"]
Sep 15 11:53:33.740461 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:53:33.740428    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22d7b6cc_85c6_431f_8070_3b8061de6ed8.slice/crio-32bd80d2b809248a60769cfa0208453bc1976a147436bf5fadb1c57f3176ad17 WatchSource:0}: Error finding container 32bd80d2b809248a60769cfa0208453bc1976a147436bf5fadb1c57f3176ad17: Status 404 returned error can't find the container with id 32bd80d2b809248a60769cfa0208453bc1976a147436bf5fadb1c57f3176ad17
Sep 15 11:53:33.821536 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.821499    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-7efa8b/sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp" event={"ID":"22d7b6cc-85c6-431f-8070-3b8061de6ed8","Type":"ContainerStarted","Data":"bc3cb53869135b27ad931f2c7737b283732fd32da49a281f9372193fa0eed6ca"}
Sep 15 11:53:33.821789 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.821551    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-7efa8b/sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp" event={"ID":"22d7b6cc-85c6-431f-8070-3b8061de6ed8","Type":"ContainerStarted","Data":"32bd80d2b809248a60769cfa0208453bc1976a147436bf5fadb1c57f3176ad17"}
Sep 15 11:53:33.839048 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:33.838980    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-7efa8b/sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp" podStartSLOduration=0.838958341 podStartE2EDuration="838.958341ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:53:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:53:33.837406778 +0000 UTC m=+1684.263737365" watchObservedRunningTime="2026-09-15 11:53:33.838958341 +0000 UTC m=+1684.265288937"
Sep 15 11:53:43.462532 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:43.462487    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-7efa8b/sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp"
Sep 15 11:53:43.463005 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:43.462551    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-7efa8b/sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp"
Sep 15 11:53:43.475843 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:43.475816    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-7efa8b/sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp"
Sep 15 11:53:43.891033 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:43.891000    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-7efa8b/sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp"
Sep 15 11:53:58.754033 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:58.753942    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-2cc790/sub-test-model-2cc790-kserve-b4d6864ff-khxd6"]
Sep 15 11:53:58.758161 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:58.758133    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-2cc790/sub-test-model-2cc790-kserve-b4d6864ff-khxd6"
Sep 15 11:53:58.761137 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:58.761103    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-2cc790\"/\"openshift-service-ca.crt\""
Sep 15 11:53:58.761137 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:58.761139    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-2cc790\"/\"sub-test-model-2cc790-kserve-self-signed-certs\""
Sep 15 11:53:58.761394 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:58.761104    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-2cc790\"/\"kube-root-ca.crt\""
Sep 15 11:53:58.761394 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:58.761107    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-2cc790\"/\"default-dockercfg-987px\""
Sep 15 11:53:58.767772 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:58.767741    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-2cc790/sub-test-model-2cc790-kserve-b4d6864ff-khxd6"]
Sep 15 11:53:58.879017 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:58.878976    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/356120a7-307e-43e8-8852-9ce092c8ade7-tls-certs\") pod \"sub-test-model-2cc790-kserve-b4d6864ff-khxd6\" (UID: \"356120a7-307e-43e8-8852-9ce092c8ade7\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/sub-test-model-2cc790-kserve-b4d6864ff-khxd6"
Sep 15 11:53:58.879215 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:58.879054    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkpxt\" (UniqueName: \"kubernetes.io/projected/356120a7-307e-43e8-8852-9ce092c8ade7-kube-api-access-gkpxt\") pod \"sub-test-model-2cc790-kserve-b4d6864ff-khxd6\" (UID: \"356120a7-307e-43e8-8852-9ce092c8ade7\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/sub-test-model-2cc790-kserve-b4d6864ff-khxd6"
Sep 15 11:53:58.879215 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:58.879094    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/356120a7-307e-43e8-8852-9ce092c8ade7-dshm\") pod \"sub-test-model-2cc790-kserve-b4d6864ff-khxd6\" (UID: \"356120a7-307e-43e8-8852-9ce092c8ade7\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/sub-test-model-2cc790-kserve-b4d6864ff-khxd6"
Sep 15 11:53:58.879215 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:58.879115    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/356120a7-307e-43e8-8852-9ce092c8ade7-model-cache\") pod \"sub-test-model-2cc790-kserve-b4d6864ff-khxd6\" (UID: \"356120a7-307e-43e8-8852-9ce092c8ade7\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/sub-test-model-2cc790-kserve-b4d6864ff-khxd6"
Sep 15 11:53:58.879215 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:58.879172    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/356120a7-307e-43e8-8852-9ce092c8ade7-home\") pod \"sub-test-model-2cc790-kserve-b4d6864ff-khxd6\" (UID: \"356120a7-307e-43e8-8852-9ce092c8ade7\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/sub-test-model-2cc790-kserve-b4d6864ff-khxd6"
Sep 15 11:53:58.879392 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:58.879221    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/356120a7-307e-43e8-8852-9ce092c8ade7-tmp-dir\") pod \"sub-test-model-2cc790-kserve-b4d6864ff-khxd6\" (UID: \"356120a7-307e-43e8-8852-9ce092c8ade7\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/sub-test-model-2cc790-kserve-b4d6864ff-khxd6"
Sep 15 11:53:58.980084 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:58.980044    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkpxt\" (UniqueName: \"kubernetes.io/projected/356120a7-307e-43e8-8852-9ce092c8ade7-kube-api-access-gkpxt\") pod \"sub-test-model-2cc790-kserve-b4d6864ff-khxd6\" (UID: \"356120a7-307e-43e8-8852-9ce092c8ade7\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/sub-test-model-2cc790-kserve-b4d6864ff-khxd6"
Sep 15 11:53:58.980296 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:58.980095    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/356120a7-307e-43e8-8852-9ce092c8ade7-dshm\") pod \"sub-test-model-2cc790-kserve-b4d6864ff-khxd6\" (UID: \"356120a7-307e-43e8-8852-9ce092c8ade7\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/sub-test-model-2cc790-kserve-b4d6864ff-khxd6"
Sep 15 11:53:58.980296 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:58.980116    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/356120a7-307e-43e8-8852-9ce092c8ade7-model-cache\") pod \"sub-test-model-2cc790-kserve-b4d6864ff-khxd6\" (UID: \"356120a7-307e-43e8-8852-9ce092c8ade7\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/sub-test-model-2cc790-kserve-b4d6864ff-khxd6"
Sep 15 11:53:58.980296 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:58.980154    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/356120a7-307e-43e8-8852-9ce092c8ade7-home\") pod \"sub-test-model-2cc790-kserve-b4d6864ff-khxd6\" (UID: \"356120a7-307e-43e8-8852-9ce092c8ade7\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/sub-test-model-2cc790-kserve-b4d6864ff-khxd6"
Sep 15 11:53:58.980296 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:58.980171    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/356120a7-307e-43e8-8852-9ce092c8ade7-tmp-dir\") pod \"sub-test-model-2cc790-kserve-b4d6864ff-khxd6\" (UID: \"356120a7-307e-43e8-8852-9ce092c8ade7\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/sub-test-model-2cc790-kserve-b4d6864ff-khxd6"
Sep 15 11:53:58.980296 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:58.980272    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/356120a7-307e-43e8-8852-9ce092c8ade7-tls-certs\") pod \"sub-test-model-2cc790-kserve-b4d6864ff-khxd6\" (UID: \"356120a7-307e-43e8-8852-9ce092c8ade7\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/sub-test-model-2cc790-kserve-b4d6864ff-khxd6"
Sep 15 11:53:58.980602 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:58.980571    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/356120a7-307e-43e8-8852-9ce092c8ade7-model-cache\") pod \"sub-test-model-2cc790-kserve-b4d6864ff-khxd6\" (UID: \"356120a7-307e-43e8-8852-9ce092c8ade7\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/sub-test-model-2cc790-kserve-b4d6864ff-khxd6"
Sep 15 11:53:58.980689 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:58.980584    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/356120a7-307e-43e8-8852-9ce092c8ade7-home\") pod \"sub-test-model-2cc790-kserve-b4d6864ff-khxd6\" (UID: \"356120a7-307e-43e8-8852-9ce092c8ade7\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/sub-test-model-2cc790-kserve-b4d6864ff-khxd6"
Sep 15 11:53:58.980757 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:58.980711    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/356120a7-307e-43e8-8852-9ce092c8ade7-tmp-dir\") pod \"sub-test-model-2cc790-kserve-b4d6864ff-khxd6\" (UID: \"356120a7-307e-43e8-8852-9ce092c8ade7\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/sub-test-model-2cc790-kserve-b4d6864ff-khxd6"
Sep 15 11:53:58.982540 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:58.982509    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/356120a7-307e-43e8-8852-9ce092c8ade7-dshm\") pod \"sub-test-model-2cc790-kserve-b4d6864ff-khxd6\" (UID: \"356120a7-307e-43e8-8852-9ce092c8ade7\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/sub-test-model-2cc790-kserve-b4d6864ff-khxd6"
Sep 15 11:53:58.982731 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:58.982713    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/356120a7-307e-43e8-8852-9ce092c8ade7-tls-certs\") pod \"sub-test-model-2cc790-kserve-b4d6864ff-khxd6\" (UID: \"356120a7-307e-43e8-8852-9ce092c8ade7\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/sub-test-model-2cc790-kserve-b4d6864ff-khxd6"
Sep 15 11:53:58.989187 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:58.989162    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkpxt\" (UniqueName: \"kubernetes.io/projected/356120a7-307e-43e8-8852-9ce092c8ade7-kube-api-access-gkpxt\") pod \"sub-test-model-2cc790-kserve-b4d6864ff-khxd6\" (UID: \"356120a7-307e-43e8-8852-9ce092c8ade7\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/sub-test-model-2cc790-kserve-b4d6864ff-khxd6"
Sep 15 11:53:59.070419 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:59.070376    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-2cc790/sub-test-model-2cc790-kserve-b4d6864ff-khxd6"
Sep 15 11:53:59.349348 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:59.349321    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-2cc790/sub-test-model-2cc790-kserve-b4d6864ff-khxd6"]
Sep 15 11:53:59.350900 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:53:59.350860    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod356120a7_307e_43e8_8852_9ce092c8ade7.slice/crio-122352bcd7a8644d3690ed9a642006a16a64cb1a4209b36978818ab133c0b6b5 WatchSource:0}: Error finding container 122352bcd7a8644d3690ed9a642006a16a64cb1a4209b36978818ab133c0b6b5: Status 404 returned error can't find the container with id 122352bcd7a8644d3690ed9a642006a16a64cb1a4209b36978818ab133c0b6b5
Sep 15 11:53:59.976017 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:59.975973    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-2cc790/sub-test-model-2cc790-kserve-b4d6864ff-khxd6" event={"ID":"356120a7-307e-43e8-8852-9ce092c8ade7","Type":"ContainerStarted","Data":"f1f5fd690cbe004814dca8732c44b67366dcd2b1ffbdb10ca599f66cd2e7af7b"}
Sep 15 11:53:59.976435 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:59.976027    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-2cc790/sub-test-model-2cc790-kserve-b4d6864ff-khxd6" event={"ID":"356120a7-307e-43e8-8852-9ce092c8ade7","Type":"ContainerStarted","Data":"122352bcd7a8644d3690ed9a642006a16a64cb1a4209b36978818ab133c0b6b5"}
Sep 15 11:53:59.995490 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:53:59.995431    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-2cc790/sub-test-model-2cc790-kserve-b4d6864ff-khxd6" podStartSLOduration=1.99541312 podStartE2EDuration="1.99541312s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:53:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:53:59.992932912 +0000 UTC m=+1710.419263508" watchObservedRunningTime="2026-09-15 11:53:59.99541312 +0000 UTC m=+1710.421743717"
Sep 15 11:54:09.071367 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:09.071314    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-2cc790/sub-test-model-2cc790-kserve-b4d6864ff-khxd6"
Sep 15 11:54:09.071826 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:09.071383    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-2cc790/sub-test-model-2cc790-kserve-b4d6864ff-khxd6"
Sep 15 11:54:09.084077 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:09.084042    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-2cc790/sub-test-model-2cc790-kserve-b4d6864ff-khxd6"
Sep 15 11:54:10.050405 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:10.050372    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-2cc790/sub-test-model-2cc790-kserve-b4d6864ff-khxd6"
Sep 15 11:54:31.693490 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:31.693442    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-7efa8b/sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp"]
Sep 15 11:54:32.775091 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:32.775055    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-2cc790/sub-test-model-2cc790-kserve-b4d6864ff-khxd6"]
Sep 15 11:54:46.713799 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:46.713748    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-7efa8b/sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp" podUID="22d7b6cc-85c6-431f-8070-3b8061de6ed8" containerName="main" containerID="cri-o://bc3cb53869135b27ad931f2c7737b283732fd32da49a281f9372193fa0eed6ca" gracePeriod=45
Sep 15 11:54:46.971520 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:46.971446    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-7efa8b/sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp"
Sep 15 11:54:47.069187 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:47.069141    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22d7b6cc-85c6-431f-8070-3b8061de6ed8-tmp-dir\") pod \"22d7b6cc-85c6-431f-8070-3b8061de6ed8\" (UID: \"22d7b6cc-85c6-431f-8070-3b8061de6ed8\") "
Sep 15 11:54:47.069187 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:47.069192    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/22d7b6cc-85c6-431f-8070-3b8061de6ed8-dshm\") pod \"22d7b6cc-85c6-431f-8070-3b8061de6ed8\" (UID: \"22d7b6cc-85c6-431f-8070-3b8061de6ed8\") "
Sep 15 11:54:47.069458 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:47.069228    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22d7b6cc-85c6-431f-8070-3b8061de6ed8-model-cache\") pod \"22d7b6cc-85c6-431f-8070-3b8061de6ed8\" (UID: \"22d7b6cc-85c6-431f-8070-3b8061de6ed8\") "
Sep 15 11:54:47.069458 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:47.069262    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/22d7b6cc-85c6-431f-8070-3b8061de6ed8-home\") pod \"22d7b6cc-85c6-431f-8070-3b8061de6ed8\" (UID: \"22d7b6cc-85c6-431f-8070-3b8061de6ed8\") "
Sep 15 11:54:47.069458 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:47.069287    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22d7b6cc-85c6-431f-8070-3b8061de6ed8-tls-certs\") pod \"22d7b6cc-85c6-431f-8070-3b8061de6ed8\" (UID: \"22d7b6cc-85c6-431f-8070-3b8061de6ed8\") "
Sep 15 11:54:47.069458 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:47.069329    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbdhq\" (UniqueName: \"kubernetes.io/projected/22d7b6cc-85c6-431f-8070-3b8061de6ed8-kube-api-access-gbdhq\") pod \"22d7b6cc-85c6-431f-8070-3b8061de6ed8\" (UID: \"22d7b6cc-85c6-431f-8070-3b8061de6ed8\") "
Sep 15 11:54:47.069648 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:47.069473    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22d7b6cc-85c6-431f-8070-3b8061de6ed8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "22d7b6cc-85c6-431f-8070-3b8061de6ed8" (UID: "22d7b6cc-85c6-431f-8070-3b8061de6ed8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:54:47.069648 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:47.069530    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22d7b6cc-85c6-431f-8070-3b8061de6ed8-home" (OuterVolumeSpecName: "home") pod "22d7b6cc-85c6-431f-8070-3b8061de6ed8" (UID: "22d7b6cc-85c6-431f-8070-3b8061de6ed8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:54:47.069648 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:47.069545    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22d7b6cc-85c6-431f-8070-3b8061de6ed8-model-cache" (OuterVolumeSpecName: "model-cache") pod "22d7b6cc-85c6-431f-8070-3b8061de6ed8" (UID: "22d7b6cc-85c6-431f-8070-3b8061de6ed8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:54:47.069833 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:47.069783    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22d7b6cc-85c6-431f-8070-3b8061de6ed8-tmp-dir\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:54:47.069833 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:47.069800    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22d7b6cc-85c6-431f-8070-3b8061de6ed8-model-cache\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:54:47.069833 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:47.069808    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/22d7b6cc-85c6-431f-8070-3b8061de6ed8-home\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:54:47.071376 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:47.071348    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22d7b6cc-85c6-431f-8070-3b8061de6ed8-dshm" (OuterVolumeSpecName: "dshm") pod "22d7b6cc-85c6-431f-8070-3b8061de6ed8" (UID: "22d7b6cc-85c6-431f-8070-3b8061de6ed8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:54:47.071540 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:47.071519    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22d7b6cc-85c6-431f-8070-3b8061de6ed8-kube-api-access-gbdhq" (OuterVolumeSpecName: "kube-api-access-gbdhq") pod "22d7b6cc-85c6-431f-8070-3b8061de6ed8" (UID: "22d7b6cc-85c6-431f-8070-3b8061de6ed8"). InnerVolumeSpecName "kube-api-access-gbdhq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:54:47.071606 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:47.071518    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22d7b6cc-85c6-431f-8070-3b8061de6ed8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "22d7b6cc-85c6-431f-8070-3b8061de6ed8" (UID: "22d7b6cc-85c6-431f-8070-3b8061de6ed8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:54:47.170978 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:47.170932    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbdhq\" (UniqueName: \"kubernetes.io/projected/22d7b6cc-85c6-431f-8070-3b8061de6ed8-kube-api-access-gbdhq\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:54:47.170978 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:47.170970    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/22d7b6cc-85c6-431f-8070-3b8061de6ed8-dshm\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:54:47.170978 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:47.170981    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22d7b6cc-85c6-431f-8070-3b8061de6ed8-tls-certs\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:54:47.267638 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:47.267534    2575 generic.go:356] "Generic (PLEG): container finished" podID="22d7b6cc-85c6-431f-8070-3b8061de6ed8" containerID="bc3cb53869135b27ad931f2c7737b283732fd32da49a281f9372193fa0eed6ca" exitCode=0
Sep 15 11:54:47.267638 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:47.267578    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-7efa8b/sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp"
Sep 15 11:54:47.267909 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:47.267578    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-7efa8b/sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp" event={"ID":"22d7b6cc-85c6-431f-8070-3b8061de6ed8","Type":"ContainerDied","Data":"bc3cb53869135b27ad931f2c7737b283732fd32da49a281f9372193fa0eed6ca"}
Sep 15 11:54:47.267909 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:47.267710    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-7efa8b/sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp" event={"ID":"22d7b6cc-85c6-431f-8070-3b8061de6ed8","Type":"ContainerDied","Data":"32bd80d2b809248a60769cfa0208453bc1976a147436bf5fadb1c57f3176ad17"}
Sep 15 11:54:47.267909 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:47.267731    2575 scope.go:117] "RemoveContainer" containerID="bc3cb53869135b27ad931f2c7737b283732fd32da49a281f9372193fa0eed6ca"
Sep 15 11:54:47.278926 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:47.278907    2575 scope.go:117] "RemoveContainer" containerID="bc3cb53869135b27ad931f2c7737b283732fd32da49a281f9372193fa0eed6ca"
Sep 15 11:54:47.279280 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:54:47.279260    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc3cb53869135b27ad931f2c7737b283732fd32da49a281f9372193fa0eed6ca\": container with ID starting with bc3cb53869135b27ad931f2c7737b283732fd32da49a281f9372193fa0eed6ca not found: ID does not exist" containerID="bc3cb53869135b27ad931f2c7737b283732fd32da49a281f9372193fa0eed6ca"
Sep 15 11:54:47.279324 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:47.279291    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc3cb53869135b27ad931f2c7737b283732fd32da49a281f9372193fa0eed6ca"} err="failed to get container status \"bc3cb53869135b27ad931f2c7737b283732fd32da49a281f9372193fa0eed6ca\": rpc error: code = NotFound desc = could not find container \"bc3cb53869135b27ad931f2c7737b283732fd32da49a281f9372193fa0eed6ca\": container with ID starting with bc3cb53869135b27ad931f2c7737b283732fd32da49a281f9372193fa0eed6ca not found: ID does not exist"
Sep 15 11:54:47.290822 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:47.290782    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-7efa8b/sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp"]
Sep 15 11:54:47.295504 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:47.295477    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-7efa8b/sub-test-model-7efa8b-kserve-5847dfb7df-m4pdp"]
Sep 15 11:54:47.795308 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:47.795253    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-2cc790/sub-test-model-2cc790-kserve-b4d6864ff-khxd6" podUID="356120a7-307e-43e8-8852-9ce092c8ade7" containerName="main" containerID="cri-o://f1f5fd690cbe004814dca8732c44b67366dcd2b1ffbdb10ca599f66cd2e7af7b" gracePeriod=45
Sep 15 11:54:48.049459 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:48.049369    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-2cc790/sub-test-model-2cc790-kserve-b4d6864ff-khxd6"
Sep 15 11:54:48.094836 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:48.094800    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22d7b6cc-85c6-431f-8070-3b8061de6ed8" path="/var/lib/kubelet/pods/22d7b6cc-85c6-431f-8070-3b8061de6ed8/volumes"
Sep 15 11:54:48.178129 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:48.178095    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/356120a7-307e-43e8-8852-9ce092c8ade7-dshm\") pod \"356120a7-307e-43e8-8852-9ce092c8ade7\" (UID: \"356120a7-307e-43e8-8852-9ce092c8ade7\") "
Sep 15 11:54:48.178352 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:48.178206    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/356120a7-307e-43e8-8852-9ce092c8ade7-tmp-dir\") pod \"356120a7-307e-43e8-8852-9ce092c8ade7\" (UID: \"356120a7-307e-43e8-8852-9ce092c8ade7\") "
Sep 15 11:54:48.178352 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:48.178237    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gkpxt\" (UniqueName: \"kubernetes.io/projected/356120a7-307e-43e8-8852-9ce092c8ade7-kube-api-access-gkpxt\") pod \"356120a7-307e-43e8-8852-9ce092c8ade7\" (UID: \"356120a7-307e-43e8-8852-9ce092c8ade7\") "
Sep 15 11:54:48.178352 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:48.178262    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/356120a7-307e-43e8-8852-9ce092c8ade7-model-cache\") pod \"356120a7-307e-43e8-8852-9ce092c8ade7\" (UID: \"356120a7-307e-43e8-8852-9ce092c8ade7\") "
Sep 15 11:54:48.178352 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:48.178336    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/356120a7-307e-43e8-8852-9ce092c8ade7-tls-certs\") pod \"356120a7-307e-43e8-8852-9ce092c8ade7\" (UID: \"356120a7-307e-43e8-8852-9ce092c8ade7\") "
Sep 15 11:54:48.178560 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:48.178359    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/356120a7-307e-43e8-8852-9ce092c8ade7-home\") pod \"356120a7-307e-43e8-8852-9ce092c8ade7\" (UID: \"356120a7-307e-43e8-8852-9ce092c8ade7\") "
Sep 15 11:54:48.178560 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:48.178477    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/356120a7-307e-43e8-8852-9ce092c8ade7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "356120a7-307e-43e8-8852-9ce092c8ade7" (UID: "356120a7-307e-43e8-8852-9ce092c8ade7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:54:48.178699 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:48.178584    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/356120a7-307e-43e8-8852-9ce092c8ade7-model-cache" (OuterVolumeSpecName: "model-cache") pod "356120a7-307e-43e8-8852-9ce092c8ade7" (UID: "356120a7-307e-43e8-8852-9ce092c8ade7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:54:48.178767 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:48.178705    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/356120a7-307e-43e8-8852-9ce092c8ade7-home" (OuterVolumeSpecName: "home") pod "356120a7-307e-43e8-8852-9ce092c8ade7" (UID: "356120a7-307e-43e8-8852-9ce092c8ade7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:54:48.178821 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:48.178798    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/356120a7-307e-43e8-8852-9ce092c8ade7-home\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:54:48.178821 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:48.178814    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/356120a7-307e-43e8-8852-9ce092c8ade7-tmp-dir\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:54:48.178938 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:48.178828    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/356120a7-307e-43e8-8852-9ce092c8ade7-model-cache\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:54:48.180507 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:48.180473    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/356120a7-307e-43e8-8852-9ce092c8ade7-dshm" (OuterVolumeSpecName: "dshm") pod "356120a7-307e-43e8-8852-9ce092c8ade7" (UID: "356120a7-307e-43e8-8852-9ce092c8ade7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:54:48.180646 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:48.180532    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/356120a7-307e-43e8-8852-9ce092c8ade7-kube-api-access-gkpxt" (OuterVolumeSpecName: "kube-api-access-gkpxt") pod "356120a7-307e-43e8-8852-9ce092c8ade7" (UID: "356120a7-307e-43e8-8852-9ce092c8ade7"). InnerVolumeSpecName "kube-api-access-gkpxt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:54:48.180646 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:48.180555    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/356120a7-307e-43e8-8852-9ce092c8ade7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "356120a7-307e-43e8-8852-9ce092c8ade7" (UID: "356120a7-307e-43e8-8852-9ce092c8ade7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:54:48.274557 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:48.274521    2575 generic.go:356] "Generic (PLEG): container finished" podID="356120a7-307e-43e8-8852-9ce092c8ade7" containerID="f1f5fd690cbe004814dca8732c44b67366dcd2b1ffbdb10ca599f66cd2e7af7b" exitCode=0
Sep 15 11:54:48.274776 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:48.274575    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-2cc790/sub-test-model-2cc790-kserve-b4d6864ff-khxd6"
Sep 15 11:54:48.274776 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:48.274599    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-2cc790/sub-test-model-2cc790-kserve-b4d6864ff-khxd6" event={"ID":"356120a7-307e-43e8-8852-9ce092c8ade7","Type":"ContainerDied","Data":"f1f5fd690cbe004814dca8732c44b67366dcd2b1ffbdb10ca599f66cd2e7af7b"}
Sep 15 11:54:48.274776 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:48.274646    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-2cc790/sub-test-model-2cc790-kserve-b4d6864ff-khxd6" event={"ID":"356120a7-307e-43e8-8852-9ce092c8ade7","Type":"ContainerDied","Data":"122352bcd7a8644d3690ed9a642006a16a64cb1a4209b36978818ab133c0b6b5"}
Sep 15 11:54:48.274776 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:48.274687    2575 scope.go:117] "RemoveContainer" containerID="f1f5fd690cbe004814dca8732c44b67366dcd2b1ffbdb10ca599f66cd2e7af7b"
Sep 15 11:54:48.279883 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:48.279832    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/356120a7-307e-43e8-8852-9ce092c8ade7-tls-certs\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:54:48.279883 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:48.279860    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/356120a7-307e-43e8-8852-9ce092c8ade7-dshm\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:54:48.279883 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:48.279873    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gkpxt\" (UniqueName: \"kubernetes.io/projected/356120a7-307e-43e8-8852-9ce092c8ade7-kube-api-access-gkpxt\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:54:48.285272 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:48.285249    2575 scope.go:117] "RemoveContainer" containerID="f1f5fd690cbe004814dca8732c44b67366dcd2b1ffbdb10ca599f66cd2e7af7b"
Sep 15 11:54:48.285594 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:54:48.285572    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1f5fd690cbe004814dca8732c44b67366dcd2b1ffbdb10ca599f66cd2e7af7b\": container with ID starting with f1f5fd690cbe004814dca8732c44b67366dcd2b1ffbdb10ca599f66cd2e7af7b not found: ID does not exist" containerID="f1f5fd690cbe004814dca8732c44b67366dcd2b1ffbdb10ca599f66cd2e7af7b"
Sep 15 11:54:48.285716 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:48.285601    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1f5fd690cbe004814dca8732c44b67366dcd2b1ffbdb10ca599f66cd2e7af7b"} err="failed to get container status \"f1f5fd690cbe004814dca8732c44b67366dcd2b1ffbdb10ca599f66cd2e7af7b\": rpc error: code = NotFound desc = could not find container \"f1f5fd690cbe004814dca8732c44b67366dcd2b1ffbdb10ca599f66cd2e7af7b\": container with ID starting with f1f5fd690cbe004814dca8732c44b67366dcd2b1ffbdb10ca599f66cd2e7af7b not found: ID does not exist"
Sep 15 11:54:48.296008 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:48.295971    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-2cc790/sub-test-model-2cc790-kserve-b4d6864ff-khxd6"]
Sep 15 11:54:48.300092 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:48.300017    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-2cc790/sub-test-model-2cc790-kserve-b4d6864ff-khxd6"]
Sep 15 11:54:50.094525 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:54:50.094477    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="356120a7-307e-43e8-8852-9ce092c8ade7" path="/var/lib/kubelet/pods/356120a7-307e-43e8-8852-9ce092c8ade7/volumes"
Sep 15 11:55:08.960780 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:08.960740    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-2cc790/rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g"]
Sep 15 11:55:08.961460 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:08.961388    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22d7b6cc-85c6-431f-8070-3b8061de6ed8" containerName="main"
Sep 15 11:55:08.961460 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:08.961414    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="22d7b6cc-85c6-431f-8070-3b8061de6ed8" containerName="main"
Sep 15 11:55:08.961460 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:08.961454    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="356120a7-307e-43e8-8852-9ce092c8ade7" containerName="main"
Sep 15 11:55:08.961646 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:08.961463    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="356120a7-307e-43e8-8852-9ce092c8ade7" containerName="main"
Sep 15 11:55:08.961646 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:08.961572    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="356120a7-307e-43e8-8852-9ce092c8ade7" containerName="main"
Sep 15 11:55:08.961646 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:08.961589    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="22d7b6cc-85c6-431f-8070-3b8061de6ed8" containerName="main"
Sep 15 11:55:08.963860 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:08.963835    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-2cc790/rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g"
Sep 15 11:55:08.966749 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:08.966716    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-2cc790\"/\"default-dockercfg-987px\""
Sep 15 11:55:08.966749 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:08.966737    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-2cc790\"/\"rate-test-model-2cc790-kserve-self-signed-certs\""
Sep 15 11:55:08.966988 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:08.966716    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-2cc790\"/\"openshift-service-ca.crt\""
Sep 15 11:55:08.966988 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:08.966783    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-2cc790\"/\"kube-root-ca.crt\""
Sep 15 11:55:08.973092 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:08.973067    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-2cc790/rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g"]
Sep 15 11:55:09.087375 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:09.087334    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33c76c39-b0b6-4e57-977a-cb0a7f5894d5-tls-certs\") pod \"rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g\" (UID: \"33c76c39-b0b6-4e57-977a-cb0a7f5894d5\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g"
Sep 15 11:55:09.087553 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:09.087391    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33c76c39-b0b6-4e57-977a-cb0a7f5894d5-dshm\") pod \"rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g\" (UID: \"33c76c39-b0b6-4e57-977a-cb0a7f5894d5\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g"
Sep 15 11:55:09.087553 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:09.087412    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33c76c39-b0b6-4e57-977a-cb0a7f5894d5-tmp-dir\") pod \"rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g\" (UID: \"33c76c39-b0b6-4e57-977a-cb0a7f5894d5\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g"
Sep 15 11:55:09.087553 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:09.087458    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33c76c39-b0b6-4e57-977a-cb0a7f5894d5-home\") pod \"rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g\" (UID: \"33c76c39-b0b6-4e57-977a-cb0a7f5894d5\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g"
Sep 15 11:55:09.087553 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:09.087484    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nwqp\" (UniqueName: \"kubernetes.io/projected/33c76c39-b0b6-4e57-977a-cb0a7f5894d5-kube-api-access-9nwqp\") pod \"rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g\" (UID: \"33c76c39-b0b6-4e57-977a-cb0a7f5894d5\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g"
Sep 15 11:55:09.087553 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:09.087523    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33c76c39-b0b6-4e57-977a-cb0a7f5894d5-model-cache\") pod \"rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g\" (UID: \"33c76c39-b0b6-4e57-977a-cb0a7f5894d5\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g"
Sep 15 11:55:09.189022 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:09.188971    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33c76c39-b0b6-4e57-977a-cb0a7f5894d5-home\") pod \"rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g\" (UID: \"33c76c39-b0b6-4e57-977a-cb0a7f5894d5\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g"
Sep 15 11:55:09.189022 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:09.189027    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nwqp\" (UniqueName: \"kubernetes.io/projected/33c76c39-b0b6-4e57-977a-cb0a7f5894d5-kube-api-access-9nwqp\") pod \"rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g\" (UID: \"33c76c39-b0b6-4e57-977a-cb0a7f5894d5\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g"
Sep 15 11:55:09.189254 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:09.189070    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33c76c39-b0b6-4e57-977a-cb0a7f5894d5-model-cache\") pod \"rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g\" (UID: \"33c76c39-b0b6-4e57-977a-cb0a7f5894d5\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g"
Sep 15 11:55:09.189254 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:09.189152    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33c76c39-b0b6-4e57-977a-cb0a7f5894d5-tls-certs\") pod \"rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g\" (UID: \"33c76c39-b0b6-4e57-977a-cb0a7f5894d5\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g"
Sep 15 11:55:09.189254 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:09.189187    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33c76c39-b0b6-4e57-977a-cb0a7f5894d5-dshm\") pod \"rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g\" (UID: \"33c76c39-b0b6-4e57-977a-cb0a7f5894d5\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g"
Sep 15 11:55:09.189254 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:09.189209    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33c76c39-b0b6-4e57-977a-cb0a7f5894d5-tmp-dir\") pod \"rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g\" (UID: \"33c76c39-b0b6-4e57-977a-cb0a7f5894d5\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g"
Sep 15 11:55:09.189482 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:09.189457    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33c76c39-b0b6-4e57-977a-cb0a7f5894d5-home\") pod \"rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g\" (UID: \"33c76c39-b0b6-4e57-977a-cb0a7f5894d5\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g"
Sep 15 11:55:09.189526 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:09.189512    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33c76c39-b0b6-4e57-977a-cb0a7f5894d5-model-cache\") pod \"rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g\" (UID: \"33c76c39-b0b6-4e57-977a-cb0a7f5894d5\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g"
Sep 15 11:55:09.189628 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:09.189607    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33c76c39-b0b6-4e57-977a-cb0a7f5894d5-tmp-dir\") pod \"rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g\" (UID: \"33c76c39-b0b6-4e57-977a-cb0a7f5894d5\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g"
Sep 15 11:55:09.191584 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:09.191560    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33c76c39-b0b6-4e57-977a-cb0a7f5894d5-dshm\") pod \"rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g\" (UID: \"33c76c39-b0b6-4e57-977a-cb0a7f5894d5\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g"
Sep 15 11:55:09.191713 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:09.191682    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33c76c39-b0b6-4e57-977a-cb0a7f5894d5-tls-certs\") pod \"rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g\" (UID: \"33c76c39-b0b6-4e57-977a-cb0a7f5894d5\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g"
Sep 15 11:55:09.199635 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:09.199604    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nwqp\" (UniqueName: \"kubernetes.io/projected/33c76c39-b0b6-4e57-977a-cb0a7f5894d5-kube-api-access-9nwqp\") pod \"rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g\" (UID: \"33c76c39-b0b6-4e57-977a-cb0a7f5894d5\") " pod="ai-tenant-e2e-shared-b-w3-2cc790/rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g"
Sep 15 11:55:09.275546 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:09.275451    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-2cc790/rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g"
Sep 15 11:55:09.556385 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:09.556266    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-2cc790/rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g"]
Sep 15 11:55:09.564441 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:55:09.564392    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod33c76c39_b0b6_4e57_977a_cb0a7f5894d5.slice/crio-d7365cf683a19d414d1032e1fb4cafd2a01aa5fd90f571eca686aa10f399c128 WatchSource:0}: Error finding container d7365cf683a19d414d1032e1fb4cafd2a01aa5fd90f571eca686aa10f399c128: Status 404 returned error can't find the container with id d7365cf683a19d414d1032e1fb4cafd2a01aa5fd90f571eca686aa10f399c128
Sep 15 11:55:10.417744 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:10.417700    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-2cc790/rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g" event={"ID":"33c76c39-b0b6-4e57-977a-cb0a7f5894d5","Type":"ContainerStarted","Data":"fd139c7153e918a408fbb58dcce3c6a03aebdaa1f205310d6efdb046f8854a18"}
Sep 15 11:55:10.418173 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:10.417757    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-2cc790/rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g" event={"ID":"33c76c39-b0b6-4e57-977a-cb0a7f5894d5","Type":"ContainerStarted","Data":"d7365cf683a19d414d1032e1fb4cafd2a01aa5fd90f571eca686aa10f399c128"}
Sep 15 11:55:10.437104 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:10.437045    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-2cc790/rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g" podStartSLOduration=2.437023255 podStartE2EDuration="2.437023255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:55:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:55:10.435069462 +0000 UTC m=+1780.861400059" watchObservedRunningTime="2026-09-15 11:55:10.437023255 +0000 UTC m=+1780.863353851"
Sep 15 11:55:19.276233 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:19.276177    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-2cc790/rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g"
Sep 15 11:55:19.276714 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:19.276267    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-2cc790/rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g"
Sep 15 11:55:19.289446 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:19.289414    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-2cc790/rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g"
Sep 15 11:55:19.483078 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:19.483045    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-2cc790/rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g"
Sep 15 11:55:40.554189 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:40.554147    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-2cc790/rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g"]
Sep 15 11:55:46.873131 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:46.873090    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-173324-58bfd9448d-fcw5j"]
Sep 15 11:55:46.877113 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:46.877077    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-173324-58bfd9448d-fcw5j"
Sep 15 11:55:46.879961 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:46.879930    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-173324-serving-cert\""
Sep 15 11:55:46.888910 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:46.888878    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-173324-58bfd9448d-fcw5j"]
Sep 15 11:55:46.970936 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:46.970895    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbf8c075-623d-4f74-a4b4-30101b7da411-metrics-certs\") pod \"maas-api-e2e-ipp-a-173324-58bfd9448d-fcw5j\" (UID: \"cbf8c075-623d-4f74-a4b4-30101b7da411\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-173324-58bfd9448d-fcw5j"
Sep 15 11:55:46.971138 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:46.970976    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82nhr\" (UniqueName: \"kubernetes.io/projected/cbf8c075-623d-4f74-a4b4-30101b7da411-kube-api-access-82nhr\") pod \"maas-api-e2e-ipp-a-173324-58bfd9448d-fcw5j\" (UID: \"cbf8c075-623d-4f74-a4b4-30101b7da411\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-173324-58bfd9448d-fcw5j"
Sep 15 11:55:46.971222 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:46.971148    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbf8c075-623d-4f74-a4b4-30101b7da411-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-173324-58bfd9448d-fcw5j\" (UID: \"cbf8c075-623d-4f74-a4b4-30101b7da411\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-173324-58bfd9448d-fcw5j"
Sep 15 11:55:46.971284 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:46.971260    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbf8c075-623d-4f74-a4b4-30101b7da411-maas-api-tls\") pod \"maas-api-e2e-ipp-a-173324-58bfd9448d-fcw5j\" (UID: \"cbf8c075-623d-4f74-a4b4-30101b7da411\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-173324-58bfd9448d-fcw5j"
Sep 15 11:55:47.072567 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:47.072511    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbf8c075-623d-4f74-a4b4-30101b7da411-maas-api-tls\") pod \"maas-api-e2e-ipp-a-173324-58bfd9448d-fcw5j\" (UID: \"cbf8c075-623d-4f74-a4b4-30101b7da411\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-173324-58bfd9448d-fcw5j"
Sep 15 11:55:47.072567 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:47.072556    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbf8c075-623d-4f74-a4b4-30101b7da411-metrics-certs\") pod \"maas-api-e2e-ipp-a-173324-58bfd9448d-fcw5j\" (UID: \"cbf8c075-623d-4f74-a4b4-30101b7da411\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-173324-58bfd9448d-fcw5j"
Sep 15 11:55:47.072907 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:47.072606    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82nhr\" (UniqueName: \"kubernetes.io/projected/cbf8c075-623d-4f74-a4b4-30101b7da411-kube-api-access-82nhr\") pod \"maas-api-e2e-ipp-a-173324-58bfd9448d-fcw5j\" (UID: \"cbf8c075-623d-4f74-a4b4-30101b7da411\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-173324-58bfd9448d-fcw5j"
Sep 15 11:55:47.072907 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:47.072779    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbf8c075-623d-4f74-a4b4-30101b7da411-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-173324-58bfd9448d-fcw5j\" (UID: \"cbf8c075-623d-4f74-a4b4-30101b7da411\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-173324-58bfd9448d-fcw5j"
Sep 15 11:55:47.073447 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:47.073420    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbf8c075-623d-4f74-a4b4-30101b7da411-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-173324-58bfd9448d-fcw5j\" (UID: \"cbf8c075-623d-4f74-a4b4-30101b7da411\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-173324-58bfd9448d-fcw5j"
Sep 15 11:55:47.075285 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:47.075255    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbf8c075-623d-4f74-a4b4-30101b7da411-maas-api-tls\") pod \"maas-api-e2e-ipp-a-173324-58bfd9448d-fcw5j\" (UID: \"cbf8c075-623d-4f74-a4b4-30101b7da411\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-173324-58bfd9448d-fcw5j"
Sep 15 11:55:47.075386 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:47.075303    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbf8c075-623d-4f74-a4b4-30101b7da411-metrics-certs\") pod \"maas-api-e2e-ipp-a-173324-58bfd9448d-fcw5j\" (UID: \"cbf8c075-623d-4f74-a4b4-30101b7da411\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-173324-58bfd9448d-fcw5j"
Sep 15 11:55:47.082792 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:47.082767    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82nhr\" (UniqueName: \"kubernetes.io/projected/cbf8c075-623d-4f74-a4b4-30101b7da411-kube-api-access-82nhr\") pod \"maas-api-e2e-ipp-a-173324-58bfd9448d-fcw5j\" (UID: \"cbf8c075-623d-4f74-a4b4-30101b7da411\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-173324-58bfd9448d-fcw5j"
Sep 15 11:55:47.190079 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:47.189982    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-173324-58bfd9448d-fcw5j"
Sep 15 11:55:47.474872 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:47.474838    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-173324-58bfd9448d-fcw5j"]
Sep 15 11:55:47.476224 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:55:47.476184    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbf8c075_623d_4f74_a4b4_30101b7da411.slice/crio-0ff6c2926d62a499e0ed08f59081da3385c5cdf67b8f5f9932a343d667949556 WatchSource:0}: Error finding container 0ff6c2926d62a499e0ed08f59081da3385c5cdf67b8f5f9932a343d667949556: Status 404 returned error can't find the container with id 0ff6c2926d62a499e0ed08f59081da3385c5cdf67b8f5f9932a343d667949556
Sep 15 11:55:47.478030 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:47.478005    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 11:55:47.639030 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:47.638986    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-173324-58bfd9448d-fcw5j" event={"ID":"cbf8c075-623d-4f74-a4b4-30101b7da411","Type":"ContainerStarted","Data":"0ff6c2926d62a499e0ed08f59081da3385c5cdf67b8f5f9932a343d667949556"}
Sep 15 11:55:48.646525 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:48.646484    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-173324-58bfd9448d-fcw5j" event={"ID":"cbf8c075-623d-4f74-a4b4-30101b7da411","Type":"ContainerStarted","Data":"cad4e5672ba70802d38815248c7c5ad783a4961ce2044e10e431ad0de05733a6"}
Sep 15 11:55:48.647048 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:48.646637    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-173324-58bfd9448d-fcw5j"
Sep 15 11:55:48.667674 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:48.667590    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-173324-58bfd9448d-fcw5j" podStartSLOduration=2.259949144 podStartE2EDuration="2.667570656s" totalImagesPullingTime="407.621512ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:55:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:55:48.666171764 +0000 UTC m=+1819.092502364" watchObservedRunningTime="2026-09-15 11:55:48.667570656 +0000 UTC m=+1819.093901251"
Sep 15 11:55:54.658185 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:54.658155    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-173324-58bfd9448d-fcw5j"
Sep 15 11:55:55.574510 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:55.574462    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-2cc790/rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g" podUID="33c76c39-b0b6-4e57-977a-cb0a7f5894d5" containerName="main" containerID="cri-o://fd139c7153e918a408fbb58dcce3c6a03aebdaa1f205310d6efdb046f8854a18" gracePeriod=45
Sep 15 11:55:55.696876 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:55.696844    2575 generic.go:356] "Generic (PLEG): container finished" podID="33c76c39-b0b6-4e57-977a-cb0a7f5894d5" containerID="fd139c7153e918a408fbb58dcce3c6a03aebdaa1f205310d6efdb046f8854a18" exitCode=0
Sep 15 11:55:55.697258 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:55.696916    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-2cc790/rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g" event={"ID":"33c76c39-b0b6-4e57-977a-cb0a7f5894d5","Type":"ContainerDied","Data":"fd139c7153e918a408fbb58dcce3c6a03aebdaa1f205310d6efdb046f8854a18"}
Sep 15 11:55:55.821799 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:55.821759    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-2cc790/rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g"
Sep 15 11:55:55.961233 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:55.961125    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9nwqp\" (UniqueName: \"kubernetes.io/projected/33c76c39-b0b6-4e57-977a-cb0a7f5894d5-kube-api-access-9nwqp\") pod \"33c76c39-b0b6-4e57-977a-cb0a7f5894d5\" (UID: \"33c76c39-b0b6-4e57-977a-cb0a7f5894d5\") "
Sep 15 11:55:55.961233 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:55.961172    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33c76c39-b0b6-4e57-977a-cb0a7f5894d5-tls-certs\") pod \"33c76c39-b0b6-4e57-977a-cb0a7f5894d5\" (UID: \"33c76c39-b0b6-4e57-977a-cb0a7f5894d5\") "
Sep 15 11:55:55.961233 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:55.961219    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33c76c39-b0b6-4e57-977a-cb0a7f5894d5-tmp-dir\") pod \"33c76c39-b0b6-4e57-977a-cb0a7f5894d5\" (UID: \"33c76c39-b0b6-4e57-977a-cb0a7f5894d5\") "
Sep 15 11:55:55.961523 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:55.961253    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33c76c39-b0b6-4e57-977a-cb0a7f5894d5-home\") pod \"33c76c39-b0b6-4e57-977a-cb0a7f5894d5\" (UID: \"33c76c39-b0b6-4e57-977a-cb0a7f5894d5\") "
Sep 15 11:55:55.961523 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:55.961329    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33c76c39-b0b6-4e57-977a-cb0a7f5894d5-dshm\") pod \"33c76c39-b0b6-4e57-977a-cb0a7f5894d5\" (UID: \"33c76c39-b0b6-4e57-977a-cb0a7f5894d5\") "
Sep 15 11:55:55.961523 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:55.961368    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33c76c39-b0b6-4e57-977a-cb0a7f5894d5-model-cache\") pod \"33c76c39-b0b6-4e57-977a-cb0a7f5894d5\" (UID: \"33c76c39-b0b6-4e57-977a-cb0a7f5894d5\") "
Sep 15 11:55:55.961741 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:55.961517    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33c76c39-b0b6-4e57-977a-cb0a7f5894d5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "33c76c39-b0b6-4e57-977a-cb0a7f5894d5" (UID: "33c76c39-b0b6-4e57-977a-cb0a7f5894d5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:55:55.961741 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:55.961567    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33c76c39-b0b6-4e57-977a-cb0a7f5894d5-home" (OuterVolumeSpecName: "home") pod "33c76c39-b0b6-4e57-977a-cb0a7f5894d5" (UID: "33c76c39-b0b6-4e57-977a-cb0a7f5894d5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:55:55.961741 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:55.961682    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33c76c39-b0b6-4e57-977a-cb0a7f5894d5-model-cache" (OuterVolumeSpecName: "model-cache") pod "33c76c39-b0b6-4e57-977a-cb0a7f5894d5" (UID: "33c76c39-b0b6-4e57-977a-cb0a7f5894d5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:55:55.961902 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:55.961833    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33c76c39-b0b6-4e57-977a-cb0a7f5894d5-model-cache\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:55:55.961902 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:55.961845    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33c76c39-b0b6-4e57-977a-cb0a7f5894d5-tmp-dir\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:55:55.961902 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:55.961854    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33c76c39-b0b6-4e57-977a-cb0a7f5894d5-home\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:55:55.963410 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:55.963375    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33c76c39-b0b6-4e57-977a-cb0a7f5894d5-dshm" (OuterVolumeSpecName: "dshm") pod "33c76c39-b0b6-4e57-977a-cb0a7f5894d5" (UID: "33c76c39-b0b6-4e57-977a-cb0a7f5894d5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:55:55.963542 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:55.963460    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33c76c39-b0b6-4e57-977a-cb0a7f5894d5-kube-api-access-9nwqp" (OuterVolumeSpecName: "kube-api-access-9nwqp") pod "33c76c39-b0b6-4e57-977a-cb0a7f5894d5" (UID: "33c76c39-b0b6-4e57-977a-cb0a7f5894d5"). InnerVolumeSpecName "kube-api-access-9nwqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:55:55.963542 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:55.963466    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33c76c39-b0b6-4e57-977a-cb0a7f5894d5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "33c76c39-b0b6-4e57-977a-cb0a7f5894d5" (UID: "33c76c39-b0b6-4e57-977a-cb0a7f5894d5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:55:56.062856 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:56.062809    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9nwqp\" (UniqueName: \"kubernetes.io/projected/33c76c39-b0b6-4e57-977a-cb0a7f5894d5-kube-api-access-9nwqp\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:55:56.062856 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:56.062848    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33c76c39-b0b6-4e57-977a-cb0a7f5894d5-tls-certs\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:55:56.062856 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:56.062861    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33c76c39-b0b6-4e57-977a-cb0a7f5894d5-dshm\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:55:56.704262 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:56.704221    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-2cc790/rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g" event={"ID":"33c76c39-b0b6-4e57-977a-cb0a7f5894d5","Type":"ContainerDied","Data":"d7365cf683a19d414d1032e1fb4cafd2a01aa5fd90f571eca686aa10f399c128"}
Sep 15 11:55:56.704721 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:56.704278    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-2cc790/rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g"
Sep 15 11:55:56.704721 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:56.704288    2575 scope.go:117] "RemoveContainer" containerID="fd139c7153e918a408fbb58dcce3c6a03aebdaa1f205310d6efdb046f8854a18"
Sep 15 11:55:56.721753 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:56.721715    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-2cc790/rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g"]
Sep 15 11:55:56.725517 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:56.725480    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-2cc790/rate-test-model-2cc790-kserve-5fdcf45bd7-ngb4g"]
Sep 15 11:55:58.094375 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:55:58.094331    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33c76c39-b0b6-4e57-977a-cb0a7f5894d5" path="/var/lib/kubelet/pods/33c76c39-b0b6-4e57-977a-cb0a7f5894d5/volumes"
Sep 15 11:56:43.897386 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:56:43.897354    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-bp6jm_0f637e00-1499-422e-8d72-e7a5504bac92/payload-processing/0.log"
Sep 15 11:57:02.942927 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:02.942838    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-173324/ipp-route-173324-kserve-6cd9f57995-6rxf2"]
Sep 15 11:57:02.943542 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:02.943517    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33c76c39-b0b6-4e57-977a-cb0a7f5894d5" containerName="main"
Sep 15 11:57:02.943625 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:02.943547    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="33c76c39-b0b6-4e57-977a-cb0a7f5894d5" containerName="main"
Sep 15 11:57:02.943737 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:02.943722    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="33c76c39-b0b6-4e57-977a-cb0a7f5894d5" containerName="main"
Sep 15 11:57:02.947008 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:02.946979    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-173324/ipp-route-173324-kserve-6cd9f57995-6rxf2"
Sep 15 11:57:02.949420 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:02.949394    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-173324\"/\"default-dockercfg-tp5w2\""
Sep 15 11:57:02.949583 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:02.949427    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-173324\"/\"kube-root-ca.crt\""
Sep 15 11:57:02.950212 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:02.950190    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-173324\"/\"ipp-route-173324-kserve-self-signed-certs\""
Sep 15 11:57:02.950333 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:02.950241    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-173324\"/\"openshift-service-ca.crt\""
Sep 15 11:57:02.955843 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:02.955807    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-173324/ipp-route-173324-kserve-6cd9f57995-6rxf2"]
Sep 15 11:57:03.031366 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:03.031329    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41cbe8ba-7600-4e0d-9227-0491539f14c0-dshm\") pod \"ipp-route-173324-kserve-6cd9f57995-6rxf2\" (UID: \"41cbe8ba-7600-4e0d-9227-0491539f14c0\") " pod="ai-tenant-e2e-ipp-a-173324/ipp-route-173324-kserve-6cd9f57995-6rxf2"
Sep 15 11:57:03.031366 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:03.031384    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41cbe8ba-7600-4e0d-9227-0491539f14c0-model-cache\") pod \"ipp-route-173324-kserve-6cd9f57995-6rxf2\" (UID: \"41cbe8ba-7600-4e0d-9227-0491539f14c0\") " pod="ai-tenant-e2e-ipp-a-173324/ipp-route-173324-kserve-6cd9f57995-6rxf2"
Sep 15 11:57:03.031687 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:03.031503    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vms5h\" (UniqueName: \"kubernetes.io/projected/41cbe8ba-7600-4e0d-9227-0491539f14c0-kube-api-access-vms5h\") pod \"ipp-route-173324-kserve-6cd9f57995-6rxf2\" (UID: \"41cbe8ba-7600-4e0d-9227-0491539f14c0\") " pod="ai-tenant-e2e-ipp-a-173324/ipp-route-173324-kserve-6cd9f57995-6rxf2"
Sep 15 11:57:03.031687 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:03.031549    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41cbe8ba-7600-4e0d-9227-0491539f14c0-tmp-dir\") pod \"ipp-route-173324-kserve-6cd9f57995-6rxf2\" (UID: \"41cbe8ba-7600-4e0d-9227-0491539f14c0\") " pod="ai-tenant-e2e-ipp-a-173324/ipp-route-173324-kserve-6cd9f57995-6rxf2"
Sep 15 11:57:03.031687 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:03.031628    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41cbe8ba-7600-4e0d-9227-0491539f14c0-tls-certs\") pod \"ipp-route-173324-kserve-6cd9f57995-6rxf2\" (UID: \"41cbe8ba-7600-4e0d-9227-0491539f14c0\") " pod="ai-tenant-e2e-ipp-a-173324/ipp-route-173324-kserve-6cd9f57995-6rxf2"
Sep 15 11:57:03.031853 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:03.031735    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41cbe8ba-7600-4e0d-9227-0491539f14c0-home\") pod \"ipp-route-173324-kserve-6cd9f57995-6rxf2\" (UID: \"41cbe8ba-7600-4e0d-9227-0491539f14c0\") " pod="ai-tenant-e2e-ipp-a-173324/ipp-route-173324-kserve-6cd9f57995-6rxf2"
Sep 15 11:57:03.133292 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:03.133250    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41cbe8ba-7600-4e0d-9227-0491539f14c0-model-cache\") pod \"ipp-route-173324-kserve-6cd9f57995-6rxf2\" (UID: \"41cbe8ba-7600-4e0d-9227-0491539f14c0\") " pod="ai-tenant-e2e-ipp-a-173324/ipp-route-173324-kserve-6cd9f57995-6rxf2"
Sep 15 11:57:03.133509 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:03.133311    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vms5h\" (UniqueName: \"kubernetes.io/projected/41cbe8ba-7600-4e0d-9227-0491539f14c0-kube-api-access-vms5h\") pod \"ipp-route-173324-kserve-6cd9f57995-6rxf2\" (UID: \"41cbe8ba-7600-4e0d-9227-0491539f14c0\") " pod="ai-tenant-e2e-ipp-a-173324/ipp-route-173324-kserve-6cd9f57995-6rxf2"
Sep 15 11:57:03.133509 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:03.133333    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41cbe8ba-7600-4e0d-9227-0491539f14c0-tmp-dir\") pod \"ipp-route-173324-kserve-6cd9f57995-6rxf2\" (UID: \"41cbe8ba-7600-4e0d-9227-0491539f14c0\") " pod="ai-tenant-e2e-ipp-a-173324/ipp-route-173324-kserve-6cd9f57995-6rxf2"
Sep 15 11:57:03.133509 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:03.133368    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41cbe8ba-7600-4e0d-9227-0491539f14c0-tls-certs\") pod \"ipp-route-173324-kserve-6cd9f57995-6rxf2\" (UID: \"41cbe8ba-7600-4e0d-9227-0491539f14c0\") " pod="ai-tenant-e2e-ipp-a-173324/ipp-route-173324-kserve-6cd9f57995-6rxf2"
Sep 15 11:57:03.133509 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:03.133401    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41cbe8ba-7600-4e0d-9227-0491539f14c0-home\") pod \"ipp-route-173324-kserve-6cd9f57995-6rxf2\" (UID: \"41cbe8ba-7600-4e0d-9227-0491539f14c0\") " pod="ai-tenant-e2e-ipp-a-173324/ipp-route-173324-kserve-6cd9f57995-6rxf2"
Sep 15 11:57:03.133509 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:03.133452    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41cbe8ba-7600-4e0d-9227-0491539f14c0-dshm\") pod \"ipp-route-173324-kserve-6cd9f57995-6rxf2\" (UID: \"41cbe8ba-7600-4e0d-9227-0491539f14c0\") " pod="ai-tenant-e2e-ipp-a-173324/ipp-route-173324-kserve-6cd9f57995-6rxf2"
Sep 15 11:57:03.133828 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:03.133768    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41cbe8ba-7600-4e0d-9227-0491539f14c0-model-cache\") pod \"ipp-route-173324-kserve-6cd9f57995-6rxf2\" (UID: \"41cbe8ba-7600-4e0d-9227-0491539f14c0\") " pod="ai-tenant-e2e-ipp-a-173324/ipp-route-173324-kserve-6cd9f57995-6rxf2"
Sep 15 11:57:03.133828 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:03.133796    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41cbe8ba-7600-4e0d-9227-0491539f14c0-tmp-dir\") pod \"ipp-route-173324-kserve-6cd9f57995-6rxf2\" (UID: \"41cbe8ba-7600-4e0d-9227-0491539f14c0\") " pod="ai-tenant-e2e-ipp-a-173324/ipp-route-173324-kserve-6cd9f57995-6rxf2"
Sep 15 11:57:03.133941 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:03.133844    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41cbe8ba-7600-4e0d-9227-0491539f14c0-home\") pod \"ipp-route-173324-kserve-6cd9f57995-6rxf2\" (UID: \"41cbe8ba-7600-4e0d-9227-0491539f14c0\") " pod="ai-tenant-e2e-ipp-a-173324/ipp-route-173324-kserve-6cd9f57995-6rxf2"
Sep 15 11:57:03.135873 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:03.135847    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41cbe8ba-7600-4e0d-9227-0491539f14c0-dshm\") pod \"ipp-route-173324-kserve-6cd9f57995-6rxf2\" (UID: \"41cbe8ba-7600-4e0d-9227-0491539f14c0\") " pod="ai-tenant-e2e-ipp-a-173324/ipp-route-173324-kserve-6cd9f57995-6rxf2"
Sep 15 11:57:03.136142 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:03.136123    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41cbe8ba-7600-4e0d-9227-0491539f14c0-tls-certs\") pod \"ipp-route-173324-kserve-6cd9f57995-6rxf2\" (UID: \"41cbe8ba-7600-4e0d-9227-0491539f14c0\") " pod="ai-tenant-e2e-ipp-a-173324/ipp-route-173324-kserve-6cd9f57995-6rxf2"
Sep 15 11:57:03.142698 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:03.142650    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vms5h\" (UniqueName: \"kubernetes.io/projected/41cbe8ba-7600-4e0d-9227-0491539f14c0-kube-api-access-vms5h\") pod \"ipp-route-173324-kserve-6cd9f57995-6rxf2\" (UID: \"41cbe8ba-7600-4e0d-9227-0491539f14c0\") " pod="ai-tenant-e2e-ipp-a-173324/ipp-route-173324-kserve-6cd9f57995-6rxf2"
Sep 15 11:57:03.260985 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:03.260884    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-173324/ipp-route-173324-kserve-6cd9f57995-6rxf2"
Sep 15 11:57:03.538304 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:03.538269    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-173324/ipp-route-173324-kserve-6cd9f57995-6rxf2"]
Sep 15 11:57:03.539936 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:57:03.539901    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod41cbe8ba_7600_4e0d_9227_0491539f14c0.slice/crio-15b56e159b8ce73519795db8bf5c06d63ad0203fd175d63f110bee73bdd67ea1 WatchSource:0}: Error finding container 15b56e159b8ce73519795db8bf5c06d63ad0203fd175d63f110bee73bdd67ea1: Status 404 returned error can't find the container with id 15b56e159b8ce73519795db8bf5c06d63ad0203fd175d63f110bee73bdd67ea1
Sep 15 11:57:04.115122 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:04.115081    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-173324/ipp-route-173324-kserve-6cd9f57995-6rxf2" event={"ID":"41cbe8ba-7600-4e0d-9227-0491539f14c0","Type":"ContainerStarted","Data":"18af133947666bada55a498a41dbf0887f28b1e2176c57e99d73b3ce94f14b8c"}
Sep 15 11:57:04.115122 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:04.115126    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-173324/ipp-route-173324-kserve-6cd9f57995-6rxf2" event={"ID":"41cbe8ba-7600-4e0d-9227-0491539f14c0","Type":"ContainerStarted","Data":"15b56e159b8ce73519795db8bf5c06d63ad0203fd175d63f110bee73bdd67ea1"}
Sep 15 11:57:04.133026 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:04.132961    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-173324/ipp-route-173324-kserve-6cd9f57995-6rxf2" podStartSLOduration=2.1329415 podStartE2EDuration="2.1329415s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:57:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:57:04.132183488 +0000 UTC m=+1894.558514082" watchObservedRunningTime="2026-09-15 11:57:04.1329415 +0000 UTC m=+1894.559272095"
Sep 15 11:57:13.261232 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:13.261190    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-173324/ipp-route-173324-kserve-6cd9f57995-6rxf2"
Sep 15 11:57:13.261716 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:13.261251    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-173324/ipp-route-173324-kserve-6cd9f57995-6rxf2"
Sep 15 11:57:13.274641 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:13.274608    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-173324/ipp-route-173324-kserve-6cd9f57995-6rxf2"
Sep 15 11:57:14.195750 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:14.195718    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-173324/ipp-route-173324-kserve-6cd9f57995-6rxf2"
Sep 15 11:57:35.461844 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:35.461806    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-bp6jm_0f637e00-1499-422e-8d72-e7a5504bac92/payload-processing/0.log"
Sep 15 11:57:42.276106 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:42.276052    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1e87f5-bf99569c-jmw7f"]
Sep 15 11:57:42.281249 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:42.281216    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1e87f5-bf99569c-jmw7f"
Sep 15 11:57:42.283420 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:42.283393    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-1e87f5-serving-cert\""
Sep 15 11:57:42.290669 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:42.289983    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1e87f5-bf99569c-jmw7f"]
Sep 15 11:57:42.445617 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:42.445587    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccc936f6-4114-4d4e-ba38-2d7bb8002628-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-1e87f5-bf99569c-jmw7f\" (UID: \"ccc936f6-4114-4d4e-ba38-2d7bb8002628\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1e87f5-bf99569c-jmw7f"
Sep 15 11:57:42.445866 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:42.445675    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccc936f6-4114-4d4e-ba38-2d7bb8002628-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-1e87f5-bf99569c-jmw7f\" (UID: \"ccc936f6-4114-4d4e-ba38-2d7bb8002628\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1e87f5-bf99569c-jmw7f"
Sep 15 11:57:42.445866 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:42.445752    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccc936f6-4114-4d4e-ba38-2d7bb8002628-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-1e87f5-bf99569c-jmw7f\" (UID: \"ccc936f6-4114-4d4e-ba38-2d7bb8002628\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1e87f5-bf99569c-jmw7f"
Sep 15 11:57:42.445866 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:42.445780    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42snm\" (UniqueName: \"kubernetes.io/projected/ccc936f6-4114-4d4e-ba38-2d7bb8002628-kube-api-access-42snm\") pod \"maas-api-e2e-ipp-cleanup-1e87f5-bf99569c-jmw7f\" (UID: \"ccc936f6-4114-4d4e-ba38-2d7bb8002628\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1e87f5-bf99569c-jmw7f"
Sep 15 11:57:42.546833 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:42.546729    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccc936f6-4114-4d4e-ba38-2d7bb8002628-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-1e87f5-bf99569c-jmw7f\" (UID: \"ccc936f6-4114-4d4e-ba38-2d7bb8002628\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1e87f5-bf99569c-jmw7f"
Sep 15 11:57:42.546833 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:42.546825    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccc936f6-4114-4d4e-ba38-2d7bb8002628-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-1e87f5-bf99569c-jmw7f\" (UID: \"ccc936f6-4114-4d4e-ba38-2d7bb8002628\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1e87f5-bf99569c-jmw7f"
Sep 15 11:57:42.547068 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:42.546851    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42snm\" (UniqueName: \"kubernetes.io/projected/ccc936f6-4114-4d4e-ba38-2d7bb8002628-kube-api-access-42snm\") pod \"maas-api-e2e-ipp-cleanup-1e87f5-bf99569c-jmw7f\" (UID: \"ccc936f6-4114-4d4e-ba38-2d7bb8002628\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1e87f5-bf99569c-jmw7f"
Sep 15 11:57:42.547068 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:42.546930    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccc936f6-4114-4d4e-ba38-2d7bb8002628-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-1e87f5-bf99569c-jmw7f\" (UID: \"ccc936f6-4114-4d4e-ba38-2d7bb8002628\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1e87f5-bf99569c-jmw7f"
Sep 15 11:57:42.547415 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:42.547390    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccc936f6-4114-4d4e-ba38-2d7bb8002628-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-1e87f5-bf99569c-jmw7f\" (UID: \"ccc936f6-4114-4d4e-ba38-2d7bb8002628\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1e87f5-bf99569c-jmw7f"
Sep 15 11:57:42.549405 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:42.549383    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccc936f6-4114-4d4e-ba38-2d7bb8002628-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-1e87f5-bf99569c-jmw7f\" (UID: \"ccc936f6-4114-4d4e-ba38-2d7bb8002628\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1e87f5-bf99569c-jmw7f"
Sep 15 11:57:42.549565 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:42.549544    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccc936f6-4114-4d4e-ba38-2d7bb8002628-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-1e87f5-bf99569c-jmw7f\" (UID: \"ccc936f6-4114-4d4e-ba38-2d7bb8002628\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1e87f5-bf99569c-jmw7f"
Sep 15 11:57:42.554783 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:42.554758    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42snm\" (UniqueName: \"kubernetes.io/projected/ccc936f6-4114-4d4e-ba38-2d7bb8002628-kube-api-access-42snm\") pod \"maas-api-e2e-ipp-cleanup-1e87f5-bf99569c-jmw7f\" (UID: \"ccc936f6-4114-4d4e-ba38-2d7bb8002628\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1e87f5-bf99569c-jmw7f"
Sep 15 11:57:42.597422 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:42.597381    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1e87f5-bf99569c-jmw7f"
Sep 15 11:57:42.880253 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:42.880217    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1e87f5-bf99569c-jmw7f"]
Sep 15 11:57:42.881471 ip-10-0-132-240 kubenswrapper[2575]: W0915 11:57:42.881442    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccc936f6_4114_4d4e_ba38_2d7bb8002628.slice/crio-4573c70de44f2d7de700d58bd495f2b88bf0befee65f46d55fe097e34c3f8b54 WatchSource:0}: Error finding container 4573c70de44f2d7de700d58bd495f2b88bf0befee65f46d55fe097e34c3f8b54: Status 404 returned error can't find the container with id 4573c70de44f2d7de700d58bd495f2b88bf0befee65f46d55fe097e34c3f8b54
Sep 15 11:57:43.360484 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:43.360445    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1e87f5-bf99569c-jmw7f" event={"ID":"ccc936f6-4114-4d4e-ba38-2d7bb8002628","Type":"ContainerStarted","Data":"3df44c5378d4b5c63442bc1b20f56d39e550e178b957497a2fee3de03ee9df37"}
Sep 15 11:57:43.360938 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:43.360503    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1e87f5-bf99569c-jmw7f" event={"ID":"ccc936f6-4114-4d4e-ba38-2d7bb8002628","Type":"ContainerStarted","Data":"4573c70de44f2d7de700d58bd495f2b88bf0befee65f46d55fe097e34c3f8b54"}
Sep 15 11:57:43.360938 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:43.360554    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1e87f5-bf99569c-jmw7f"
Sep 15 11:57:43.380365 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:43.380302    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1e87f5-bf99569c-jmw7f" podStartSLOduration=0.999440936 podStartE2EDuration="1.380281908s" totalImagesPullingTime="380.840972ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:57:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:57:43.377144767 +0000 UTC m=+1933.803475364" watchObservedRunningTime="2026-09-15 11:57:43.380281908 +0000 UTC m=+1933.806612503"
Sep 15 11:57:49.372287 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:57:49.372245    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1e87f5-bf99569c-jmw7f"
Sep 15 11:58:20.801694 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:20.801633    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1e87f5-bf99569c-jmw7f"]
Sep 15 11:58:20.802344 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:20.801920    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1e87f5-bf99569c-jmw7f" podUID="ccc936f6-4114-4d4e-ba38-2d7bb8002628" containerName="maas-api" containerID="cri-o://3df44c5378d4b5c63442bc1b20f56d39e550e178b957497a2fee3de03ee9df37" gracePeriod=30
Sep 15 11:58:21.054509 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:21.054436    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1e87f5-bf99569c-jmw7f"
Sep 15 11:58:21.143721 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:21.143686    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccc936f6-4114-4d4e-ba38-2d7bb8002628-metrics-certs\") pod \"ccc936f6-4114-4d4e-ba38-2d7bb8002628\" (UID: \"ccc936f6-4114-4d4e-ba38-2d7bb8002628\") "
Sep 15 11:58:21.143899 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:21.143814    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccc936f6-4114-4d4e-ba38-2d7bb8002628-openshift-service-ca\") pod \"ccc936f6-4114-4d4e-ba38-2d7bb8002628\" (UID: \"ccc936f6-4114-4d4e-ba38-2d7bb8002628\") "
Sep 15 11:58:21.143899 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:21.143868    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccc936f6-4114-4d4e-ba38-2d7bb8002628-maas-api-tls\") pod \"ccc936f6-4114-4d4e-ba38-2d7bb8002628\" (UID: \"ccc936f6-4114-4d4e-ba38-2d7bb8002628\") "
Sep 15 11:58:21.143899 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:21.143898    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42snm\" (UniqueName: \"kubernetes.io/projected/ccc936f6-4114-4d4e-ba38-2d7bb8002628-kube-api-access-42snm\") pod \"ccc936f6-4114-4d4e-ba38-2d7bb8002628\" (UID: \"ccc936f6-4114-4d4e-ba38-2d7bb8002628\") "
Sep 15 11:58:21.144208 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:21.144173    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccc936f6-4114-4d4e-ba38-2d7bb8002628-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ccc936f6-4114-4d4e-ba38-2d7bb8002628" (UID: "ccc936f6-4114-4d4e-ba38-2d7bb8002628"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:58:21.145871 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:21.145827    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccc936f6-4114-4d4e-ba38-2d7bb8002628-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ccc936f6-4114-4d4e-ba38-2d7bb8002628" (UID: "ccc936f6-4114-4d4e-ba38-2d7bb8002628"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:58:21.145991 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:21.145920    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccc936f6-4114-4d4e-ba38-2d7bb8002628-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ccc936f6-4114-4d4e-ba38-2d7bb8002628" (UID: "ccc936f6-4114-4d4e-ba38-2d7bb8002628"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:58:21.146044 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:21.146011    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccc936f6-4114-4d4e-ba38-2d7bb8002628-kube-api-access-42snm" (OuterVolumeSpecName: "kube-api-access-42snm") pod "ccc936f6-4114-4d4e-ba38-2d7bb8002628" (UID: "ccc936f6-4114-4d4e-ba38-2d7bb8002628"). InnerVolumeSpecName "kube-api-access-42snm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:58:21.244916 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:21.244871    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccc936f6-4114-4d4e-ba38-2d7bb8002628-metrics-certs\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:58:21.244916 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:21.244910    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccc936f6-4114-4d4e-ba38-2d7bb8002628-openshift-service-ca\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:58:21.245154 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:21.244935    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccc936f6-4114-4d4e-ba38-2d7bb8002628-maas-api-tls\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:58:21.245154 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:21.244944    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42snm\" (UniqueName: \"kubernetes.io/projected/ccc936f6-4114-4d4e-ba38-2d7bb8002628-kube-api-access-42snm\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:58:21.591445 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:21.591402    2575 generic.go:356] "Generic (PLEG): container finished" podID="ccc936f6-4114-4d4e-ba38-2d7bb8002628" containerID="3df44c5378d4b5c63442bc1b20f56d39e550e178b957497a2fee3de03ee9df37" exitCode=0
Sep 15 11:58:21.591643 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:21.591456    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1e87f5-bf99569c-jmw7f"
Sep 15 11:58:21.591643 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:21.591484    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1e87f5-bf99569c-jmw7f" event={"ID":"ccc936f6-4114-4d4e-ba38-2d7bb8002628","Type":"ContainerDied","Data":"3df44c5378d4b5c63442bc1b20f56d39e550e178b957497a2fee3de03ee9df37"}
Sep 15 11:58:21.591643 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:21.591540    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1e87f5-bf99569c-jmw7f" event={"ID":"ccc936f6-4114-4d4e-ba38-2d7bb8002628","Type":"ContainerDied","Data":"4573c70de44f2d7de700d58bd495f2b88bf0befee65f46d55fe097e34c3f8b54"}
Sep 15 11:58:21.591643 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:21.591567    2575 scope.go:117] "RemoveContainer" containerID="3df44c5378d4b5c63442bc1b20f56d39e550e178b957497a2fee3de03ee9df37"
Sep 15 11:58:21.602481 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:21.602457    2575 scope.go:117] "RemoveContainer" containerID="3df44c5378d4b5c63442bc1b20f56d39e550e178b957497a2fee3de03ee9df37"
Sep 15 11:58:21.602895 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:58:21.602874    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3df44c5378d4b5c63442bc1b20f56d39e550e178b957497a2fee3de03ee9df37\": container with ID starting with 3df44c5378d4b5c63442bc1b20f56d39e550e178b957497a2fee3de03ee9df37 not found: ID does not exist" containerID="3df44c5378d4b5c63442bc1b20f56d39e550e178b957497a2fee3de03ee9df37"
Sep 15 11:58:21.602949 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:21.602906    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3df44c5378d4b5c63442bc1b20f56d39e550e178b957497a2fee3de03ee9df37"} err="failed to get container status \"3df44c5378d4b5c63442bc1b20f56d39e550e178b957497a2fee3de03ee9df37\": rpc error: code = NotFound desc = could not find container \"3df44c5378d4b5c63442bc1b20f56d39e550e178b957497a2fee3de03ee9df37\": container with ID starting with 3df44c5378d4b5c63442bc1b20f56d39e550e178b957497a2fee3de03ee9df37 not found: ID does not exist"
Sep 15 11:58:21.615266 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:21.615227    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1e87f5-bf99569c-jmw7f"]
Sep 15 11:58:21.621185 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:21.621140    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1e87f5-bf99569c-jmw7f"]
Sep 15 11:58:22.093777 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:22.093742    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccc936f6-4114-4d4e-ba38-2d7bb8002628" path="/var/lib/kubelet/pods/ccc936f6-4114-4d4e-ba38-2d7bb8002628/volumes"
Sep 15 11:58:46.257173 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:46.257133    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-173324-58bfd9448d-fcw5j"]
Sep 15 11:58:46.257566 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:46.257357    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-173324-58bfd9448d-fcw5j" podUID="cbf8c075-623d-4f74-a4b4-30101b7da411" containerName="maas-api" containerID="cri-o://cad4e5672ba70802d38815248c7c5ad783a4961ce2044e10e431ad0de05733a6" gracePeriod=30
Sep 15 11:58:46.525445 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:46.525414    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-173324-58bfd9448d-fcw5j"
Sep 15 11:58:46.610811 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:46.610777    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbf8c075-623d-4f74-a4b4-30101b7da411-maas-api-tls\") pod \"cbf8c075-623d-4f74-a4b4-30101b7da411\" (UID: \"cbf8c075-623d-4f74-a4b4-30101b7da411\") "
Sep 15 11:58:46.611028 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:46.610909    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82nhr\" (UniqueName: \"kubernetes.io/projected/cbf8c075-623d-4f74-a4b4-30101b7da411-kube-api-access-82nhr\") pod \"cbf8c075-623d-4f74-a4b4-30101b7da411\" (UID: \"cbf8c075-623d-4f74-a4b4-30101b7da411\") "
Sep 15 11:58:46.611028 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:46.610937    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbf8c075-623d-4f74-a4b4-30101b7da411-openshift-service-ca\") pod \"cbf8c075-623d-4f74-a4b4-30101b7da411\" (UID: \"cbf8c075-623d-4f74-a4b4-30101b7da411\") "
Sep 15 11:58:46.611028 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:46.610998    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbf8c075-623d-4f74-a4b4-30101b7da411-metrics-certs\") pod \"cbf8c075-623d-4f74-a4b4-30101b7da411\" (UID: \"cbf8c075-623d-4f74-a4b4-30101b7da411\") "
Sep 15 11:58:46.611437 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:46.611402    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbf8c075-623d-4f74-a4b4-30101b7da411-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cbf8c075-623d-4f74-a4b4-30101b7da411" (UID: "cbf8c075-623d-4f74-a4b4-30101b7da411"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:58:46.613418 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:46.613381    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbf8c075-623d-4f74-a4b4-30101b7da411-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "cbf8c075-623d-4f74-a4b4-30101b7da411" (UID: "cbf8c075-623d-4f74-a4b4-30101b7da411"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:58:46.613582 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:46.613557    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbf8c075-623d-4f74-a4b4-30101b7da411-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cbf8c075-623d-4f74-a4b4-30101b7da411" (UID: "cbf8c075-623d-4f74-a4b4-30101b7da411"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:58:46.613642 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:46.613577    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbf8c075-623d-4f74-a4b4-30101b7da411-kube-api-access-82nhr" (OuterVolumeSpecName: "kube-api-access-82nhr") pod "cbf8c075-623d-4f74-a4b4-30101b7da411" (UID: "cbf8c075-623d-4f74-a4b4-30101b7da411"). InnerVolumeSpecName "kube-api-access-82nhr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:58:46.712586 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:46.712542    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbf8c075-623d-4f74-a4b4-30101b7da411-maas-api-tls\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:58:46.712586 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:46.712578    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82nhr\" (UniqueName: \"kubernetes.io/projected/cbf8c075-623d-4f74-a4b4-30101b7da411-kube-api-access-82nhr\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:58:46.712586 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:46.712589    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbf8c075-623d-4f74-a4b4-30101b7da411-openshift-service-ca\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:58:46.712586 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:46.712600    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbf8c075-623d-4f74-a4b4-30101b7da411-metrics-certs\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:58:46.752106 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:46.752073    2575 generic.go:356] "Generic (PLEG): container finished" podID="cbf8c075-623d-4f74-a4b4-30101b7da411" containerID="cad4e5672ba70802d38815248c7c5ad783a4961ce2044e10e431ad0de05733a6" exitCode=0
Sep 15 11:58:46.752273 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:46.752125    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-173324-58bfd9448d-fcw5j"
Sep 15 11:58:46.752273 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:46.752160    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-173324-58bfd9448d-fcw5j" event={"ID":"cbf8c075-623d-4f74-a4b4-30101b7da411","Type":"ContainerDied","Data":"cad4e5672ba70802d38815248c7c5ad783a4961ce2044e10e431ad0de05733a6"}
Sep 15 11:58:46.752273 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:46.752218    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-173324-58bfd9448d-fcw5j" event={"ID":"cbf8c075-623d-4f74-a4b4-30101b7da411","Type":"ContainerDied","Data":"0ff6c2926d62a499e0ed08f59081da3385c5cdf67b8f5f9932a343d667949556"}
Sep 15 11:58:46.752273 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:46.752250    2575 scope.go:117] "RemoveContainer" containerID="cad4e5672ba70802d38815248c7c5ad783a4961ce2044e10e431ad0de05733a6"
Sep 15 11:58:46.763110 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:46.763087    2575 scope.go:117] "RemoveContainer" containerID="cad4e5672ba70802d38815248c7c5ad783a4961ce2044e10e431ad0de05733a6"
Sep 15 11:58:46.763451 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:58:46.763432    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cad4e5672ba70802d38815248c7c5ad783a4961ce2044e10e431ad0de05733a6\": container with ID starting with cad4e5672ba70802d38815248c7c5ad783a4961ce2044e10e431ad0de05733a6 not found: ID does not exist" containerID="cad4e5672ba70802d38815248c7c5ad783a4961ce2044e10e431ad0de05733a6"
Sep 15 11:58:46.763558 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:46.763460    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cad4e5672ba70802d38815248c7c5ad783a4961ce2044e10e431ad0de05733a6"} err="failed to get container status \"cad4e5672ba70802d38815248c7c5ad783a4961ce2044e10e431ad0de05733a6\": rpc error: code = NotFound desc = could not find container \"cad4e5672ba70802d38815248c7c5ad783a4961ce2044e10e431ad0de05733a6\": container with ID starting with cad4e5672ba70802d38815248c7c5ad783a4961ce2044e10e431ad0de05733a6 not found: ID does not exist"
Sep 15 11:58:46.775624 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:46.775583    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-173324-58bfd9448d-fcw5j"]
Sep 15 11:58:46.778712 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:46.778680    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-173324-58bfd9448d-fcw5j"]
Sep 15 11:58:48.094407 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:48.094368    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbf8c075-623d-4f74-a4b4-30101b7da411" path="/var/lib/kubelet/pods/cbf8c075-623d-4f74-a4b4-30101b7da411/volumes"
Sep 15 11:58:51.833849 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:58:51.833811    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-173324/ipp-route-173324-kserve-6cd9f57995-6rxf2"]
Sep 15 11:59:06.854190 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:59:06.854124    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-173324/ipp-route-173324-kserve-6cd9f57995-6rxf2" podUID="41cbe8ba-7600-4e0d-9227-0491539f14c0" containerName="main" containerID="cri-o://18af133947666bada55a498a41dbf0887f28b1e2176c57e99d73b3ce94f14b8c" gracePeriod=45
Sep 15 11:59:07.115386 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:59:07.115305    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-173324/ipp-route-173324-kserve-6cd9f57995-6rxf2"
Sep 15 11:59:07.218595 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:59:07.218547    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41cbe8ba-7600-4e0d-9227-0491539f14c0-home\") pod \"41cbe8ba-7600-4e0d-9227-0491539f14c0\" (UID: \"41cbe8ba-7600-4e0d-9227-0491539f14c0\") "
Sep 15 11:59:07.218595 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:59:07.218604    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vms5h\" (UniqueName: \"kubernetes.io/projected/41cbe8ba-7600-4e0d-9227-0491539f14c0-kube-api-access-vms5h\") pod \"41cbe8ba-7600-4e0d-9227-0491539f14c0\" (UID: \"41cbe8ba-7600-4e0d-9227-0491539f14c0\") "
Sep 15 11:59:07.218886 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:59:07.218635    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41cbe8ba-7600-4e0d-9227-0491539f14c0-model-cache\") pod \"41cbe8ba-7600-4e0d-9227-0491539f14c0\" (UID: \"41cbe8ba-7600-4e0d-9227-0491539f14c0\") "
Sep 15 11:59:07.218886 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:59:07.218702    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41cbe8ba-7600-4e0d-9227-0491539f14c0-dshm\") pod \"41cbe8ba-7600-4e0d-9227-0491539f14c0\" (UID: \"41cbe8ba-7600-4e0d-9227-0491539f14c0\") "
Sep 15 11:59:07.218886 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:59:07.218731    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41cbe8ba-7600-4e0d-9227-0491539f14c0-tmp-dir\") pod \"41cbe8ba-7600-4e0d-9227-0491539f14c0\" (UID: \"41cbe8ba-7600-4e0d-9227-0491539f14c0\") "
Sep 15 11:59:07.218886 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:59:07.218763    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41cbe8ba-7600-4e0d-9227-0491539f14c0-tls-certs\") pod \"41cbe8ba-7600-4e0d-9227-0491539f14c0\" (UID: \"41cbe8ba-7600-4e0d-9227-0491539f14c0\") "
Sep 15 11:59:07.219092 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:59:07.218955    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41cbe8ba-7600-4e0d-9227-0491539f14c0-home" (OuterVolumeSpecName: "home") pod "41cbe8ba-7600-4e0d-9227-0491539f14c0" (UID: "41cbe8ba-7600-4e0d-9227-0491539f14c0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:59:07.219092 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:59:07.218985    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41cbe8ba-7600-4e0d-9227-0491539f14c0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "41cbe8ba-7600-4e0d-9227-0491539f14c0" (UID: "41cbe8ba-7600-4e0d-9227-0491539f14c0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:59:07.219092 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:59:07.218999    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41cbe8ba-7600-4e0d-9227-0491539f14c0-model-cache" (OuterVolumeSpecName: "model-cache") pod "41cbe8ba-7600-4e0d-9227-0491539f14c0" (UID: "41cbe8ba-7600-4e0d-9227-0491539f14c0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:59:07.219262 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:59:07.219158    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41cbe8ba-7600-4e0d-9227-0491539f14c0-home\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:59:07.219262 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:59:07.219173    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41cbe8ba-7600-4e0d-9227-0491539f14c0-model-cache\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:59:07.219262 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:59:07.219184    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41cbe8ba-7600-4e0d-9227-0491539f14c0-tmp-dir\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:59:07.221159 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:59:07.221129    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41cbe8ba-7600-4e0d-9227-0491539f14c0-dshm" (OuterVolumeSpecName: "dshm") pod "41cbe8ba-7600-4e0d-9227-0491539f14c0" (UID: "41cbe8ba-7600-4e0d-9227-0491539f14c0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:59:07.221159 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:59:07.221140    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41cbe8ba-7600-4e0d-9227-0491539f14c0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "41cbe8ba-7600-4e0d-9227-0491539f14c0" (UID: "41cbe8ba-7600-4e0d-9227-0491539f14c0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:59:07.221159 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:59:07.221156    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41cbe8ba-7600-4e0d-9227-0491539f14c0-kube-api-access-vms5h" (OuterVolumeSpecName: "kube-api-access-vms5h") pod "41cbe8ba-7600-4e0d-9227-0491539f14c0" (UID: "41cbe8ba-7600-4e0d-9227-0491539f14c0"). InnerVolumeSpecName "kube-api-access-vms5h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:59:07.320444 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:59:07.320407    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vms5h\" (UniqueName: \"kubernetes.io/projected/41cbe8ba-7600-4e0d-9227-0491539f14c0-kube-api-access-vms5h\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:59:07.320444 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:59:07.320439    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41cbe8ba-7600-4e0d-9227-0491539f14c0-dshm\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:59:07.320444 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:59:07.320450    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41cbe8ba-7600-4e0d-9227-0491539f14c0-tls-certs\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 11:59:07.884982 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:59:07.884943    2575 generic.go:356] "Generic (PLEG): container finished" podID="41cbe8ba-7600-4e0d-9227-0491539f14c0" containerID="18af133947666bada55a498a41dbf0887f28b1e2176c57e99d73b3ce94f14b8c" exitCode=0
Sep 15 11:59:07.884982 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:59:07.884989    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-173324/ipp-route-173324-kserve-6cd9f57995-6rxf2" event={"ID":"41cbe8ba-7600-4e0d-9227-0491539f14c0","Type":"ContainerDied","Data":"18af133947666bada55a498a41dbf0887f28b1e2176c57e99d73b3ce94f14b8c"}
Sep 15 11:59:07.885572 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:59:07.885005    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-173324/ipp-route-173324-kserve-6cd9f57995-6rxf2"
Sep 15 11:59:07.885572 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:59:07.885021    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-173324/ipp-route-173324-kserve-6cd9f57995-6rxf2" event={"ID":"41cbe8ba-7600-4e0d-9227-0491539f14c0","Type":"ContainerDied","Data":"15b56e159b8ce73519795db8bf5c06d63ad0203fd175d63f110bee73bdd67ea1"}
Sep 15 11:59:07.885572 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:59:07.885038    2575 scope.go:117] "RemoveContainer" containerID="18af133947666bada55a498a41dbf0887f28b1e2176c57e99d73b3ce94f14b8c"
Sep 15 11:59:07.896088 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:59:07.896056    2575 scope.go:117] "RemoveContainer" containerID="18af133947666bada55a498a41dbf0887f28b1e2176c57e99d73b3ce94f14b8c"
Sep 15 11:59:07.896491 ip-10-0-132-240 kubenswrapper[2575]: E0915 11:59:07.896468    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18af133947666bada55a498a41dbf0887f28b1e2176c57e99d73b3ce94f14b8c\": container with ID starting with 18af133947666bada55a498a41dbf0887f28b1e2176c57e99d73b3ce94f14b8c not found: ID does not exist" containerID="18af133947666bada55a498a41dbf0887f28b1e2176c57e99d73b3ce94f14b8c"
Sep 15 11:59:07.896562 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:59:07.896501    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18af133947666bada55a498a41dbf0887f28b1e2176c57e99d73b3ce94f14b8c"} err="failed to get container status \"18af133947666bada55a498a41dbf0887f28b1e2176c57e99d73b3ce94f14b8c\": rpc error: code = NotFound desc = could not find container \"18af133947666bada55a498a41dbf0887f28b1e2176c57e99d73b3ce94f14b8c\": container with ID starting with 18af133947666bada55a498a41dbf0887f28b1e2176c57e99d73b3ce94f14b8c not found: ID does not exist"
Sep 15 11:59:07.906979 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:59:07.906944    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-173324/ipp-route-173324-kserve-6cd9f57995-6rxf2"]
Sep 15 11:59:07.912524 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:59:07.912489    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-173324/ipp-route-173324-kserve-6cd9f57995-6rxf2"]
Sep 15 11:59:08.094049 ip-10-0-132-240 kubenswrapper[2575]: I0915 11:59:08.094013    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41cbe8ba-7600-4e0d-9227-0491539f14c0" path="/var/lib/kubelet/pods/41cbe8ba-7600-4e0d-9227-0491539f14c0/volumes"
Sep 15 12:00:03.650670 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:03.650563    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7efa8b-74876948c6-4sq64"]
Sep 15 12:00:03.652879 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:03.650826    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7efa8b-74876948c6-4sq64" podUID="b9b80036-c0e1-47e7-b06a-849ef1074f37" containerName="maas-api" containerID="cri-o://a2ea9ba6ffa47554cda8559c8b7b06c027e7465c7530d4da44aa1a1f52820271" gracePeriod=30
Sep 15 12:00:03.913042 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:03.912967    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7efa8b-74876948c6-4sq64"
Sep 15 12:00:03.980889 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:03.980844    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9b80036-c0e1-47e7-b06a-849ef1074f37-metrics-certs\") pod \"b9b80036-c0e1-47e7-b06a-849ef1074f37\" (UID: \"b9b80036-c0e1-47e7-b06a-849ef1074f37\") "
Sep 15 12:00:03.981072 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:03.980991    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9b80036-c0e1-47e7-b06a-849ef1074f37-openshift-service-ca\") pod \"b9b80036-c0e1-47e7-b06a-849ef1074f37\" (UID: \"b9b80036-c0e1-47e7-b06a-849ef1074f37\") "
Sep 15 12:00:03.981072 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:03.981028    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n69rq\" (UniqueName: \"kubernetes.io/projected/b9b80036-c0e1-47e7-b06a-849ef1074f37-kube-api-access-n69rq\") pod \"b9b80036-c0e1-47e7-b06a-849ef1074f37\" (UID: \"b9b80036-c0e1-47e7-b06a-849ef1074f37\") "
Sep 15 12:00:03.981072 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:03.981048    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9b80036-c0e1-47e7-b06a-849ef1074f37-maas-api-tls\") pod \"b9b80036-c0e1-47e7-b06a-849ef1074f37\" (UID: \"b9b80036-c0e1-47e7-b06a-849ef1074f37\") "
Sep 15 12:00:03.981375 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:03.981343    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9b80036-c0e1-47e7-b06a-849ef1074f37-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b9b80036-c0e1-47e7-b06a-849ef1074f37" (UID: "b9b80036-c0e1-47e7-b06a-849ef1074f37"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:00:03.981522 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:03.981475    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9b80036-c0e1-47e7-b06a-849ef1074f37-openshift-service-ca\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 12:00:03.983211 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:03.983174    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9b80036-c0e1-47e7-b06a-849ef1074f37-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b9b80036-c0e1-47e7-b06a-849ef1074f37" (UID: "b9b80036-c0e1-47e7-b06a-849ef1074f37"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:00:03.983345 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:03.983233    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9b80036-c0e1-47e7-b06a-849ef1074f37-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b9b80036-c0e1-47e7-b06a-849ef1074f37" (UID: "b9b80036-c0e1-47e7-b06a-849ef1074f37"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:00:03.983345 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:03.983285    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9b80036-c0e1-47e7-b06a-849ef1074f37-kube-api-access-n69rq" (OuterVolumeSpecName: "kube-api-access-n69rq") pod "b9b80036-c0e1-47e7-b06a-849ef1074f37" (UID: "b9b80036-c0e1-47e7-b06a-849ef1074f37"). InnerVolumeSpecName "kube-api-access-n69rq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:00:04.082811 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:04.082767    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9b80036-c0e1-47e7-b06a-849ef1074f37-metrics-certs\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 12:00:04.082811 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:04.082805    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n69rq\" (UniqueName: \"kubernetes.io/projected/b9b80036-c0e1-47e7-b06a-849ef1074f37-kube-api-access-n69rq\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 12:00:04.082811 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:04.082815    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9b80036-c0e1-47e7-b06a-849ef1074f37-maas-api-tls\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 12:00:04.224094 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:04.223993    2575 generic.go:356] "Generic (PLEG): container finished" podID="b9b80036-c0e1-47e7-b06a-849ef1074f37" containerID="a2ea9ba6ffa47554cda8559c8b7b06c027e7465c7530d4da44aa1a1f52820271" exitCode=0
Sep 15 12:00:04.224094 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:04.224044    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7efa8b-74876948c6-4sq64"
Sep 15 12:00:04.224317 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:04.224091    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7efa8b-74876948c6-4sq64" event={"ID":"b9b80036-c0e1-47e7-b06a-849ef1074f37","Type":"ContainerDied","Data":"a2ea9ba6ffa47554cda8559c8b7b06c027e7465c7530d4da44aa1a1f52820271"}
Sep 15 12:00:04.224317 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:04.224148    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7efa8b-74876948c6-4sq64" event={"ID":"b9b80036-c0e1-47e7-b06a-849ef1074f37","Type":"ContainerDied","Data":"ab6df2c15c104281ee77a7abc0d177d4a5ef881131c151d9b66a5571a0ec02dc"}
Sep 15 12:00:04.224317 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:04.224172    2575 scope.go:117] "RemoveContainer" containerID="a2ea9ba6ffa47554cda8559c8b7b06c027e7465c7530d4da44aa1a1f52820271"
Sep 15 12:00:04.233863 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:04.233841    2575 scope.go:117] "RemoveContainer" containerID="a2ea9ba6ffa47554cda8559c8b7b06c027e7465c7530d4da44aa1a1f52820271"
Sep 15 12:00:04.234207 ip-10-0-132-240 kubenswrapper[2575]: E0915 12:00:04.234182    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2ea9ba6ffa47554cda8559c8b7b06c027e7465c7530d4da44aa1a1f52820271\": container with ID starting with a2ea9ba6ffa47554cda8559c8b7b06c027e7465c7530d4da44aa1a1f52820271 not found: ID does not exist" containerID="a2ea9ba6ffa47554cda8559c8b7b06c027e7465c7530d4da44aa1a1f52820271"
Sep 15 12:00:04.234311 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:04.234223    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2ea9ba6ffa47554cda8559c8b7b06c027e7465c7530d4da44aa1a1f52820271"} err="failed to get container status \"a2ea9ba6ffa47554cda8559c8b7b06c027e7465c7530d4da44aa1a1f52820271\": rpc error: code = NotFound desc = could not find container \"a2ea9ba6ffa47554cda8559c8b7b06c027e7465c7530d4da44aa1a1f52820271\": container with ID starting with a2ea9ba6ffa47554cda8559c8b7b06c027e7465c7530d4da44aa1a1f52820271 not found: ID does not exist"
Sep 15 12:00:04.241203 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:04.241163    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7efa8b-74876948c6-4sq64"]
Sep 15 12:00:04.246145 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:04.246114    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7efa8b-74876948c6-4sq64"]
Sep 15 12:00:06.094106 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:06.094069    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9b80036-c0e1-47e7-b06a-849ef1074f37" path="/var/lib/kubelet/pods/b9b80036-c0e1-47e7-b06a-849ef1074f37/volumes"
Sep 15 12:00:21.237934 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:21.237892    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2cc790-f76d6d74-47wwt"]
Sep 15 12:00:21.238476 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:21.238188    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2cc790-f76d6d74-47wwt" podUID="70810daa-c6ab-4571-beb6-a363f6af32a5" containerName="maas-api" containerID="cri-o://12a72ce08559981850459b8f067b881b78425e5874177d265983b886455d5035" gracePeriod=30
Sep 15 12:00:21.491565 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:21.491464    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2cc790-f76d6d74-47wwt"
Sep 15 12:00:21.564980 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:21.564944    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70810daa-c6ab-4571-beb6-a363f6af32a5-metrics-certs\") pod \"70810daa-c6ab-4571-beb6-a363f6af32a5\" (UID: \"70810daa-c6ab-4571-beb6-a363f6af32a5\") "
Sep 15 12:00:21.565145 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:21.565001    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70810daa-c6ab-4571-beb6-a363f6af32a5-openshift-service-ca\") pod \"70810daa-c6ab-4571-beb6-a363f6af32a5\" (UID: \"70810daa-c6ab-4571-beb6-a363f6af32a5\") "
Sep 15 12:00:21.565145 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:21.565021    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c487h\" (UniqueName: \"kubernetes.io/projected/70810daa-c6ab-4571-beb6-a363f6af32a5-kube-api-access-c487h\") pod \"70810daa-c6ab-4571-beb6-a363f6af32a5\" (UID: \"70810daa-c6ab-4571-beb6-a363f6af32a5\") "
Sep 15 12:00:21.565145 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:21.565051    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70810daa-c6ab-4571-beb6-a363f6af32a5-maas-api-tls\") pod \"70810daa-c6ab-4571-beb6-a363f6af32a5\" (UID: \"70810daa-c6ab-4571-beb6-a363f6af32a5\") "
Sep 15 12:00:21.565455 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:21.565425    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70810daa-c6ab-4571-beb6-a363f6af32a5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "70810daa-c6ab-4571-beb6-a363f6af32a5" (UID: "70810daa-c6ab-4571-beb6-a363f6af32a5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:00:21.567259 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:21.567229    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70810daa-c6ab-4571-beb6-a363f6af32a5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "70810daa-c6ab-4571-beb6-a363f6af32a5" (UID: "70810daa-c6ab-4571-beb6-a363f6af32a5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:00:21.567395 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:21.567265    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70810daa-c6ab-4571-beb6-a363f6af32a5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "70810daa-c6ab-4571-beb6-a363f6af32a5" (UID: "70810daa-c6ab-4571-beb6-a363f6af32a5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:00:21.567395 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:21.567306    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70810daa-c6ab-4571-beb6-a363f6af32a5-kube-api-access-c487h" (OuterVolumeSpecName: "kube-api-access-c487h") pod "70810daa-c6ab-4571-beb6-a363f6af32a5" (UID: "70810daa-c6ab-4571-beb6-a363f6af32a5"). InnerVolumeSpecName "kube-api-access-c487h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:00:21.666426 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:21.666387    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70810daa-c6ab-4571-beb6-a363f6af32a5-openshift-service-ca\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 12:00:21.666426 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:21.666430    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c487h\" (UniqueName: \"kubernetes.io/projected/70810daa-c6ab-4571-beb6-a363f6af32a5-kube-api-access-c487h\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 12:00:21.666667 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:21.666454    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70810daa-c6ab-4571-beb6-a363f6af32a5-maas-api-tls\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 12:00:21.666667 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:21.666463    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70810daa-c6ab-4571-beb6-a363f6af32a5-metrics-certs\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 12:00:22.341966 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:22.341932    2575 generic.go:356] "Generic (PLEG): container finished" podID="70810daa-c6ab-4571-beb6-a363f6af32a5" containerID="12a72ce08559981850459b8f067b881b78425e5874177d265983b886455d5035" exitCode=0
Sep 15 12:00:22.342441 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:22.341977    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2cc790-f76d6d74-47wwt"
Sep 15 12:00:22.342441 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:22.342021    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2cc790-f76d6d74-47wwt" event={"ID":"70810daa-c6ab-4571-beb6-a363f6af32a5","Type":"ContainerDied","Data":"12a72ce08559981850459b8f067b881b78425e5874177d265983b886455d5035"}
Sep 15 12:00:22.342441 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:22.342087    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2cc790-f76d6d74-47wwt" event={"ID":"70810daa-c6ab-4571-beb6-a363f6af32a5","Type":"ContainerDied","Data":"5ccd459a263c7d71b3693ef4fec3cdd1013f03a353e5f7c5fcb687c6c8e73fff"}
Sep 15 12:00:22.342441 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:22.342124    2575 scope.go:117] "RemoveContainer" containerID="12a72ce08559981850459b8f067b881b78425e5874177d265983b886455d5035"
Sep 15 12:00:22.352442 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:22.352393    2575 scope.go:117] "RemoveContainer" containerID="12a72ce08559981850459b8f067b881b78425e5874177d265983b886455d5035"
Sep 15 12:00:22.352834 ip-10-0-132-240 kubenswrapper[2575]: E0915 12:00:22.352812    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12a72ce08559981850459b8f067b881b78425e5874177d265983b886455d5035\": container with ID starting with 12a72ce08559981850459b8f067b881b78425e5874177d265983b886455d5035 not found: ID does not exist" containerID="12a72ce08559981850459b8f067b881b78425e5874177d265983b886455d5035"
Sep 15 12:00:22.352904 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:22.352843    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12a72ce08559981850459b8f067b881b78425e5874177d265983b886455d5035"} err="failed to get container status \"12a72ce08559981850459b8f067b881b78425e5874177d265983b886455d5035\": rpc error: code = NotFound desc = could not find container \"12a72ce08559981850459b8f067b881b78425e5874177d265983b886455d5035\": container with ID starting with 12a72ce08559981850459b8f067b881b78425e5874177d265983b886455d5035 not found: ID does not exist"
Sep 15 12:00:22.359272 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:22.359234    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2cc790-f76d6d74-47wwt"]
Sep 15 12:00:22.363088 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:22.363053    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2cc790-f76d6d74-47wwt"]
Sep 15 12:00:24.095148 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:00:24.095107    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70810daa-c6ab-4571-beb6-a363f6af32a5" path="/var/lib/kubelet/pods/70810daa-c6ab-4571-beb6-a363f6af32a5/volumes"
Sep 15 12:05:16.448305 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:16.448258    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk"]
Sep 15 12:05:16.450938 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:16.448684    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccc936f6-4114-4d4e-ba38-2d7bb8002628" containerName="maas-api"
Sep 15 12:05:16.450938 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:16.448701    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccc936f6-4114-4d4e-ba38-2d7bb8002628" containerName="maas-api"
Sep 15 12:05:16.450938 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:16.448723    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41cbe8ba-7600-4e0d-9227-0491539f14c0" containerName="main"
Sep 15 12:05:16.450938 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:16.448729    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="41cbe8ba-7600-4e0d-9227-0491539f14c0" containerName="main"
Sep 15 12:05:16.450938 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:16.448742    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70810daa-c6ab-4571-beb6-a363f6af32a5" containerName="maas-api"
Sep 15 12:05:16.450938 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:16.448747    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="70810daa-c6ab-4571-beb6-a363f6af32a5" containerName="maas-api"
Sep 15 12:05:16.450938 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:16.448755    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbf8c075-623d-4f74-a4b4-30101b7da411" containerName="maas-api"
Sep 15 12:05:16.450938 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:16.448760    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbf8c075-623d-4f74-a4b4-30101b7da411" containerName="maas-api"
Sep 15 12:05:16.450938 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:16.448772    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9b80036-c0e1-47e7-b06a-849ef1074f37" containerName="maas-api"
Sep 15 12:05:16.450938 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:16.448778    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9b80036-c0e1-47e7-b06a-849ef1074f37" containerName="maas-api"
Sep 15 12:05:16.450938 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:16.448853    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="41cbe8ba-7600-4e0d-9227-0491539f14c0" containerName="main"
Sep 15 12:05:16.450938 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:16.448866    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccc936f6-4114-4d4e-ba38-2d7bb8002628" containerName="maas-api"
Sep 15 12:05:16.450938 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:16.448875    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbf8c075-623d-4f74-a4b4-30101b7da411" containerName="maas-api"
Sep 15 12:05:16.450938 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:16.448886    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="70810daa-c6ab-4571-beb6-a363f6af32a5" containerName="maas-api"
Sep 15 12:05:16.450938 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:16.448895    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9b80036-c0e1-47e7-b06a-849ef1074f37" containerName="maas-api"
Sep 15 12:05:16.451881 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:16.451860    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk"
Sep 15 12:05:16.454610 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:16.454581    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-a80b3a05-kserve-self-signed-certs\""
Sep 15 12:05:16.463783 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:16.463752    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk"]
Sep 15 12:05:16.488987 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:16.488940    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7996a3d4-6719-4b99-ad54-becef70c731e-tls-certs\") pod \"e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk\" (UID: \"7996a3d4-6719-4b99-ad54-becef70c731e\") " pod="llm/e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk"
Sep 15 12:05:16.489175 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:16.489035    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7996a3d4-6719-4b99-ad54-becef70c731e-dshm\") pod \"e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk\" (UID: \"7996a3d4-6719-4b99-ad54-becef70c731e\") " pod="llm/e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk"
Sep 15 12:05:16.489175 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:16.489093    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7996a3d4-6719-4b99-ad54-becef70c731e-home\") pod \"e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk\" (UID: \"7996a3d4-6719-4b99-ad54-becef70c731e\") " pod="llm/e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk"
Sep 15 12:05:16.489175 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:16.489116    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7996a3d4-6719-4b99-ad54-becef70c731e-model-cache\") pod \"e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk\" (UID: \"7996a3d4-6719-4b99-ad54-becef70c731e\") " pod="llm/e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk"
Sep 15 12:05:16.489175 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:16.489145    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7996a3d4-6719-4b99-ad54-becef70c731e-tmp-dir\") pod \"e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk\" (UID: \"7996a3d4-6719-4b99-ad54-becef70c731e\") " pod="llm/e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk"
Sep 15 12:05:16.489175 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:16.489171    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rh6f\" (UniqueName: \"kubernetes.io/projected/7996a3d4-6719-4b99-ad54-becef70c731e-kube-api-access-9rh6f\") pod \"e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk\" (UID: \"7996a3d4-6719-4b99-ad54-becef70c731e\") " pod="llm/e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk"
Sep 15 12:05:16.589716 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:16.589628    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7996a3d4-6719-4b99-ad54-becef70c731e-dshm\") pod \"e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk\" (UID: \"7996a3d4-6719-4b99-ad54-becef70c731e\") " pod="llm/e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk"
Sep 15 12:05:16.589892 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:16.589763    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7996a3d4-6719-4b99-ad54-becef70c731e-home\") pod \"e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk\" (UID: \"7996a3d4-6719-4b99-ad54-becef70c731e\") " pod="llm/e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk"
Sep 15 12:05:16.589892 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:16.589791    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7996a3d4-6719-4b99-ad54-becef70c731e-model-cache\") pod \"e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk\" (UID: \"7996a3d4-6719-4b99-ad54-becef70c731e\") " pod="llm/e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk"
Sep 15 12:05:16.589892 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:16.589820    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7996a3d4-6719-4b99-ad54-becef70c731e-tmp-dir\") pod \"e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk\" (UID: \"7996a3d4-6719-4b99-ad54-becef70c731e\") " pod="llm/e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk"
Sep 15 12:05:16.590032 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:16.589961    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rh6f\" (UniqueName: \"kubernetes.io/projected/7996a3d4-6719-4b99-ad54-becef70c731e-kube-api-access-9rh6f\") pod \"e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk\" (UID: \"7996a3d4-6719-4b99-ad54-becef70c731e\") " pod="llm/e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk"
Sep 15 12:05:16.590032 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:16.590005    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7996a3d4-6719-4b99-ad54-becef70c731e-tls-certs\") pod \"e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk\" (UID: \"7996a3d4-6719-4b99-ad54-becef70c731e\") " pod="llm/e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk"
Sep 15 12:05:16.590190 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:16.590168    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7996a3d4-6719-4b99-ad54-becef70c731e-home\") pod \"e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk\" (UID: \"7996a3d4-6719-4b99-ad54-becef70c731e\") " pod="llm/e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk"
Sep 15 12:05:16.590253 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:16.590193    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7996a3d4-6719-4b99-ad54-becef70c731e-tmp-dir\") pod \"e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk\" (UID: \"7996a3d4-6719-4b99-ad54-becef70c731e\") " pod="llm/e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk"
Sep 15 12:05:16.590253 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:16.590226    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7996a3d4-6719-4b99-ad54-becef70c731e-model-cache\") pod \"e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk\" (UID: \"7996a3d4-6719-4b99-ad54-becef70c731e\") " pod="llm/e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk"
Sep 15 12:05:16.592115 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:16.592096    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7996a3d4-6719-4b99-ad54-becef70c731e-dshm\") pod \"e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk\" (UID: \"7996a3d4-6719-4b99-ad54-becef70c731e\") " pod="llm/e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk"
Sep 15 12:05:16.592410 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:16.592392    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7996a3d4-6719-4b99-ad54-becef70c731e-tls-certs\") pod \"e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk\" (UID: \"7996a3d4-6719-4b99-ad54-becef70c731e\") " pod="llm/e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk"
Sep 15 12:05:16.598914 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:16.598889    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rh6f\" (UniqueName: \"kubernetes.io/projected/7996a3d4-6719-4b99-ad54-becef70c731e-kube-api-access-9rh6f\") pod \"e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk\" (UID: \"7996a3d4-6719-4b99-ad54-becef70c731e\") " pod="llm/e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk"
Sep 15 12:05:16.762978 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:16.762871    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk"
Sep 15 12:05:17.044891 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:17.044858    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk"]
Sep 15 12:05:17.045907 ip-10-0-132-240 kubenswrapper[2575]: W0915 12:05:17.045873    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7996a3d4_6719_4b99_ad54_becef70c731e.slice/crio-08e1be0ec06652f101f4be6dd73e50766107ac5d007168115d4963169ca8eed7 WatchSource:0}: Error finding container 08e1be0ec06652f101f4be6dd73e50766107ac5d007168115d4963169ca8eed7: Status 404 returned error can't find the container with id 08e1be0ec06652f101f4be6dd73e50766107ac5d007168115d4963169ca8eed7
Sep 15 12:05:17.073213 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:17.073176    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk" event={"ID":"7996a3d4-6719-4b99-ad54-becef70c731e","Type":"ContainerStarted","Data":"08e1be0ec06652f101f4be6dd73e50766107ac5d007168115d4963169ca8eed7"}
Sep 15 12:05:18.080521 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:18.080472    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk" event={"ID":"7996a3d4-6719-4b99-ad54-becef70c731e","Type":"ContainerStarted","Data":"fb30ca539ca6ca6d5275e825e6ee36cc537b9b802240a4e31a4b31613381cda4"}
Sep 15 12:05:18.099497 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:18.099432    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk" podStartSLOduration=2.099411074 podStartE2EDuration="2.099411074s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:05:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:05:18.09739364 +0000 UTC m=+2388.523724236" watchObservedRunningTime="2026-09-15 12:05:18.099411074 +0000 UTC m=+2388.525741670"
Sep 15 12:05:26.763198 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:26.763154    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk"
Sep 15 12:05:26.763632 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:26.763215    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk"
Sep 15 12:05:26.776311 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:26.776283    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk"
Sep 15 12:05:27.144568 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:27.144533    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk"
Sep 15 12:05:58.374963 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:05:58.374861    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk"]
Sep 15 12:06:13.395293 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:13.395251    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk" podUID="7996a3d4-6719-4b99-ad54-becef70c731e" containerName="main" containerID="cri-o://fb30ca539ca6ca6d5275e825e6ee36cc537b9b802240a4e31a4b31613381cda4" gracePeriod=45
Sep 15 12:06:13.650705 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:13.650618    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk"
Sep 15 12:06:13.772114 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:13.772062    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rh6f\" (UniqueName: \"kubernetes.io/projected/7996a3d4-6719-4b99-ad54-becef70c731e-kube-api-access-9rh6f\") pod \"7996a3d4-6719-4b99-ad54-becef70c731e\" (UID: \"7996a3d4-6719-4b99-ad54-becef70c731e\") "
Sep 15 12:06:13.772307 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:13.772252    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7996a3d4-6719-4b99-ad54-becef70c731e-tmp-dir\") pod \"7996a3d4-6719-4b99-ad54-becef70c731e\" (UID: \"7996a3d4-6719-4b99-ad54-becef70c731e\") "
Sep 15 12:06:13.772307 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:13.772280    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7996a3d4-6719-4b99-ad54-becef70c731e-tls-certs\") pod \"7996a3d4-6719-4b99-ad54-becef70c731e\" (UID: \"7996a3d4-6719-4b99-ad54-becef70c731e\") "
Sep 15 12:06:13.772416 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:13.772307    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7996a3d4-6719-4b99-ad54-becef70c731e-dshm\") pod \"7996a3d4-6719-4b99-ad54-becef70c731e\" (UID: \"7996a3d4-6719-4b99-ad54-becef70c731e\") "
Sep 15 12:06:13.772416 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:13.772340    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7996a3d4-6719-4b99-ad54-becef70c731e-home\") pod \"7996a3d4-6719-4b99-ad54-becef70c731e\" (UID: \"7996a3d4-6719-4b99-ad54-becef70c731e\") "
Sep 15 12:06:13.772416 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:13.772410    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7996a3d4-6719-4b99-ad54-becef70c731e-model-cache\") pod \"7996a3d4-6719-4b99-ad54-becef70c731e\" (UID: \"7996a3d4-6719-4b99-ad54-becef70c731e\") "
Sep 15 12:06:13.772580 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:13.772552    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7996a3d4-6719-4b99-ad54-becef70c731e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7996a3d4-6719-4b99-ad54-becef70c731e" (UID: "7996a3d4-6719-4b99-ad54-becef70c731e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:06:13.772706 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:13.772645    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7996a3d4-6719-4b99-ad54-becef70c731e-home" (OuterVolumeSpecName: "home") pod "7996a3d4-6719-4b99-ad54-becef70c731e" (UID: "7996a3d4-6719-4b99-ad54-becef70c731e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:06:13.772837 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:13.772773    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7996a3d4-6719-4b99-ad54-becef70c731e-model-cache" (OuterVolumeSpecName: "model-cache") pod "7996a3d4-6719-4b99-ad54-becef70c731e" (UID: "7996a3d4-6719-4b99-ad54-becef70c731e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:06:13.772837 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:13.772804    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7996a3d4-6719-4b99-ad54-becef70c731e-tmp-dir\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 12:06:13.772837 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:13.772818    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7996a3d4-6719-4b99-ad54-becef70c731e-home\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 12:06:13.774565 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:13.774538    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7996a3d4-6719-4b99-ad54-becef70c731e-dshm" (OuterVolumeSpecName: "dshm") pod "7996a3d4-6719-4b99-ad54-becef70c731e" (UID: "7996a3d4-6719-4b99-ad54-becef70c731e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:06:13.774829 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:13.774799    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7996a3d4-6719-4b99-ad54-becef70c731e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7996a3d4-6719-4b99-ad54-becef70c731e" (UID: "7996a3d4-6719-4b99-ad54-becef70c731e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:06:13.774829 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:13.774806    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7996a3d4-6719-4b99-ad54-becef70c731e-kube-api-access-9rh6f" (OuterVolumeSpecName: "kube-api-access-9rh6f") pod "7996a3d4-6719-4b99-ad54-becef70c731e" (UID: "7996a3d4-6719-4b99-ad54-becef70c731e"). InnerVolumeSpecName "kube-api-access-9rh6f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:06:13.874072 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:13.874015    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7996a3d4-6719-4b99-ad54-becef70c731e-tls-certs\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 12:06:13.874072 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:13.874064    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7996a3d4-6719-4b99-ad54-becef70c731e-dshm\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 12:06:13.874072 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:13.874073    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7996a3d4-6719-4b99-ad54-becef70c731e-model-cache\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 12:06:13.874072 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:13.874081    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rh6f\" (UniqueName: \"kubernetes.io/projected/7996a3d4-6719-4b99-ad54-becef70c731e-kube-api-access-9rh6f\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 12:06:14.418756 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:14.418637    2575 generic.go:356] "Generic (PLEG): container finished" podID="7996a3d4-6719-4b99-ad54-becef70c731e" containerID="fb30ca539ca6ca6d5275e825e6ee36cc537b9b802240a4e31a4b31613381cda4" exitCode=0
Sep 15 12:06:14.418756 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:14.418690    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk"
Sep 15 12:06:14.418756 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:14.418727    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk" event={"ID":"7996a3d4-6719-4b99-ad54-becef70c731e","Type":"ContainerDied","Data":"fb30ca539ca6ca6d5275e825e6ee36cc537b9b802240a4e31a4b31613381cda4"}
Sep 15 12:06:14.419310 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:14.418777    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk" event={"ID":"7996a3d4-6719-4b99-ad54-becef70c731e","Type":"ContainerDied","Data":"08e1be0ec06652f101f4be6dd73e50766107ac5d007168115d4963169ca8eed7"}
Sep 15 12:06:14.419310 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:14.418799    2575 scope.go:117] "RemoveContainer" containerID="fb30ca539ca6ca6d5275e825e6ee36cc537b9b802240a4e31a4b31613381cda4"
Sep 15 12:06:14.428731 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:14.428708    2575 scope.go:117] "RemoveContainer" containerID="fb30ca539ca6ca6d5275e825e6ee36cc537b9b802240a4e31a4b31613381cda4"
Sep 15 12:06:14.429077 ip-10-0-132-240 kubenswrapper[2575]: E0915 12:06:14.429061    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb30ca539ca6ca6d5275e825e6ee36cc537b9b802240a4e31a4b31613381cda4\": container with ID starting with fb30ca539ca6ca6d5275e825e6ee36cc537b9b802240a4e31a4b31613381cda4 not found: ID does not exist" containerID="fb30ca539ca6ca6d5275e825e6ee36cc537b9b802240a4e31a4b31613381cda4"
Sep 15 12:06:14.429129 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:14.429086    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb30ca539ca6ca6d5275e825e6ee36cc537b9b802240a4e31a4b31613381cda4"} err="failed to get container status \"fb30ca539ca6ca6d5275e825e6ee36cc537b9b802240a4e31a4b31613381cda4\": rpc error: code = NotFound desc = could not find container \"fb30ca539ca6ca6d5275e825e6ee36cc537b9b802240a4e31a4b31613381cda4\": container with ID starting with fb30ca539ca6ca6d5275e825e6ee36cc537b9b802240a4e31a4b31613381cda4 not found: ID does not exist"
Sep 15 12:06:14.438891 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:14.438852    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk"]
Sep 15 12:06:14.442306 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:14.442271    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-a80b3a05-kserve-5cff869595-hsfqk"]
Sep 15 12:06:16.094061 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:16.094020    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7996a3d4-6719-4b99-ad54-becef70c731e" path="/var/lib/kubelet/pods/7996a3d4-6719-4b99-ad54-becef70c731e/volumes"
Sep 15 12:06:17.461628 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:17.461576    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-57d8d6c56b-59g7n"]
Sep 15 12:06:17.462081 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:17.462064    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7996a3d4-6719-4b99-ad54-becef70c731e" containerName="main"
Sep 15 12:06:17.462129 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:17.462082    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7996a3d4-6719-4b99-ad54-becef70c731e" containerName="main"
Sep 15 12:06:17.462170 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:17.462160    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7996a3d4-6719-4b99-ad54-becef70c731e" containerName="main"
Sep 15 12:06:17.467233 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:17.467207    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-57d8d6c56b-59g7n"
Sep 15 12:06:17.469462 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:17.469436    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 12:06:17.470208 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:17.470186    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 12:06:17.470358 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:17.470218    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-bjt69\""
Sep 15 12:06:17.470358 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:17.470309    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 15 12:06:17.470358 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:17.470346    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 15 12:06:17.477752 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:17.477717    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-57d8d6c56b-59g7n"]
Sep 15 12:06:17.610983 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:17.610933    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59638e62-a6bb-420a-afe0-95a6fdcd267d-maas-api-tls\") pod \"maas-api-57d8d6c56b-59g7n\" (UID: \"59638e62-a6bb-420a-afe0-95a6fdcd267d\") " pod="odh-ai-gateway-infra/maas-api-57d8d6c56b-59g7n"
Sep 15 12:06:17.611193 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:17.611014    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g768w\" (UniqueName: \"kubernetes.io/projected/59638e62-a6bb-420a-afe0-95a6fdcd267d-kube-api-access-g768w\") pod \"maas-api-57d8d6c56b-59g7n\" (UID: \"59638e62-a6bb-420a-afe0-95a6fdcd267d\") " pod="odh-ai-gateway-infra/maas-api-57d8d6c56b-59g7n"
Sep 15 12:06:17.611193 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:17.611070    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59638e62-a6bb-420a-afe0-95a6fdcd267d-openshift-service-ca\") pod \"maas-api-57d8d6c56b-59g7n\" (UID: \"59638e62-a6bb-420a-afe0-95a6fdcd267d\") " pod="odh-ai-gateway-infra/maas-api-57d8d6c56b-59g7n"
Sep 15 12:06:17.611193 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:17.611100    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59638e62-a6bb-420a-afe0-95a6fdcd267d-metrics-certs\") pod \"maas-api-57d8d6c56b-59g7n\" (UID: \"59638e62-a6bb-420a-afe0-95a6fdcd267d\") " pod="odh-ai-gateway-infra/maas-api-57d8d6c56b-59g7n"
Sep 15 12:06:17.712164 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:17.712061    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g768w\" (UniqueName: \"kubernetes.io/projected/59638e62-a6bb-420a-afe0-95a6fdcd267d-kube-api-access-g768w\") pod \"maas-api-57d8d6c56b-59g7n\" (UID: \"59638e62-a6bb-420a-afe0-95a6fdcd267d\") " pod="odh-ai-gateway-infra/maas-api-57d8d6c56b-59g7n"
Sep 15 12:06:17.712164 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:17.712115    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59638e62-a6bb-420a-afe0-95a6fdcd267d-openshift-service-ca\") pod \"maas-api-57d8d6c56b-59g7n\" (UID: \"59638e62-a6bb-420a-afe0-95a6fdcd267d\") " pod="odh-ai-gateway-infra/maas-api-57d8d6c56b-59g7n"
Sep 15 12:06:17.712164 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:17.712145    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59638e62-a6bb-420a-afe0-95a6fdcd267d-metrics-certs\") pod \"maas-api-57d8d6c56b-59g7n\" (UID: \"59638e62-a6bb-420a-afe0-95a6fdcd267d\") " pod="odh-ai-gateway-infra/maas-api-57d8d6c56b-59g7n"
Sep 15 12:06:17.712410 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:17.712271    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59638e62-a6bb-420a-afe0-95a6fdcd267d-maas-api-tls\") pod \"maas-api-57d8d6c56b-59g7n\" (UID: \"59638e62-a6bb-420a-afe0-95a6fdcd267d\") " pod="odh-ai-gateway-infra/maas-api-57d8d6c56b-59g7n"
Sep 15 12:06:17.712925 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:17.712899    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59638e62-a6bb-420a-afe0-95a6fdcd267d-openshift-service-ca\") pod \"maas-api-57d8d6c56b-59g7n\" (UID: \"59638e62-a6bb-420a-afe0-95a6fdcd267d\") " pod="odh-ai-gateway-infra/maas-api-57d8d6c56b-59g7n"
Sep 15 12:06:17.714880 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:17.714855    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59638e62-a6bb-420a-afe0-95a6fdcd267d-maas-api-tls\") pod \"maas-api-57d8d6c56b-59g7n\" (UID: \"59638e62-a6bb-420a-afe0-95a6fdcd267d\") " pod="odh-ai-gateway-infra/maas-api-57d8d6c56b-59g7n"
Sep 15 12:06:17.715009 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:17.714886    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59638e62-a6bb-420a-afe0-95a6fdcd267d-metrics-certs\") pod \"maas-api-57d8d6c56b-59g7n\" (UID: \"59638e62-a6bb-420a-afe0-95a6fdcd267d\") " pod="odh-ai-gateway-infra/maas-api-57d8d6c56b-59g7n"
Sep 15 12:06:17.720296 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:17.720261    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g768w\" (UniqueName: \"kubernetes.io/projected/59638e62-a6bb-420a-afe0-95a6fdcd267d-kube-api-access-g768w\") pod \"maas-api-57d8d6c56b-59g7n\" (UID: \"59638e62-a6bb-420a-afe0-95a6fdcd267d\") " pod="odh-ai-gateway-infra/maas-api-57d8d6c56b-59g7n"
Sep 15 12:06:17.780192 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:17.780145    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-57d8d6c56b-59g7n"
Sep 15 12:06:18.056349 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:18.056320    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-57d8d6c56b-59g7n"]
Sep 15 12:06:18.058096 ip-10-0-132-240 kubenswrapper[2575]: W0915 12:06:18.058063    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59638e62_a6bb_420a_afe0_95a6fdcd267d.slice/crio-a9514e05532bd7b6c60f9d7db0a409c55bd63206836370f379d0af183418de7a WatchSource:0}: Error finding container a9514e05532bd7b6c60f9d7db0a409c55bd63206836370f379d0af183418de7a: Status 404 returned error can't find the container with id a9514e05532bd7b6c60f9d7db0a409c55bd63206836370f379d0af183418de7a
Sep 15 12:06:18.059584 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:18.059562    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 12:06:18.444463 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:18.444426    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-57d8d6c56b-59g7n" event={"ID":"59638e62-a6bb-420a-afe0-95a6fdcd267d","Type":"ContainerStarted","Data":"a9514e05532bd7b6c60f9d7db0a409c55bd63206836370f379d0af183418de7a"}
Sep 15 12:06:21.463781 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:21.463742    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-57d8d6c56b-59g7n" event={"ID":"59638e62-a6bb-420a-afe0-95a6fdcd267d","Type":"ContainerStarted","Data":"7c5293c889b721d21a5c93ce0a3661285ff2777fb5dd8f6c43943853d25260d2"}
Sep 15 12:06:21.464208 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:21.463881    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-57d8d6c56b-59g7n"
Sep 15 12:06:21.488738 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:21.488680    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-57d8d6c56b-59g7n" podStartSLOduration=1.786329672 podStartE2EDuration="4.488636327s" totalImagesPullingTime="2.702306655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:06:21.487878059 +0000 UTC m=+2451.914208655" watchObservedRunningTime="2026-09-15 12:06:21.488636327 +0000 UTC m=+2451.914966923"
Sep 15 12:06:24.851770 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:24.851728    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-57d8d6c56b-59g7n"]
Sep 15 12:06:24.852290 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:24.852038    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-57d8d6c56b-59g7n" podUID="59638e62-a6bb-420a-afe0-95a6fdcd267d" containerName="maas-api" containerID="cri-o://7c5293c889b721d21a5c93ce0a3661285ff2777fb5dd8f6c43943853d25260d2" gracePeriod=30
Sep 15 12:06:25.106717 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:25.106616    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-57d8d6c56b-59g7n"
Sep 15 12:06:25.192465 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:25.192428    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59638e62-a6bb-420a-afe0-95a6fdcd267d-maas-api-tls\") pod \"59638e62-a6bb-420a-afe0-95a6fdcd267d\" (UID: \"59638e62-a6bb-420a-afe0-95a6fdcd267d\") "
Sep 15 12:06:25.192637 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:25.192549    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g768w\" (UniqueName: \"kubernetes.io/projected/59638e62-a6bb-420a-afe0-95a6fdcd267d-kube-api-access-g768w\") pod \"59638e62-a6bb-420a-afe0-95a6fdcd267d\" (UID: \"59638e62-a6bb-420a-afe0-95a6fdcd267d\") "
Sep 15 12:06:25.192637 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:25.192589    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59638e62-a6bb-420a-afe0-95a6fdcd267d-openshift-service-ca\") pod \"59638e62-a6bb-420a-afe0-95a6fdcd267d\" (UID: \"59638e62-a6bb-420a-afe0-95a6fdcd267d\") "
Sep 15 12:06:25.192637 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:25.192622    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59638e62-a6bb-420a-afe0-95a6fdcd267d-metrics-certs\") pod \"59638e62-a6bb-420a-afe0-95a6fdcd267d\" (UID: \"59638e62-a6bb-420a-afe0-95a6fdcd267d\") "
Sep 15 12:06:25.193020 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:25.192980    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59638e62-a6bb-420a-afe0-95a6fdcd267d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "59638e62-a6bb-420a-afe0-95a6fdcd267d" (UID: "59638e62-a6bb-420a-afe0-95a6fdcd267d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:06:25.194830 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:25.194796    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59638e62-a6bb-420a-afe0-95a6fdcd267d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "59638e62-a6bb-420a-afe0-95a6fdcd267d" (UID: "59638e62-a6bb-420a-afe0-95a6fdcd267d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:06:25.194947 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:25.194802    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59638e62-a6bb-420a-afe0-95a6fdcd267d-kube-api-access-g768w" (OuterVolumeSpecName: "kube-api-access-g768w") pod "59638e62-a6bb-420a-afe0-95a6fdcd267d" (UID: "59638e62-a6bb-420a-afe0-95a6fdcd267d"). InnerVolumeSpecName "kube-api-access-g768w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:06:25.194947 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:25.194859    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59638e62-a6bb-420a-afe0-95a6fdcd267d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "59638e62-a6bb-420a-afe0-95a6fdcd267d" (UID: "59638e62-a6bb-420a-afe0-95a6fdcd267d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:06:25.294408 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:25.294346    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59638e62-a6bb-420a-afe0-95a6fdcd267d-maas-api-tls\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 12:06:25.294408 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:25.294398    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g768w\" (UniqueName: \"kubernetes.io/projected/59638e62-a6bb-420a-afe0-95a6fdcd267d-kube-api-access-g768w\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 12:06:25.294408 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:25.294411    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59638e62-a6bb-420a-afe0-95a6fdcd267d-openshift-service-ca\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 12:06:25.294408 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:25.294419    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59638e62-a6bb-420a-afe0-95a6fdcd267d-metrics-certs\") on node \"ip-10-0-132-240.ec2.internal\" DevicePath \"\""
Sep 15 12:06:25.491581 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:25.491484    2575 generic.go:356] "Generic (PLEG): container finished" podID="59638e62-a6bb-420a-afe0-95a6fdcd267d" containerID="7c5293c889b721d21a5c93ce0a3661285ff2777fb5dd8f6c43943853d25260d2" exitCode=0
Sep 15 12:06:25.491581 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:25.491531    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-57d8d6c56b-59g7n"
Sep 15 12:06:25.491811 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:25.491575    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-57d8d6c56b-59g7n" event={"ID":"59638e62-a6bb-420a-afe0-95a6fdcd267d","Type":"ContainerDied","Data":"7c5293c889b721d21a5c93ce0a3661285ff2777fb5dd8f6c43943853d25260d2"}
Sep 15 12:06:25.491811 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:25.491631    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-57d8d6c56b-59g7n" event={"ID":"59638e62-a6bb-420a-afe0-95a6fdcd267d","Type":"ContainerDied","Data":"a9514e05532bd7b6c60f9d7db0a409c55bd63206836370f379d0af183418de7a"}
Sep 15 12:06:25.491811 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:25.491678    2575 scope.go:117] "RemoveContainer" containerID="7c5293c889b721d21a5c93ce0a3661285ff2777fb5dd8f6c43943853d25260d2"
Sep 15 12:06:25.501942 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:25.501918    2575 scope.go:117] "RemoveContainer" containerID="7c5293c889b721d21a5c93ce0a3661285ff2777fb5dd8f6c43943853d25260d2"
Sep 15 12:06:25.502300 ip-10-0-132-240 kubenswrapper[2575]: E0915 12:06:25.502278    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c5293c889b721d21a5c93ce0a3661285ff2777fb5dd8f6c43943853d25260d2\": container with ID starting with 7c5293c889b721d21a5c93ce0a3661285ff2777fb5dd8f6c43943853d25260d2 not found: ID does not exist" containerID="7c5293c889b721d21a5c93ce0a3661285ff2777fb5dd8f6c43943853d25260d2"
Sep 15 12:06:25.502379 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:25.502309    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c5293c889b721d21a5c93ce0a3661285ff2777fb5dd8f6c43943853d25260d2"} err="failed to get container status \"7c5293c889b721d21a5c93ce0a3661285ff2777fb5dd8f6c43943853d25260d2\": rpc error: code = NotFound desc = could not find container \"7c5293c889b721d21a5c93ce0a3661285ff2777fb5dd8f6c43943853d25260d2\": container with ID starting with 7c5293c889b721d21a5c93ce0a3661285ff2777fb5dd8f6c43943853d25260d2 not found: ID does not exist"
Sep 15 12:06:25.514303 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:25.514263    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-57d8d6c56b-59g7n"]
Sep 15 12:06:25.520219 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:25.520186    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-57d8d6c56b-59g7n"]
Sep 15 12:06:26.094245 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:26.094207    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59638e62-a6bb-420a-afe0-95a6fdcd267d" path="/var/lib/kubelet/pods/59638e62-a6bb-420a-afe0-95a6fdcd267d/volumes"
Sep 15 12:06:51.187513 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:51.187453    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-849f4c7b4d-wmg2z_36d4e344-18df-40d7-b0d5-c7803d8f74c6/authorino/0.log"
Sep 15 12:06:56.830246 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:56.830211    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-fw6nx_80f17fda-ba80-4ed4-a42c-658bb39be158/server/0.log"
Sep 15 12:06:56.940366 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:56.940332    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-st8kl_6ead0d0d-537c-4283-9bba-be92cb669493/manager/0.log"
Sep 15 12:06:57.051869 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:57.051837    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b96c7c888-9nzmj_66140c79-49a9-451d-8815-727ceed5f655/copy-manifests/0.log"
Sep 15 12:06:57.059451 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:57.059418    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b96c7c888-9nzmj_66140c79-49a9-451d-8815-727ceed5f655/manager/0.log"
Sep 15 12:06:58.795331 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:58.795296    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-849f4c7b4d-wmg2z_36d4e344-18df-40d7-b0d5-c7803d8f74c6/authorino/0.log"
Sep 15 12:06:59.812836 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:06:59.812805    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c_6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad/istio-proxy/0.log"
Sep 15 12:07:00.138949 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:00.138917    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79674675df-ptdl6_a3719401-4dc0-4e1c-b3b7-f669615eb88a/kube-auth-proxy/0.log"
Sep 15 12:07:00.476557 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:00.476444    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-bp6jm_0f637e00-1499-422e-8d72-e7a5504bac92/payload-processing/0.log"
Sep 15 12:07:01.222225 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:01.222191    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-kd44x_06ddb44b-3f4f-43c0-b15a-f85c537eb290/main/0.log"
Sep 15 12:07:01.435214 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:01.435185    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-wvp4r_05bee46c-7d21-448e-a734-023e2ff2ad30/main/0.log"
Sep 15 12:07:06.953772 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:06.953735    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nkxzt/must-gather-fnz9t"]
Sep 15 12:07:06.954491 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:06.954465    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59638e62-a6bb-420a-afe0-95a6fdcd267d" containerName="maas-api"
Sep 15 12:07:06.954585 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:06.954494    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="59638e62-a6bb-420a-afe0-95a6fdcd267d" containerName="maas-api"
Sep 15 12:07:06.954646 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:06.954596    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="59638e62-a6bb-420a-afe0-95a6fdcd267d" containerName="maas-api"
Sep 15 12:07:06.958014 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:06.957984    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nkxzt/must-gather-fnz9t"
Sep 15 12:07:06.960189 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:06.960164    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nkxzt\"/\"default-dockercfg-jpntf\""
Sep 15 12:07:06.960329 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:06.960167    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nkxzt\"/\"openshift-service-ca.crt\""
Sep 15 12:07:06.960735 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:06.960719    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nkxzt\"/\"kube-root-ca.crt\""
Sep 15 12:07:06.966599 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:06.966564    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nkxzt/must-gather-fnz9t"]
Sep 15 12:07:07.097922 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:07.097878    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e2f6b32c-bdf4-4b1c-a5e3-19b7e840d6bd-must-gather-output\") pod \"must-gather-fnz9t\" (UID: \"e2f6b32c-bdf4-4b1c-a5e3-19b7e840d6bd\") " pod="openshift-must-gather-nkxzt/must-gather-fnz9t"
Sep 15 12:07:07.098130 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:07.097963    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kb47\" (UniqueName: \"kubernetes.io/projected/e2f6b32c-bdf4-4b1c-a5e3-19b7e840d6bd-kube-api-access-8kb47\") pod \"must-gather-fnz9t\" (UID: \"e2f6b32c-bdf4-4b1c-a5e3-19b7e840d6bd\") " pod="openshift-must-gather-nkxzt/must-gather-fnz9t"
Sep 15 12:07:07.199536 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:07.199487    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e2f6b32c-bdf4-4b1c-a5e3-19b7e840d6bd-must-gather-output\") pod \"must-gather-fnz9t\" (UID: \"e2f6b32c-bdf4-4b1c-a5e3-19b7e840d6bd\") " pod="openshift-must-gather-nkxzt/must-gather-fnz9t"
Sep 15 12:07:07.199762 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:07.199591    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kb47\" (UniqueName: \"kubernetes.io/projected/e2f6b32c-bdf4-4b1c-a5e3-19b7e840d6bd-kube-api-access-8kb47\") pod \"must-gather-fnz9t\" (UID: \"e2f6b32c-bdf4-4b1c-a5e3-19b7e840d6bd\") " pod="openshift-must-gather-nkxzt/must-gather-fnz9t"
Sep 15 12:07:07.199904 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:07.199885    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e2f6b32c-bdf4-4b1c-a5e3-19b7e840d6bd-must-gather-output\") pod \"must-gather-fnz9t\" (UID: \"e2f6b32c-bdf4-4b1c-a5e3-19b7e840d6bd\") " pod="openshift-must-gather-nkxzt/must-gather-fnz9t"
Sep 15 12:07:07.210448 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:07.210367    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kb47\" (UniqueName: \"kubernetes.io/projected/e2f6b32c-bdf4-4b1c-a5e3-19b7e840d6bd-kube-api-access-8kb47\") pod \"must-gather-fnz9t\" (UID: \"e2f6b32c-bdf4-4b1c-a5e3-19b7e840d6bd\") " pod="openshift-must-gather-nkxzt/must-gather-fnz9t"
Sep 15 12:07:07.268610 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:07.268574    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nkxzt/must-gather-fnz9t"
Sep 15 12:07:07.544058 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:07.544031    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nkxzt/must-gather-fnz9t"]
Sep 15 12:07:07.545778 ip-10-0-132-240 kubenswrapper[2575]: W0915 12:07:07.545748    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode2f6b32c_bdf4_4b1c_a5e3_19b7e840d6bd.slice/crio-a446bc5136d5f56be2d6ba60e460362803cb8e3daab3241ad560a13ee2eaddcc WatchSource:0}: Error finding container a446bc5136d5f56be2d6ba60e460362803cb8e3daab3241ad560a13ee2eaddcc: Status 404 returned error can't find the container with id a446bc5136d5f56be2d6ba60e460362803cb8e3daab3241ad560a13ee2eaddcc
Sep 15 12:07:07.736934 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:07.736893    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nkxzt/must-gather-fnz9t" event={"ID":"e2f6b32c-bdf4-4b1c-a5e3-19b7e840d6bd","Type":"ContainerStarted","Data":"a446bc5136d5f56be2d6ba60e460362803cb8e3daab3241ad560a13ee2eaddcc"}
Sep 15 12:07:11.766939 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:11.766766    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nkxzt/must-gather-fnz9t" event={"ID":"e2f6b32c-bdf4-4b1c-a5e3-19b7e840d6bd","Type":"ContainerStarted","Data":"9f51d4be37f6c1815567ca09259c219888b67606087c45e265d574edad5f63c2"}
Sep 15 12:07:11.766939 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:11.766839    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nkxzt/must-gather-fnz9t" event={"ID":"e2f6b32c-bdf4-4b1c-a5e3-19b7e840d6bd","Type":"ContainerStarted","Data":"ef46564d9de4180389851aa13ecbd31328e612fc5924460ca7edb4292e6509c1"}
Sep 15 12:07:11.783975 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:11.783904    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nkxzt/must-gather-fnz9t" podStartSLOduration=1.93720646 podStartE2EDuration="5.783881448s" totalImagesPullingTime="3.846674988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:07:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:07:11.78183321 +0000 UTC m=+2502.208163807" watchObservedRunningTime="2026-09-15 12:07:11.783881448 +0000 UTC m=+2502.210212045"
Sep 15 12:07:13.045782 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:13.045744    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-q96s9_c0bac93c-2a52-439c-a4a6-d4d31424d653/global-pull-secret-syncer/0.log"
Sep 15 12:07:13.167472 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:13.167436    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ttwvq_c5e5dc64-36c8-49a9-b823-185c56534d6a/konnectivity-agent/0.log"
Sep 15 12:07:13.187084 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:13.187056    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-240.ec2.internal_87bfeb81dec9b16ad8c9fded8c51d913/haproxy/0.log"
Sep 15 12:07:17.988145 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:17.988112    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-849f4c7b4d-wmg2z_36d4e344-18df-40d7-b0d5-c7803d8f74c6/authorino/0.log"
Sep 15 12:07:19.929676 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:19.929614    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7d221dc1-d60e-4929-bedb-38e7561ce21f/alertmanager/0.log"
Sep 15 12:07:19.955372 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:19.955310    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7d221dc1-d60e-4929-bedb-38e7561ce21f/config-reloader/0.log"
Sep 15 12:07:19.979974 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:19.979937    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7d221dc1-d60e-4929-bedb-38e7561ce21f/kube-rbac-proxy-web/0.log"
Sep 15 12:07:20.004001 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:20.003964    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7d221dc1-d60e-4929-bedb-38e7561ce21f/kube-rbac-proxy/0.log"
Sep 15 12:07:20.022922 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:20.022872    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7d221dc1-d60e-4929-bedb-38e7561ce21f/kube-rbac-proxy-metric/0.log"
Sep 15 12:07:20.047055 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:20.047027    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7d221dc1-d60e-4929-bedb-38e7561ce21f/prom-label-proxy/0.log"
Sep 15 12:07:20.072777 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:20.072741    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7d221dc1-d60e-4929-bedb-38e7561ce21f/init-config-reloader/0.log"
Sep 15 12:07:20.160629 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:20.160596    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-8jsbl_15947759-97ca-45fa-ba35-9775f005932e/kube-state-metrics/0.log"
Sep 15 12:07:20.180492 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:20.180381    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-8jsbl_15947759-97ca-45fa-ba35-9775f005932e/kube-rbac-proxy-main/0.log"
Sep 15 12:07:20.202769 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:20.202737    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-8jsbl_15947759-97ca-45fa-ba35-9775f005932e/kube-rbac-proxy-self/0.log"
Sep 15 12:07:20.230551 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:20.230514    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-86c8f6885b-7sxth_f29accc6-671c-4242-9f6e-2816b9719497/metrics-server/0.log"
Sep 15 12:07:20.257171 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:20.257135    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-g45xg_f0fea698-4dfb-4444-8f7d-400771895b0b/monitoring-plugin/0.log"
Sep 15 12:07:20.291207 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:20.291135    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fcx44_decbe6a6-fff2-4036-a878-9ca3938aed97/node-exporter/0.log"
Sep 15 12:07:20.312537 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:20.312487    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fcx44_decbe6a6-fff2-4036-a878-9ca3938aed97/kube-rbac-proxy/0.log"
Sep 15 12:07:20.335537 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:20.335479    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fcx44_decbe6a6-fff2-4036-a878-9ca3938aed97/init-textfile/0.log"
Sep 15 12:07:20.527382 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:20.527296    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-krbrg_8dfe2975-53d4-497f-84a8-73769c317649/kube-rbac-proxy-main/0.log"
Sep 15 12:07:20.549387 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:20.549351    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-krbrg_8dfe2975-53d4-497f-84a8-73769c317649/kube-rbac-proxy-self/0.log"
Sep 15 12:07:20.572957 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:20.572922    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-krbrg_8dfe2975-53d4-497f-84a8-73769c317649/openshift-state-metrics/0.log"
Sep 15 12:07:20.788975 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:20.788943    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-qsnvj_bfe43c5a-29be-4e66-967c-0ffccbca8f41/prometheus-operator/0.log"
Sep 15 12:07:20.825082 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:20.825046    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-qsnvj_bfe43c5a-29be-4e66-967c-0ffccbca8f41/kube-rbac-proxy/0.log"
Sep 15 12:07:20.870878 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:20.870811    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-hgfjw_194579af-cc78-46c8-9cd0-1a99d60bdb63/prometheus-operator-admission-webhook/0.log"
Sep 15 12:07:20.916024 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:20.915506    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-545d74596c-csvhm_ea56a0f5-bcfc-488f-83b5-ea00001546ad/telemeter-client/0.log"
Sep 15 12:07:20.950695 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:20.949939    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-545d74596c-csvhm_ea56a0f5-bcfc-488f-83b5-ea00001546ad/reload/0.log"
Sep 15 12:07:20.974290 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:20.974261    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-545d74596c-csvhm_ea56a0f5-bcfc-488f-83b5-ea00001546ad/kube-rbac-proxy/0.log"
Sep 15 12:07:21.015912 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:21.015879    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-747c85f84b-7btht_3f865a88-05c6-49da-a8e4-fe70726ce77a/thanos-query/0.log"
Sep 15 12:07:21.038818 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:21.038727    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-747c85f84b-7btht_3f865a88-05c6-49da-a8e4-fe70726ce77a/kube-rbac-proxy-web/0.log"
Sep 15 12:07:21.059567 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:21.059540    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-747c85f84b-7btht_3f865a88-05c6-49da-a8e4-fe70726ce77a/kube-rbac-proxy/0.log"
Sep 15 12:07:21.083076 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:21.083046    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-747c85f84b-7btht_3f865a88-05c6-49da-a8e4-fe70726ce77a/prom-label-proxy/0.log"
Sep 15 12:07:21.109226 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:21.109189    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-747c85f84b-7btht_3f865a88-05c6-49da-a8e4-fe70726ce77a/kube-rbac-proxy-rules/0.log"
Sep 15 12:07:21.131031 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:21.130979    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-747c85f84b-7btht_3f865a88-05c6-49da-a8e4-fe70726ce77a/kube-rbac-proxy-metrics/0.log"
Sep 15 12:07:23.744447 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:23.744388    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nkxzt/perf-node-gather-daemonset-5bkmj"]
Sep 15 12:07:23.749773 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:23.749741    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nkxzt/perf-node-gather-daemonset-5bkmj"
Sep 15 12:07:23.757310 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:23.755841    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nkxzt/perf-node-gather-daemonset-5bkmj"]
Sep 15 12:07:23.797122 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:23.797077    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7f0cf187-5dfc-4358-b10e-7998fb857387-proc\") pod \"perf-node-gather-daemonset-5bkmj\" (UID: \"7f0cf187-5dfc-4358-b10e-7998fb857387\") " pod="openshift-must-gather-nkxzt/perf-node-gather-daemonset-5bkmj"
Sep 15 12:07:23.797344 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:23.797134    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxmfl\" (UniqueName: \"kubernetes.io/projected/7f0cf187-5dfc-4358-b10e-7998fb857387-kube-api-access-kxmfl\") pod \"perf-node-gather-daemonset-5bkmj\" (UID: \"7f0cf187-5dfc-4358-b10e-7998fb857387\") " pod="openshift-must-gather-nkxzt/perf-node-gather-daemonset-5bkmj"
Sep 15 12:07:23.797344 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:23.797208    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f0cf187-5dfc-4358-b10e-7998fb857387-sys\") pod \"perf-node-gather-daemonset-5bkmj\" (UID: \"7f0cf187-5dfc-4358-b10e-7998fb857387\") " pod="openshift-must-gather-nkxzt/perf-node-gather-daemonset-5bkmj"
Sep 15 12:07:23.797344 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:23.797254    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7f0cf187-5dfc-4358-b10e-7998fb857387-podres\") pod \"perf-node-gather-daemonset-5bkmj\" (UID: \"7f0cf187-5dfc-4358-b10e-7998fb857387\") " pod="openshift-must-gather-nkxzt/perf-node-gather-daemonset-5bkmj"
Sep 15 12:07:23.797344 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:23.797326    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7f0cf187-5dfc-4358-b10e-7998fb857387-lib-modules\") pod \"perf-node-gather-daemonset-5bkmj\" (UID: \"7f0cf187-5dfc-4358-b10e-7998fb857387\") " pod="openshift-must-gather-nkxzt/perf-node-gather-daemonset-5bkmj"
Sep 15 12:07:23.808050 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:23.808008    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-67c488f774-8vfmf_c2b243e1-5294-417b-a00c-34eb2c5edfbe/console/0.log"
Sep 15 12:07:23.898986 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:23.898944    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7f0cf187-5dfc-4358-b10e-7998fb857387-podres\") pod \"perf-node-gather-daemonset-5bkmj\" (UID: \"7f0cf187-5dfc-4358-b10e-7998fb857387\") " pod="openshift-must-gather-nkxzt/perf-node-gather-daemonset-5bkmj"
Sep 15 12:07:23.899342 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:23.899318    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7f0cf187-5dfc-4358-b10e-7998fb857387-lib-modules\") pod \"perf-node-gather-daemonset-5bkmj\" (UID: \"7f0cf187-5dfc-4358-b10e-7998fb857387\") " pod="openshift-must-gather-nkxzt/perf-node-gather-daemonset-5bkmj"
Sep 15 12:07:23.899476 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:23.899463    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7f0cf187-5dfc-4358-b10e-7998fb857387-proc\") pod \"perf-node-gather-daemonset-5bkmj\" (UID: \"7f0cf187-5dfc-4358-b10e-7998fb857387\") " pod="openshift-must-gather-nkxzt/perf-node-gather-daemonset-5bkmj"
Sep 15 12:07:23.899589 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:23.899574    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxmfl\" (UniqueName: \"kubernetes.io/projected/7f0cf187-5dfc-4358-b10e-7998fb857387-kube-api-access-kxmfl\") pod \"perf-node-gather-daemonset-5bkmj\" (UID: \"7f0cf187-5dfc-4358-b10e-7998fb857387\") " pod="openshift-must-gather-nkxzt/perf-node-gather-daemonset-5bkmj"
Sep 15 12:07:23.899787 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:23.899771    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f0cf187-5dfc-4358-b10e-7998fb857387-sys\") pod \"perf-node-gather-daemonset-5bkmj\" (UID: \"7f0cf187-5dfc-4358-b10e-7998fb857387\") " pod="openshift-must-gather-nkxzt/perf-node-gather-daemonset-5bkmj"
Sep 15 12:07:23.900012 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:23.899996    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f0cf187-5dfc-4358-b10e-7998fb857387-sys\") pod \"perf-node-gather-daemonset-5bkmj\" (UID: \"7f0cf187-5dfc-4358-b10e-7998fb857387\") " pod="openshift-must-gather-nkxzt/perf-node-gather-daemonset-5bkmj"
Sep 15 12:07:23.900249 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:23.900227    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7f0cf187-5dfc-4358-b10e-7998fb857387-podres\") pod \"perf-node-gather-daemonset-5bkmj\" (UID: \"7f0cf187-5dfc-4358-b10e-7998fb857387\") " pod="openshift-must-gather-nkxzt/perf-node-gather-daemonset-5bkmj"
Sep 15 12:07:23.900457 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:23.900442    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7f0cf187-5dfc-4358-b10e-7998fb857387-lib-modules\") pod \"perf-node-gather-daemonset-5bkmj\" (UID: \"7f0cf187-5dfc-4358-b10e-7998fb857387\") " pod="openshift-must-gather-nkxzt/perf-node-gather-daemonset-5bkmj"
Sep 15 12:07:23.900598 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:23.900583    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7f0cf187-5dfc-4358-b10e-7998fb857387-proc\") pod \"perf-node-gather-daemonset-5bkmj\" (UID: \"7f0cf187-5dfc-4358-b10e-7998fb857387\") " pod="openshift-must-gather-nkxzt/perf-node-gather-daemonset-5bkmj"
Sep 15 12:07:23.915423 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:23.915381    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxmfl\" (UniqueName: \"kubernetes.io/projected/7f0cf187-5dfc-4358-b10e-7998fb857387-kube-api-access-kxmfl\") pod \"perf-node-gather-daemonset-5bkmj\" (UID: \"7f0cf187-5dfc-4358-b10e-7998fb857387\") " pod="openshift-must-gather-nkxzt/perf-node-gather-daemonset-5bkmj"
Sep 15 12:07:24.071290 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:24.071238    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nkxzt/perf-node-gather-daemonset-5bkmj"
Sep 15 12:07:24.364440 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:24.364390    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nkxzt/perf-node-gather-daemonset-5bkmj"]
Sep 15 12:07:24.913692 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:24.913615    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nkxzt/perf-node-gather-daemonset-5bkmj" event={"ID":"7f0cf187-5dfc-4358-b10e-7998fb857387","Type":"ContainerStarted","Data":"a61b731ef0626af72168212accae178378f53d33afcf98852b54e2f30ad7bb93"}
Sep 15 12:07:24.914190 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:24.913729    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nkxzt/perf-node-gather-daemonset-5bkmj" event={"ID":"7f0cf187-5dfc-4358-b10e-7998fb857387","Type":"ContainerStarted","Data":"fe9c8bba021237947018c80dab1f3c82fd04a496df663514256877e12d976316"}
Sep 15 12:07:24.914190 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:24.913784    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nkxzt/perf-node-gather-daemonset-5bkmj"
Sep 15 12:07:25.863013 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:25.862981    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-m847l_c39f60d8-e16b-4c73-bacf-a5702c57c76e/dns/0.log"
Sep 15 12:07:25.883538 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:25.883511    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-m847l_c39f60d8-e16b-4c73-bacf-a5702c57c76e/kube-rbac-proxy/0.log"
Sep 15 12:07:25.908636 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:25.908603    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-26srz_6145cbf4-342d-4e4d-a322-2fc77d67553a/dns-node-resolver/0.log"
Sep 15 12:07:26.521756 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:26.521721    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t82xl_000e6b60-7f5f-4af5-9e06-31a6cd4d8ef4/node-ca/0.log"
Sep 15 12:07:27.471380 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:27.471343    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c_6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad/istio-proxy/0.log"
Sep 15 12:07:28.334887 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:28.334858    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79674675df-ptdl6_a3719401-4dc0-4e1c-b3b7-f669615eb88a/kube-auth-proxy/0.log"
Sep 15 12:07:28.438003 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:28.437970    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-bp6jm_0f637e00-1499-422e-8d72-e7a5504bac92/payload-processing/0.log"
Sep 15 12:07:29.361568 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:29.361530    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-26xwb_329235b6-5a87-40ce-a572-98c3f16101d5/serve-healthcheck-canary/0.log"
Sep 15 12:07:29.913407 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:29.913380    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mzz6r_098e3803-ccda-43ed-9c4b-27b03842d8bd/kube-rbac-proxy/0.log"
Sep 15 12:07:29.933187 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:29.933146    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mzz6r_098e3803-ccda-43ed-9c4b-27b03842d8bd/exporter/0.log"
Sep 15 12:07:29.954991 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:29.954959    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mzz6r_098e3803-ccda-43ed-9c4b-27b03842d8bd/extractor/0.log"
Sep 15 12:07:30.936407 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:30.935188    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nkxzt/perf-node-gather-daemonset-5bkmj"
Sep 15 12:07:30.955264 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:30.955209    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nkxzt/perf-node-gather-daemonset-5bkmj" podStartSLOduration=7.955189194 podStartE2EDuration="7.955189194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:07:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:07:24.934883731 +0000 UTC m=+2515.361214319" watchObservedRunningTime="2026-09-15 12:07:30.955189194 +0000 UTC m=+2521.381519789"
Sep 15 12:07:32.794255 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:32.794226    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-fw6nx_80f17fda-ba80-4ed4-a42c-658bb39be158/server/0.log"
Sep 15 12:07:32.910684 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:32.910331    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-st8kl_6ead0d0d-537c-4283-9bba-be92cb669493/manager/0.log"
Sep 15 12:07:32.936788 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:32.936734    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b96c7c888-9nzmj_66140c79-49a9-451d-8815-727ceed5f655/manager/0.log"
Sep 15 12:07:32.958072 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:32.958035    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b96c7c888-9nzmj_66140c79-49a9-451d-8815-727ceed5f655/copy-manifests/0.log"
Sep 15 12:07:34.478441 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:34.478387    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-667dbb5fb5-527sq_05797d60-711b-46cf-b919-2b0550863e05/manager/0.log"
Sep 15 12:07:34.532650 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:34.532616    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-tmdsq_ee5b51cf-50e5-4288-8b9f-c45ea8dcff77/openshift-lws-operator/0.log"
Sep 15 12:07:34.639003 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:34.638968    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c_6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad/istio-proxy/0.log"
Sep 15 12:07:35.505507 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:35.505483    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79674675df-ptdl6_a3719401-4dc0-4e1c-b3b7-f669615eb88a/kube-auth-proxy/0.log"
Sep 15 12:07:35.591158 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:35.591117    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-bp6jm_0f637e00-1499-422e-8d72-e7a5504bac92/payload-processing/0.log"
Sep 15 12:07:37.119795 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:37.119768    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c_6e5ad2d8-2523-4e84-a32f-3cc9eb2afdad/istio-proxy/0.log"
Sep 15 12:07:38.050057 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:38.050020    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79674675df-ptdl6_a3719401-4dc0-4e1c-b3b7-f669615eb88a/kube-auth-proxy/0.log"
Sep 15 12:07:38.145159 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:38.145123    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-bp6jm_0f637e00-1499-422e-8d72-e7a5504bac92/payload-processing/0.log"
Sep 15 12:07:41.649710 ip-10-0-132-240 kubenswrapper[2575]: I0915 12:07:41.649671    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4dmcz_8c04ca25-e153-4f97-89db-aba1b15106bb/kube-multus/0.log"