Sep 08 03:58:34.565329 ip-10-0-143-35 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 08 03:58:34.565340 ip-10-0-143-35 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 08 03:58:34.565350 ip-10-0-143-35 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 08 03:58:34.565542 ip-10-0-143-35 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 08 03:58:44.654498 ip-10-0-143-35 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 08 03:58:44.654514 ip-10-0-143-35 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot af95f577b7e7493690c7e7cf8fe12beb --
Sep 08 04:00:40.096817 ip-10-0-143-35 systemd[1]: Starting Kubernetes Kubelet...
Sep 08 04:00:40.455857 ip-10-0-143-35 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 04:00:40.455857 ip-10-0-143-35 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 08 04:00:40.455857 ip-10-0-143-35 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 04:00:40.455857 ip-10-0-143-35 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 08 04:00:40.455857 ip-10-0-143-35 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 04:00:40.457412 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.457331    2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 08 04:00:40.462496 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462472    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 04:00:40.462496 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462490    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 04:00:40.462496 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462496    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 04:00:40.462496 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462499    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 04:00:40.462496 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462502    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 04:00:40.462709 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462508    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 04:00:40.462709 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462513    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 04:00:40.462709 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462516    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 04:00:40.462709 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462519    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 04:00:40.462709 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462522    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 04:00:40.462709 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462525    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 04:00:40.462709 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462527    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 04:00:40.462709 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462530    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 04:00:40.462709 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462533    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 04:00:40.462709 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462535    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 04:00:40.462709 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462538    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 04:00:40.462709 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462540    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 04:00:40.462709 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462543    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 04:00:40.462709 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462547    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 04:00:40.462709 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462550    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 04:00:40.462709 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462566    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 04:00:40.462709 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462569    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 04:00:40.462709 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462572    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 04:00:40.462709 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462576    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 04:00:40.463166 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462579    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 04:00:40.463166 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462582    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 04:00:40.463166 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462585    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 04:00:40.463166 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462589    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 04:00:40.463166 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462592    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 04:00:40.463166 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462594    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 04:00:40.463166 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462597    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 04:00:40.463166 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462600    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 04:00:40.463166 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462603    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 04:00:40.463166 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462605    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 04:00:40.463166 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462608    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 04:00:40.463166 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462610    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 04:00:40.463166 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462613    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 04:00:40.463166 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462615    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 04:00:40.463166 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462619    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 04:00:40.463166 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462624    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 04:00:40.463166 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462627    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 04:00:40.463166 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462630    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 04:00:40.463166 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462632    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 04:00:40.463681 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462635    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 04:00:40.463681 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462637    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 04:00:40.463681 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462640    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 04:00:40.463681 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462642    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 04:00:40.463681 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462645    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 04:00:40.463681 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462647    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 04:00:40.463681 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462650    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 04:00:40.463681 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462660    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 04:00:40.463681 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462663    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 04:00:40.463681 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462665    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 04:00:40.463681 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462667    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 04:00:40.463681 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462670    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 04:00:40.463681 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462672    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 04:00:40.463681 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462675    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 04:00:40.463681 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462678    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 04:00:40.463681 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462680    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 04:00:40.463681 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462683    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 04:00:40.463681 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462686    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 04:00:40.463681 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462689    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 04:00:40.463681 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462691    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 04:00:40.464171 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462694    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 04:00:40.464171 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462697    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 04:00:40.464171 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462699    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 04:00:40.464171 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462701    2573 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 04:00:40.464171 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462704    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 04:00:40.464171 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462706    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 04:00:40.464171 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462709    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 04:00:40.464171 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462712    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 04:00:40.464171 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462715    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 04:00:40.464171 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462718    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 04:00:40.464171 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462720    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 04:00:40.464171 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462723    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 04:00:40.464171 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462725    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 04:00:40.464171 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462728    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 04:00:40.464171 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462730    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 04:00:40.464171 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462732    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 04:00:40.464171 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462736    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 04:00:40.464171 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462739    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 04:00:40.464171 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462741    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 04:00:40.464171 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462744    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 04:00:40.464657 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462754    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 04:00:40.464657 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462757    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 04:00:40.464657 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462759    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 04:00:40.464657 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462762    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 04:00:40.464657 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462764    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 04:00:40.464657 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462767    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 04:00:40.464657 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462769    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 04:00:40.464657 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462772    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 04:00:40.464657 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462775    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 04:00:40.464657 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462777    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 04:00:40.464657 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462779    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 04:00:40.464657 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462782    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 04:00:40.464657 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462784    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 04:00:40.464657 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462786    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 04:00:40.464657 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462790    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 04:00:40.464657 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.462792    2573 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 04:00:40.464657 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463502    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 04:00:40.464657 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463509    2573 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 04:00:40.464657 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463511    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 04:00:40.464657 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463514    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 04:00:40.465133 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463517    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 04:00:40.465133 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463520    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 04:00:40.465133 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463522    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 04:00:40.465133 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463525    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 04:00:40.465133 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463527    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 04:00:40.465133 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463530    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 04:00:40.465133 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463533    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 04:00:40.465133 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463535    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 04:00:40.465133 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463538    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 04:00:40.465133 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463540    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 04:00:40.465133 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463543    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 04:00:40.465133 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463545    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 04:00:40.465133 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463547    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 04:00:40.465133 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463573    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 04:00:40.465133 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463577    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 04:00:40.465133 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463580    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 04:00:40.465133 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463582    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 04:00:40.465133 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463585    2573 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 04:00:40.465133 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463587    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 04:00:40.465133 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463590    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 04:00:40.465634 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463592    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 04:00:40.465634 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463595    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 04:00:40.465634 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463597    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 04:00:40.465634 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463600    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 04:00:40.465634 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463603    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 04:00:40.465634 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463605    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 04:00:40.465634 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463608    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 04:00:40.465634 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463611    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 04:00:40.465634 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463613    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 04:00:40.465634 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463616    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 04:00:40.465634 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463619    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 04:00:40.465634 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463622    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 04:00:40.465634 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463625    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 04:00:40.465634 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463627    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 04:00:40.465634 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463630    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 04:00:40.465634 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463632    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 04:00:40.465634 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463635    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 04:00:40.465634 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463637    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 04:00:40.465634 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463640    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 04:00:40.465634 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463642    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 04:00:40.466136 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463645    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 04:00:40.466136 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463647    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 04:00:40.466136 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463649    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 04:00:40.466136 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463653    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 04:00:40.466136 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463655    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 04:00:40.466136 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463658    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 04:00:40.466136 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463666    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 04:00:40.466136 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463669    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 04:00:40.466136 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463671    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 04:00:40.466136 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463674    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 04:00:40.466136 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463678    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 04:00:40.466136 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463681    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 04:00:40.466136 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463685    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 04:00:40.466136 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463688    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 04:00:40.466136 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463691    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 04:00:40.466136 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463693    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 04:00:40.466136 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463696    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 04:00:40.466136 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463699    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 04:00:40.466136 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463702    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 04:00:40.466664 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463706    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 04:00:40.466664 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463709    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 04:00:40.466664 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463712    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 04:00:40.466664 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463715    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 04:00:40.466664 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463719    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 04:00:40.466664 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463722    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 04:00:40.466664 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463725    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 04:00:40.466664 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463727    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 04:00:40.466664 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463730    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 04:00:40.466664 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463733    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 04:00:40.466664 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463736    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 04:00:40.466664 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463739    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 04:00:40.466664 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463742    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 04:00:40.466664 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463744    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 04:00:40.466664 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463747    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 04:00:40.466664 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463749    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 04:00:40.466664 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463752    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 04:00:40.466664 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463754    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 04:00:40.466664 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463756    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 04:00:40.466664 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463759    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 04:00:40.467148 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463767    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 04:00:40.467148 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463770    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 04:00:40.467148 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463772    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 04:00:40.467148 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463775    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 04:00:40.467148 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463777    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 04:00:40.467148 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463780    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 04:00:40.467148 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463782    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 04:00:40.467148 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463785    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 04:00:40.467148 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463787    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 04:00:40.467148 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463789    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 04:00:40.467148 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463792    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 04:00:40.467148 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463796    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 04:00:40.467148 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463800    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 04:00:40.467148 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463803    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 04:00:40.467148 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463806    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 04:00:40.467148 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.463809    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 04:00:40.467148 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464182    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 04:00:40.467148 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464187    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 04:00:40.467148 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464190    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 04:00:40.467148 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464192    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 04:00:40.467644 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464195    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 04:00:40.467644 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464198    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 04:00:40.467644 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464200    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 04:00:40.467644 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464203    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 04:00:40.467644 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464206    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 04:00:40.467644 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464208    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 04:00:40.467644 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464211    2573 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 04:00:40.467644 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464214    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 04:00:40.467644 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464216    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 04:00:40.467644 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464219    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 04:00:40.467644 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464221    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 04:00:40.467644 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464224    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 04:00:40.467644 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464227    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 04:00:40.467644 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464229    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 04:00:40.467644 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464232    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 04:00:40.467644 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464234    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 04:00:40.467644 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464236    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 04:00:40.467644 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464239    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 04:00:40.467644 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464241    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 04:00:40.467644 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464244    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 04:00:40.468127 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464246    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 04:00:40.468127 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464248    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 04:00:40.468127 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464251    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 04:00:40.468127 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464254    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 04:00:40.468127 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464256    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 04:00:40.468127 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464259    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 04:00:40.468127 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464263    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 04:00:40.468127 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464266    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 04:00:40.468127 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464269    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 04:00:40.468127 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464272    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 04:00:40.468127 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464275    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 04:00:40.468127 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464278    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 04:00:40.468127 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464281    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 04:00:40.468127 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464284    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 04:00:40.468127 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464287    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 04:00:40.468127 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464290    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 04:00:40.468127 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464293    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 04:00:40.468127 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464295    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 04:00:40.468127 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464298    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 04:00:40.468127 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464300    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 04:00:40.468620 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464302    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 04:00:40.468620 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464305    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 04:00:40.468620 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464308    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 04:00:40.468620 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464310    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 04:00:40.468620 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464312    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 04:00:40.468620 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464315    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 04:00:40.468620 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464318    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 04:00:40.468620 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464320    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 04:00:40.468620 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464323    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 04:00:40.468620 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464325    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 04:00:40.468620 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464328    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 04:00:40.468620 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464330    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 04:00:40.468620 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464333    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 04:00:40.468620 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464336    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 04:00:40.468620 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464338    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 04:00:40.468620 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464341    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 04:00:40.468620 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464344    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 04:00:40.468620 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464346    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 04:00:40.468620 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464348    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 04:00:40.468620 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464351    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 04:00:40.469098 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464353    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 04:00:40.469098 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464356    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 04:00:40.469098 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464358    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 04:00:40.469098 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464361    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 04:00:40.469098 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464364    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 04:00:40.469098 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464368    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 04:00:40.469098 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464371    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 04:00:40.469098 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464373    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 04:00:40.469098 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464375    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 04:00:40.469098 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464378    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 04:00:40.469098 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464381    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 04:00:40.469098 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464383    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 04:00:40.469098 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464386    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 04:00:40.469098 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464390    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 04:00:40.469098 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464393    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 04:00:40.469098 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464395    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 04:00:40.469098 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464398    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 04:00:40.469098 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464400    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 04:00:40.469098 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464404    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 04:00:40.469549 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464406    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 04:00:40.469549 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464408    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 04:00:40.469549 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464411    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 04:00:40.469549 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464413    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 04:00:40.469549 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464415    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 04:00:40.469549 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464418    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 04:00:40.469549 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464420    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 04:00:40.469549 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464423    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 04:00:40.469549 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464426    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 04:00:40.469549 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464428    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 04:00:40.469549 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464431    2573 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 04:00:40.469549 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464433    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 04:00:40.469549 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464436    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 04:00:40.469549 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464438    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 04:00:40.469549 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464440    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 04:00:40.469549 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.464443    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 04:00:40.469549 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464514    2573 flags.go:64] FLAG: --address="0.0.0.0"
Sep 08 04:00:40.469549 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464546    2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 08 04:00:40.469549 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464571    2573 flags.go:64] FLAG: --anonymous-auth="true"
Sep 08 04:00:40.469549 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464576    2573 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 08 04:00:40.469549 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464580    2573 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 08 04:00:40.470065 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464583    2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 08 04:00:40.470065 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464587    2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 08 04:00:40.470065 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464591    2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 08 04:00:40.470065 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464594    2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 08 04:00:40.470065 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464597    2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 08 04:00:40.470065 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464601    2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 08 04:00:40.470065 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464604    2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 08 04:00:40.470065 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464607    2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 08 04:00:40.470065 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464610    2573 flags.go:64] FLAG: --cgroup-root=""
Sep 08 04:00:40.470065 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464612    2573 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 08 04:00:40.470065 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464615    2573 flags.go:64] FLAG: --client-ca-file=""
Sep 08 04:00:40.470065 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464619    2573 flags.go:64] FLAG: --cloud-provider="external"
Sep 08 04:00:40.470065 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464622    2573 flags.go:64] FLAG: --cluster-dns="[]"
Sep 08 04:00:40.470065 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464625    2573 flags.go:64] FLAG: --cluster-domain=""
Sep 08 04:00:40.470065 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464628    2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 08 04:00:40.470065 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464631    2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 08 04:00:40.470065 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464635    2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 08 04:00:40.470065 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464638    2573 flags.go:64] FLAG: --container-log-max-files="5"
Sep 08 04:00:40.470065 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464642    2573 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 08 04:00:40.470065 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464644    2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 08 04:00:40.470065 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464647    2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 08 04:00:40.470065 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464650    2573 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 08 04:00:40.470065 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464653    2573 flags.go:64] FLAG: --contention-profiling="false"
Sep 08 04:00:40.470065 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464656    2573 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 08 04:00:40.470657 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464659    2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 08 04:00:40.470657 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464662    2573 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 08 04:00:40.470657 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464665    2573 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 08 04:00:40.470657 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464669    2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 08 04:00:40.470657 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464672    2573 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 08 04:00:40.470657 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464675    2573 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 08 04:00:40.470657 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464678    2573 flags.go:64] FLAG: --enable-load-reader="false"
Sep 08 04:00:40.470657 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464681    2573 flags.go:64] FLAG: --enable-server="true"
Sep 08 04:00:40.470657 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464683    2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 08 04:00:40.470657 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464688    2573 flags.go:64] FLAG: --event-burst="100"
Sep 08 04:00:40.470657 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464691    2573 flags.go:64] FLAG: --event-qps="50"
Sep 08 04:00:40.470657 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464693    2573 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 08 04:00:40.470657 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464696    2573 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 08 04:00:40.470657 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464699    2573 flags.go:64] FLAG: --eviction-hard=""
Sep 08 04:00:40.470657 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464703    2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 08 04:00:40.470657 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464705    2573 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 08 04:00:40.470657 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464708    2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 08 04:00:40.470657 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464711    2573 flags.go:64] FLAG: --eviction-soft=""
Sep 08 04:00:40.470657 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464714    2573 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 08 04:00:40.470657 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464716    2573 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 08 04:00:40.470657 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464720    2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 08 04:00:40.470657 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464722    2573 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 08 04:00:40.470657 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464725    2573 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 08 04:00:40.470657 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464728    2573 flags.go:64] FLAG: --fail-swap-on="true"
Sep 08 04:00:40.470657 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464731    2573 flags.go:64] FLAG: --feature-gates=""
Sep 08 04:00:40.471307 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464734    2573 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 08 04:00:40.471307 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464739    2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 08 04:00:40.471307 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464742    2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 08 04:00:40.471307 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464745    2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 08 04:00:40.471307 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464748    2573 flags.go:64] FLAG: --healthz-port="10248"
Sep 08 04:00:40.471307 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464751    2573 flags.go:64] FLAG: --help="false"
Sep 08 04:00:40.471307 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464754    2573 flags.go:64] FLAG: --hostname-override="ip-10-0-143-35.ec2.internal"
Sep 08 04:00:40.471307 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464757    2573 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 08 04:00:40.471307 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464760    2573 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 08 04:00:40.471307 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464762    2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 08 04:00:40.471307 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464765    2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 08 04:00:40.471307 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464768    2573 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 08 04:00:40.471307 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464771    2573 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 08 04:00:40.471307 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464774    2573 flags.go:64] FLAG: --image-service-endpoint=""
Sep 08 04:00:40.471307 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464777    2573 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 08 04:00:40.471307 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464779    2573 flags.go:64] FLAG: --kube-api-burst="100"
Sep 08 04:00:40.471307 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464782    2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 08 04:00:40.471307 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464785    2573 flags.go:64] FLAG: --kube-api-qps="50"
Sep 08 04:00:40.471307 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464787    2573 flags.go:64] FLAG: --kube-reserved=""
Sep 08 04:00:40.471307 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464790    2573 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 08 04:00:40.471307 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464793    2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 08 04:00:40.471307 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464796    2573 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 08 04:00:40.471307 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464798    2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 08 04:00:40.471307 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464801    2573 flags.go:64] FLAG: --lock-file=""
Sep 08 04:00:40.471939 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464804    2573 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 08 04:00:40.471939 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464806    2573 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 08 04:00:40.471939 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464809    2573 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 08 04:00:40.471939 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464814    2573 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 08 04:00:40.471939 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464817    2573 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 08 04:00:40.471939 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464820    2573 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 08 04:00:40.471939 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464823    2573 flags.go:64] FLAG: --logging-format="text"
Sep 08 04:00:40.471939 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464827    2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 08 04:00:40.471939 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464831    2573 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 08 04:00:40.471939 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464834    2573 flags.go:64] FLAG: --manifest-url=""
Sep 08 04:00:40.471939 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464837    2573 flags.go:64] FLAG: --manifest-url-header=""
Sep 08 04:00:40.471939 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464841    2573 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 08 04:00:40.471939 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464844    2573 flags.go:64] FLAG: --max-open-files="1000000"
Sep 08 04:00:40.471939 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464848    2573 flags.go:64] FLAG: --max-pods="110"
Sep 08 04:00:40.471939 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464851    2573 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 08 04:00:40.471939 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464854    2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 08 04:00:40.471939 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464857    2573 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 08 04:00:40.471939 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464860    2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 08 04:00:40.471939 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464862    2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 08 04:00:40.471939 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464865    2573 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 08 04:00:40.471939 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464868    2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 08 04:00:40.471939 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464875    2573 flags.go:64] FLAG: --node-status-max-images="50"
Sep 08 04:00:40.471939 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464877    2573 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 08 04:00:40.471939 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464880    2573 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 08 04:00:40.471939 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464883    2573 flags.go:64] FLAG: --pod-cidr=""
Sep 08 04:00:40.472538 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464886    2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 08 04:00:40.472538 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464891    2573 flags.go:64] FLAG: --pod-manifest-path=""
Sep 08 04:00:40.472538 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464894    2573 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 08 04:00:40.472538 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464897    2573 flags.go:64] FLAG: --pods-per-core="0"
Sep 08 04:00:40.472538 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464899    2573 flags.go:64] FLAG: --port="10250"
Sep 08 04:00:40.472538 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464902    2573 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 08 04:00:40.472538 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464905    2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-032ad420f18600365"
Sep 08 04:00:40.472538 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464908    2573 flags.go:64] FLAG: --qos-reserved=""
Sep 08 04:00:40.472538 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464910    2573 flags.go:64] FLAG: --read-only-port="10255"
Sep 08 04:00:40.472538 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464913    2573 flags.go:64] FLAG: --register-node="true"
Sep 08 04:00:40.472538 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464916    2573 flags.go:64] FLAG: --register-with-taints=""
Sep 08 04:00:40.472538 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464920    2573 flags.go:64] FLAG: --registry-burst="10"
Sep 08 04:00:40.472538 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464923    2573 flags.go:64] FLAG: --registry-qps="5"
Sep 08 04:00:40.472538 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464925    2573 flags.go:64] FLAG: --reserved-cpus=""
Sep 08 04:00:40.472538 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464930    2573 flags.go:64] FLAG: --reserved-memory=""
Sep 08 04:00:40.472538 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464934    2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 08 04:00:40.472538 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464937    2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 08 04:00:40.472538 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464941    2573 flags.go:64] FLAG: --rotate-certificates="false"
Sep 08 04:00:40.472538 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464944    2573 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 08 04:00:40.472538 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464947    2573 flags.go:64] FLAG: --runonce="false"
Sep 08 04:00:40.472538 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464949    2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 08 04:00:40.472538 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464952    2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 08 04:00:40.472538 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464955    2573 flags.go:64] FLAG: --seccomp-default="false"
Sep 08 04:00:40.472538 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464958    2573 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 08 04:00:40.472538 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464961    2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 08 04:00:40.473148 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464964    2573 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 08 04:00:40.473148 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464966    2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 08 04:00:40.473148 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464969    2573 flags.go:64] FLAG: --storage-driver-password="root"
Sep 08 04:00:40.473148 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464972    2573 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 08 04:00:40.473148 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464974    2573 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 08 04:00:40.473148 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464977    2573 flags.go:64] FLAG: --storage-driver-user="root"
Sep 08 04:00:40.473148 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464980    2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 08 04:00:40.473148 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464982    2573 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 08 04:00:40.473148 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464985    2573 flags.go:64] FLAG: --system-cgroups=""
Sep 08 04:00:40.473148 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464988    2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 08 04:00:40.473148 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464993    2573 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 08 04:00:40.473148 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464995    2573 flags.go:64] FLAG: --tls-cert-file=""
Sep 08 04:00:40.473148 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.464998    2573 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 08 04:00:40.473148 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.465002    2573 flags.go:64] FLAG: --tls-min-version=""
Sep 08 04:00:40.473148 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.465004    2573 flags.go:64] FLAG: --tls-private-key-file=""
Sep 08 04:00:40.473148 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.465006    2573 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 08 04:00:40.473148 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.465009    2573 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 08 04:00:40.473148 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.465012    2573 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 08 04:00:40.473148 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.465015    2573 flags.go:64] FLAG: --v="2"
Sep 08 04:00:40.473148 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.465018    2573 flags.go:64] FLAG: --version="false"
Sep 08 04:00:40.473148 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.465023    2573 flags.go:64] FLAG: --vmodule=""
Sep 08 04:00:40.473148 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.465027    2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 08 04:00:40.473148 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.465031    2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 08 04:00:40.473148 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465158    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 04:00:40.473148 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465164    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 04:00:40.473760 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465167    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 04:00:40.473760 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465170    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 04:00:40.473760 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465172    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 04:00:40.473760 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465175    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 04:00:40.473760 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465178    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 04:00:40.473760 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465180    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 04:00:40.473760 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465183    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 04:00:40.473760 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465186    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 04:00:40.473760 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465188    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 04:00:40.473760 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465190    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 04:00:40.473760 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465193    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 04:00:40.473760 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465195    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 04:00:40.473760 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465198    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 04:00:40.473760 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465200    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 04:00:40.473760 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465203    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 04:00:40.473760 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465205    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 04:00:40.473760 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465207    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 04:00:40.473760 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465210    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 04:00:40.473760 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465212    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 04:00:40.473760 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465214    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 04:00:40.474262 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465217    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 04:00:40.474262 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465219    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 04:00:40.474262 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465222    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 04:00:40.474262 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465224    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 04:00:40.474262 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465226    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 04:00:40.474262 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465229    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 04:00:40.474262 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465232    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 04:00:40.474262 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465236    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 04:00:40.474262 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465241    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 04:00:40.474262 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465244    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 04:00:40.474262 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465247    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 04:00:40.474262 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465251    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 04:00:40.474262 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465254    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 04:00:40.474262 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465256    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 04:00:40.474262 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465259    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 04:00:40.474262 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465262    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 04:00:40.474262 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465264    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 04:00:40.474262 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465267    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 04:00:40.474262 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465269    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 04:00:40.474738 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465271    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 04:00:40.474738 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465274    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 04:00:40.474738 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465277    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 04:00:40.474738 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465279    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 04:00:40.474738 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465282    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 04:00:40.474738 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465284    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 04:00:40.474738 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465287    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 04:00:40.474738 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465289    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 04:00:40.474738 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465292    2573 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 04:00:40.474738 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465294    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 04:00:40.474738 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465297    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 04:00:40.474738 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465299    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 04:00:40.474738 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465301    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 04:00:40.474738 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465304    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 04:00:40.474738 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465306    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 04:00:40.474738 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465309    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 04:00:40.474738 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465311    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 04:00:40.474738 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465314    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 04:00:40.474738 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465316    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 04:00:40.474738 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465319    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 04:00:40.475226 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465321    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 04:00:40.475226 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465325    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 04:00:40.475226 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465328    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 04:00:40.475226 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465331    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 04:00:40.475226 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465334    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 04:00:40.475226 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465337    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 04:00:40.475226 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465339    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 04:00:40.475226 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465342    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 04:00:40.475226 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465344    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 04:00:40.475226 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465347    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 04:00:40.475226 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465350    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 04:00:40.475226 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465352    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 04:00:40.475226 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465355    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 04:00:40.475226 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465358    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 04:00:40.475226 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465362    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 04:00:40.475226 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465365    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 04:00:40.475226 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465369    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 04:00:40.475226 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465373    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 04:00:40.475226 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465376    2573 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 04:00:40.475226 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465378    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 04:00:40.475826 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465380    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 04:00:40.475826 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465383    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 04:00:40.475826 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465385    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 04:00:40.475826 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465388    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 04:00:40.475826 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465390    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 04:00:40.475826 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465393    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 04:00:40.475826 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465395    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 04:00:40.475826 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465397    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 04:00:40.475826 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465400    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 04:00:40.475826 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465404    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 04:00:40.475826 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465407    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 04:00:40.475826 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465410    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 04:00:40.475826 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465412    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 04:00:40.475826 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465416    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 04:00:40.475826 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465418    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 04:00:40.475826 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465422    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 04:00:40.475826 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465426    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 04:00:40.475826 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.465430    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 04:00:40.476285 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.465989    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 04:00:40.476285 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.473404    2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 08 04:00:40.476285 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.473420    2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 08 04:00:40.476285 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.473437    2573 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 08 04:00:40.476285 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.473442    2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 08 04:00:40.476285 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473497    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 04:00:40.476285 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473503    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 04:00:40.476285 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473506    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 04:00:40.476285 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473511    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 04:00:40.476285 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473515    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 04:00:40.476285 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473518    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 04:00:40.476285 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473521    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 04:00:40.476285 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473524    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 04:00:40.476285 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473527    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 04:00:40.476649 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473530    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 04:00:40.476649 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473532    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 04:00:40.476649 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473535    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 04:00:40.476649 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473538    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 04:00:40.476649 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473540    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 04:00:40.476649 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473543    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 04:00:40.476649 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473545    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 04:00:40.476649 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473548    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 04:00:40.476649 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473550    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 04:00:40.476649 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473573    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 04:00:40.476649 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473577    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 04:00:40.476649 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473580    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 04:00:40.476649 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473583    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 04:00:40.476649 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473585    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 04:00:40.476649 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473588    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 04:00:40.476649 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473591    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 04:00:40.476649 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473593    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 04:00:40.476649 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473596    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 04:00:40.476649 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473599    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 04:00:40.476649 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473602    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 04:00:40.477127 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473605    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 04:00:40.477127 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473608    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 04:00:40.477127 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473611    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 04:00:40.477127 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473614    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 04:00:40.477127 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473617    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 04:00:40.477127 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473619    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 04:00:40.477127 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473622    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 04:00:40.477127 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473624    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 04:00:40.477127 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473627    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 04:00:40.477127 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473629    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 04:00:40.477127 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473632    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 04:00:40.477127 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473634    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 04:00:40.477127 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473638    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 04:00:40.477127 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473642    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 04:00:40.477127 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473644    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 04:00:40.477127 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473647    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 04:00:40.477127 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473649    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 04:00:40.477127 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473652    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 04:00:40.477127 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473655    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 04:00:40.477592 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473657    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 04:00:40.477592 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473660    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 04:00:40.477592 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473662    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 04:00:40.477592 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473665    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 04:00:40.477592 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473667    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 04:00:40.477592 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473670    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 04:00:40.477592 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473672    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 04:00:40.477592 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473675    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 04:00:40.477592 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473678    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 04:00:40.477592 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473680    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 04:00:40.477592 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473682    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 04:00:40.477592 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473686    2573 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 04:00:40.477592 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473688    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 04:00:40.477592 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473691    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 04:00:40.477592 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473694    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 04:00:40.477592 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473697    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 04:00:40.477592 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473700    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 04:00:40.477592 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473702    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 04:00:40.477592 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473704    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 04:00:40.477592 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473707    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 04:00:40.478076 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473709    2573 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 04:00:40.478076 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473712    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 04:00:40.478076 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473728    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 04:00:40.478076 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473731    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 04:00:40.478076 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473735    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 04:00:40.478076 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473738    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 04:00:40.478076 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473741    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 04:00:40.478076 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473743    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 04:00:40.478076 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473746    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 04:00:40.478076 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473749    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 04:00:40.478076 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473752    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 04:00:40.478076 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473754    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 04:00:40.478076 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473757    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 04:00:40.478076 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473759    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 04:00:40.478076 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473762    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 04:00:40.478076 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473764    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 04:00:40.478076 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473767    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 04:00:40.478076 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473769    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 04:00:40.478076 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473772    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 04:00:40.478076 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473775    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 04:00:40.478646 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473777    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 04:00:40.478646 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473782    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 04:00:40.478646 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473785    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 04:00:40.478646 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473789    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 04:00:40.478646 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473792    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 04:00:40.478646 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473795    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 04:00:40.478646 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473798    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 04:00:40.478646 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473801    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 04:00:40.478646 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473804    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 04:00:40.478646 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473807    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 04:00:40.478646 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473810    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 04:00:40.478646 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.473815    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 04:00:40.478646 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473936    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 04:00:40.478990 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473941    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 04:00:40.478990 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473944    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 04:00:40.478990 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473947    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 04:00:40.478990 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473949    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 04:00:40.478990 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473952    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 04:00:40.478990 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473955    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 04:00:40.478990 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473957    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 04:00:40.478990 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473960    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 04:00:40.478990 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473963    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 04:00:40.478990 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473966    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 04:00:40.478990 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473970    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 04:00:40.478990 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473973    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 04:00:40.478990 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473975    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 04:00:40.478990 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473978    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 04:00:40.478990 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473981    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 04:00:40.478990 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473983    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 04:00:40.478990 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473986    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 04:00:40.478990 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473988    2573 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 04:00:40.478990 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473991    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 04:00:40.478990 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473993    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 04:00:40.479461 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473996    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 04:00:40.479461 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.473998    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 04:00:40.479461 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474001    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 04:00:40.479461 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474004    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 04:00:40.479461 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474007    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 04:00:40.479461 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474009    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 04:00:40.479461 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474012    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 04:00:40.479461 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474015    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 04:00:40.479461 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474018    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 04:00:40.479461 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474021    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 04:00:40.479461 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474024    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 04:00:40.479461 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474026    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 04:00:40.479461 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474028    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 04:00:40.479461 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474031    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 04:00:40.479461 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474033    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 04:00:40.479461 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474036    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 04:00:40.479461 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474039    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 04:00:40.479461 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474041    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 04:00:40.479461 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474043    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 04:00:40.479461 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474046    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 04:00:40.479979 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474048    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 04:00:40.479979 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474051    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 04:00:40.479979 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474066    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 04:00:40.479979 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474069    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 04:00:40.479979 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474074    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 04:00:40.479979 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474077    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 04:00:40.479979 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474081    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 04:00:40.479979 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474084    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 04:00:40.479979 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474087    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 04:00:40.479979 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474091    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 04:00:40.479979 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474094    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 04:00:40.479979 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474096    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 04:00:40.479979 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474099    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 04:00:40.479979 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474103    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 04:00:40.479979 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474105    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 04:00:40.479979 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474108    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 04:00:40.479979 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474111    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 04:00:40.479979 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474114    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 04:00:40.479979 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474116    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 04:00:40.480477 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474118    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 04:00:40.480477 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474121    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 04:00:40.480477 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474124    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 04:00:40.480477 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474126    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 04:00:40.480477 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474129    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 04:00:40.480477 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474131    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 04:00:40.480477 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474134    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 04:00:40.480477 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474136    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 04:00:40.480477 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474139    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 04:00:40.480477 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474141    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 04:00:40.480477 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474143    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 04:00:40.480477 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474146    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 04:00:40.480477 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474148    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 04:00:40.480477 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474151    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 04:00:40.480477 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474153    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 04:00:40.480477 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474156    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 04:00:40.480477 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474158    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 04:00:40.480477 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474160    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 04:00:40.480477 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474163    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 04:00:40.480477 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474165    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 04:00:40.480965 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474168    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 04:00:40.480965 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474170    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 04:00:40.480965 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474173    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 04:00:40.480965 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474175    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 04:00:40.480965 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474177    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 04:00:40.480965 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474187    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 04:00:40.480965 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474191    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 04:00:40.480965 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474193    2573 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 04:00:40.480965 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474196    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 04:00:40.480965 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474199    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 04:00:40.480965 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474201    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 04:00:40.480965 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474204    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 04:00:40.480965 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474207    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 04:00:40.480965 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474209    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 04:00:40.480965 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474219    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 04:00:40.480965 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474221    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 04:00:40.480965 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474224    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 04:00:40.480965 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474226    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 04:00:40.480965 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:40.474228    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 04:00:40.481552 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.474233    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 04:00:40.481552 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.474350    2573 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 08 04:00:40.481552 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.476403    2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 08 04:00:40.481552 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.477439    2573 server.go:1019] "Starting client certificate rotation"
Sep 08 04:00:40.481552 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.477550    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 04:00:40.481552 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.478262    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 04:00:40.481552 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.479788    2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 04:00:40.481552 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.481226    2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 04:00:40.492361 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.492342    2573 log.go:25] "Validated CRI v1 runtime API"
Sep 08 04:00:40.495655 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.495639    2573 log.go:25] "Validated CRI v1 image API"
Sep 08 04:00:40.496593 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.496577    2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 08 04:00:40.499391 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.499372    2573 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a0d92021-d951-4425-ba17-ed43f22e4c68:/dev/nvme0n1p3 c515508f-b621-41c7-a660-4655373308df:/dev/nvme0n1p4]
Sep 08 04:00:40.499450 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.499391    2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 08 04:00:40.504824 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.504713    2573 manager.go:216] Machine: {Timestamp:2026-09-08 04:00:40.503431435 +0000 UTC m=+0.288722664 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104315 MemoryCapacity:32812163072 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ee7e009233ab0184268cc43875113 SystemUUID:ec2ee7e0-0923-3ab0-1842-68cc43875113 BootID:af95f577-b7e7-4936-90c7-e7cf8fe12beb Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:59:f1:40:db:63 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:59:f1:40:db:63 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:aa:04:8f:80:a8:21 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812163072 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 08 04:00:40.504899 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.504824    2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 08 04:00:40.504931 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.504900    2573 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 08 04:00:40.507227 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.507203    2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 08 04:00:40.507365 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.507230    2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-35.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 08 04:00:40.508194 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.508184    2573 topology_manager.go:138] "Creating topology manager with none policy"
Sep 08 04:00:40.508232 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.508197    2573 container_manager_linux.go:309] "Creating device plugin manager"
Sep 08 04:00:40.508232 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.508204    2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 04:00:40.508842 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.508828    2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 04:00:40.508930 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.508917    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 04:00:40.510381 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.510369    2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 08 04:00:40.514042 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.514029    2573 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 04:00:40.514163 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.514153    2573 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 08 04:00:40.514207 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.514190    2573 kubelet.go:486] "Attempting to sync node with API server"
Sep 08 04:00:40.514207 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.514200    2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 08 04:00:40.514272 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.514214    2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 08 04:00:40.514272 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.514222    2573 kubelet.go:398] "Adding apiserver pod source"
Sep 08 04:00:40.514272 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.514231    2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 08 04:00:40.514621 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.514607    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 04:00:40.514691 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.514634    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 04:00:40.516475 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.516459    2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 08 04:00:40.518985 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.518962    2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 08 04:00:40.519034 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.519014    2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 08 04:00:40.519837 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.519826    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 08 04:00:40.519870 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.519843    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 08 04:00:40.519870 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.519849    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 08 04:00:40.519870 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.519854    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 08 04:00:40.519870 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.519862    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 08 04:00:40.519870 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.519867    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 08 04:00:40.520000 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.519880    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 08 04:00:40.520000 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.519885    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 08 04:00:40.520000 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.519891    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 08 04:00:40.520000 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.519896    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 08 04:00:40.520000 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.519904    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 08 04:00:40.520000 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.519909    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 08 04:00:40.520944 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.520930    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 08 04:00:40.521008 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.520949    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 08 04:00:40.524707 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.524692    2573 server.go:1268] "Started kubelet"
Sep 08 04:00:40.524917 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.524889    2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 08 04:00:40.525267 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.525088    2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 08 04:00:40.525483 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.525464    2573 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 08 04:00:40.525790 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.525774    2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-35.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 08 04:00:40.526035 ip-10-0-143-35 systemd[1]: Started Kubernetes Kubelet.
Sep 08 04:00:40.526460 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.526238    2573 server.go:310] "Adding debug handlers to kubelet server"
Sep 08 04:00:40.526460 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:40.526374    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 08 04:00:40.529051 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:40.528984    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-35.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 08 04:00:40.529782 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.529759    2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 08 04:00:40.530643 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:40.530618    2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 08 04:00:40.533519 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:40.532448    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-35.ec2.internal.18d33c8a0777c950  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-35.ec2.internal,UID:ip-10-0-143-35.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-35.ec2.internal,},FirstTimestamp:2026-09-08 04:00:40.52466312 +0000 UTC m=+0.309954353,LastTimestamp:2026-09-08 04:00:40.52466312 +0000 UTC m=+0.309954353,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-35.ec2.internal,}"
Sep 08 04:00:40.535778 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.535756    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 08 04:00:40.536289 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.536274    2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 08 04:00:40.536527 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:40.536375    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-35.ec2.internal\" not found"
Sep 08 04:00:40.537107 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.536886    2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 08 04:00:40.537158 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.537148    2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 08 04:00:40.537190 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.537162    2573 factory.go:55] Registering systemd factory
Sep 08 04:00:40.537190 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.537171    2573 factory.go:223] Registration of the systemd container factory successfully
Sep 08 04:00:40.537247 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.537238    2573 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 08 04:00:40.537284 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.537250    2573 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 08 04:00:40.537367 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.537354    2573 reconstruct.go:97] "Volume reconstruction finished"
Sep 08 04:00:40.537367 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.537364    2573 reconciler.go:29] "Reconciler: start to sync state"
Sep 08 04:00:40.537489 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.537427    2573 factory.go:153] Registering CRI-O factory
Sep 08 04:00:40.537489 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.537437    2573 factory.go:223] Registration of the crio container factory successfully
Sep 08 04:00:40.537489 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.537451    2573 factory.go:103] Registering Raw factory
Sep 08 04:00:40.537489 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.537466    2573 manager.go:1196] Started watching for new ooms in manager
Sep 08 04:00:40.537807 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.537795    2573 manager.go:349] Starting recovery of all containers
Sep 08 04:00:40.542028 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.541984    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-t8gf5"
Sep 08 04:00:40.542221 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:40.542197    2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-35.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 08 04:00:40.542350 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:40.542323    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 08 04:00:40.548473 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.548459    2573 manager.go:354] Recovery completed
Sep 08 04:00:40.551597 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.551580    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-t8gf5"
Sep 08 04:00:40.552664 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.552652    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 04:00:40.554206 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.554190    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-35.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 04:00:40.554257 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.554220    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-35.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 04:00:40.554257 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.554230    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-35.ec2.internal" event="NodeHasSufficientPID"
Sep 08 04:00:40.554748 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.554734    2573 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 08 04:00:40.554748 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.554747    2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 08 04:00:40.554857 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.554750    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 04:00:40.554857 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.554764    2573 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 04:00:40.555373 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.555358    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-35.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 04:00:40.555426 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.555384    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-35.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 04:00:40.555426 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.555393    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-35.ec2.internal" event="NodeHasSufficientPID"
Sep 08 04:00:40.555802 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.555791    2573 policy_none.go:49] "None policy: Start"
Sep 08 04:00:40.555835 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.555806    2573 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 08 04:00:40.555835 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.555816    2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 08 04:00:40.556262 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:40.556206    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-35.ec2.internal.18d33c8a093a9098  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-35.ec2.internal,UID:ip-10-0-143-35.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-35.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-35.ec2.internal,},FirstTimestamp:2026-09-08 04:00:40.554205336 +0000 UTC m=+0.339496563,LastTimestamp:2026-09-08 04:00:40.554205336 +0000 UTC m=+0.339496563,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-35.ec2.internal,}"
Sep 08 04:00:40.556739 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.556728    2573 policy_none.go:47] "Start"
Sep 08 04:00:40.594150 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.594135    2573 manager.go:337] "Starting Device Plugin manager"
Sep 08 04:00:40.610273 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:40.594170    2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 08 04:00:40.610273 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.594192    2573 server.go:87] "Starting device plugin registration server"
Sep 08 04:00:40.610273 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.594454    2573 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 08 04:00:40.610273 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.594466    2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 08 04:00:40.610273 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.594590    2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 08 04:00:40.610273 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.594672    2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 08 04:00:40.610273 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.594681    2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 08 04:00:40.610273 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:40.595096    2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 08 04:00:40.610273 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:40.595144    2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-35.ec2.internal\" not found"
Sep 08 04:00:40.666389 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.666364    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 08 04:00:40.667664 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.667650    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 08 04:00:40.667717 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.667694    2573 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 08 04:00:40.667768 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.667719    2573 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 08 04:00:40.667768 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:40.667752    2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 08 04:00:40.670422 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.670398    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 04:00:40.695391 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.695375    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 04:00:40.696169 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.696148    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-35.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 04:00:40.696257 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.696186    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-35.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 04:00:40.696257 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.696201    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-35.ec2.internal" event="NodeHasSufficientPID"
Sep 08 04:00:40.696257 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.696228    2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-35.ec2.internal"
Sep 08 04:00:40.705381 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.705366    2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-35.ec2.internal"
Sep 08 04:00:40.705444 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:40.705388    2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-35.ec2.internal\": node \"ip-10-0-143-35.ec2.internal\" not found"
Sep 08 04:00:40.723609 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:40.723549    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-35.ec2.internal\" not found"
Sep 08 04:00:40.768608 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.768586    2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-35.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-35.ec2.internal"]
Sep 08 04:00:40.768696 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.768652    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 04:00:40.771245 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.771231    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-35.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 04:00:40.771313 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.771258    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-35.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 04:00:40.771313 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.771267    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-35.ec2.internal" event="NodeHasSufficientPID"
Sep 08 04:00:40.772512 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.772500    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 04:00:40.772641 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.772616    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-35.ec2.internal"
Sep 08 04:00:40.772684 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.772647    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 04:00:40.773221 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.773205    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-35.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 04:00:40.773285 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.773231    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-35.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 04:00:40.773285 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.773245    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-35.ec2.internal" event="NodeHasSufficientPID"
Sep 08 04:00:40.773285 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.773249    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-35.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 04:00:40.773285 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.773267    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-35.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 04:00:40.773285 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.773278    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-35.ec2.internal" event="NodeHasSufficientPID"
Sep 08 04:00:40.774634 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.774619    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-35.ec2.internal"
Sep 08 04:00:40.774697 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.774655    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 04:00:40.775294 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.775273    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-35.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 04:00:40.775383 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.775307    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-35.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 04:00:40.775383 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.775321    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-35.ec2.internal" event="NodeHasSufficientPID"
Sep 08 04:00:40.800239 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:40.800216    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-35.ec2.internal\" not found" node="ip-10-0-143-35.ec2.internal"
Sep 08 04:00:40.804531 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:40.804514    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-35.ec2.internal\" not found" node="ip-10-0-143-35.ec2.internal"
Sep 08 04:00:40.824068 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:40.824050    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-35.ec2.internal\" not found"
Sep 08 04:00:40.839392 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.839370    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d382fa944d7c9206c91fe951106292d7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-35.ec2.internal\" (UID: \"d382fa944d7c9206c91fe951106292d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-35.ec2.internal"
Sep 08 04:00:40.839461 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.839395    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7f5a837540d716e426e6051c25aec9eb-config\") pod \"kube-apiserver-proxy-ip-10-0-143-35.ec2.internal\" (UID: \"7f5a837540d716e426e6051c25aec9eb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-35.ec2.internal"
Sep 08 04:00:40.839461 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.839414    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d382fa944d7c9206c91fe951106292d7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-35.ec2.internal\" (UID: \"d382fa944d7c9206c91fe951106292d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-35.ec2.internal"
Sep 08 04:00:40.924418 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:40.924398    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-35.ec2.internal\" not found"
Sep 08 04:00:40.940387 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.940366    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d382fa944d7c9206c91fe951106292d7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-35.ec2.internal\" (UID: \"d382fa944d7c9206c91fe951106292d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-35.ec2.internal"
Sep 08 04:00:40.940458 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.940390    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d382fa944d7c9206c91fe951106292d7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-35.ec2.internal\" (UID: \"d382fa944d7c9206c91fe951106292d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-35.ec2.internal"
Sep 08 04:00:40.940458 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.940405    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7f5a837540d716e426e6051c25aec9eb-config\") pod \"kube-apiserver-proxy-ip-10-0-143-35.ec2.internal\" (UID: \"7f5a837540d716e426e6051c25aec9eb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-35.ec2.internal"
Sep 08 04:00:40.940525 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.940473    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d382fa944d7c9206c91fe951106292d7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-35.ec2.internal\" (UID: \"d382fa944d7c9206c91fe951106292d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-35.ec2.internal"
Sep 08 04:00:40.940525 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.940482    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7f5a837540d716e426e6051c25aec9eb-config\") pod \"kube-apiserver-proxy-ip-10-0-143-35.ec2.internal\" (UID: \"7f5a837540d716e426e6051c25aec9eb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-35.ec2.internal"
Sep 08 04:00:40.940525 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:40.940485    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d382fa944d7c9206c91fe951106292d7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-35.ec2.internal\" (UID: \"d382fa944d7c9206c91fe951106292d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-35.ec2.internal"
Sep 08 04:00:41.024963 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:41.024910    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-35.ec2.internal\" not found"
Sep 08 04:00:41.103425 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:41.103397    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-35.ec2.internal"
Sep 08 04:00:41.108417 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:41.108402    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-35.ec2.internal"
Sep 08 04:00:41.125408 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:41.125382    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-35.ec2.internal\" not found"
Sep 08 04:00:41.226116 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:41.226089    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-35.ec2.internal\" not found"
Sep 08 04:00:41.326635 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:41.326569    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-35.ec2.internal\" not found"
Sep 08 04:00:41.427123 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:41.427097    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-35.ec2.internal\" not found"
Sep 08 04:00:41.477543 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:41.477521    2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 08 04:00:41.477926 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:41.477684    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 08 04:00:41.527612 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:41.527588    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-35.ec2.internal\" not found"
Sep 08 04:00:41.554037 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:41.554011    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-07 03:55:40 +0000 UTC" deadline="2028-06-10 20:53:49.46611394 +0000 UTC"
Sep 08 04:00:41.554037 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:41.554033    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15400h53m7.912083406s"
Sep 08 04:00:41.583840 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:41.583803    2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 04:00:41.636783 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:41.636754    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-35.ec2.internal"
Sep 08 04:00:41.648932 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:41.648914    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 04:00:41.650993 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:41.650979    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-35.ec2.internal"
Sep 08 04:00:41.659483 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:41.659466    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 04:00:41.732885 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:41.732856    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd382fa944d7c9206c91fe951106292d7.slice/crio-0f53ed5b803b0d2492e3b66a8cab2516db77b7a27158279a5dfb3e1404476a97 WatchSource:0}: Error finding container 0f53ed5b803b0d2492e3b66a8cab2516db77b7a27158279a5dfb3e1404476a97: Status 404 returned error can't find the container with id 0f53ed5b803b0d2492e3b66a8cab2516db77b7a27158279a5dfb3e1404476a97
Sep 08 04:00:41.738046 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:41.738034    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 04:00:41.992582 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:41.992502    2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 04:00:42.119386 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.119359    2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 04:00:42.442388 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.442306    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 04:00:42.515857 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.515825    2573 apiserver.go:52] "Watching apiserver"
Sep 08 04:00:42.527858 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.525867    2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 08 04:00:42.528348 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.528307    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-b7xw7","kube-system/kube-apiserver-proxy-ip-10-0-143-35.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k5tlp","openshift-cluster-node-tuning-operator/tuned-pxrmh","openshift-dns/node-resolver-zkwhq","openshift-multus/network-metrics-daemon-kw824","openshift-network-diagnostics/network-check-target-46n66","openshift-network-operator/iptables-alerter-hnhn5","kube-system/global-pull-secret-syncer-h6v7m","openshift-image-registry/node-ca-m2x6p","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-35.ec2.internal","openshift-multus/multus-additional-cni-plugins-6qplb","openshift-multus/multus-wmm7p","openshift-ovn-kubernetes/ovnkube-node-fcwwv"]
Sep 08 04:00:42.529999 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.529979    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46n66"
Sep 08 04:00:42.530120 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:42.530058    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46n66" podUID="15bf9e2a-b4c6-4c30-b7f2-8700093ee320"
Sep 08 04:00:42.531421 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.531398    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.532739 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.532703    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k5tlp"
Sep 08 04:00:42.534083 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.534060    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.534197 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.534156    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 08 04:00:42.534958 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.534939    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 08 04:00:42.535072 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.535022    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 08 04:00:42.535318 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.535304    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 08 04:00:42.535581 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.535565    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mkglr\""
Sep 08 04:00:42.535700 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.535663    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 08 04:00:42.535944 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.535923    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zkwhq"
Sep 08 04:00:42.536039 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.535966    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-t54rl\""
Sep 08 04:00:42.536039 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.535977    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 08 04:00:42.536410 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.536386    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 08 04:00:42.536501 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.536395    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 08 04:00:42.536560 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.536512    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 08 04:00:42.536647 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.536568    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 08 04:00:42.536955 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.536935    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ksnjb\""
Sep 08 04:00:42.537202 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.537185    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:00:42.537278 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:42.537257    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kw824" podUID="1082908b-13b3-42fe-952e-7512558aa436"
Sep 08 04:00:42.538287 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.538268    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:00:42.538382 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:42.538350    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6v7m" podUID="7446436d-a655-4644-91b2-d2071bf4e925"
Sep 08 04:00:42.538756 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.538739    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 08 04:00:42.538941 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.538921    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vkdrf\""
Sep 08 04:00:42.539037 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.538955    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 08 04:00:42.539849 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.539829    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-b7xw7"
Sep 08 04:00:42.541754 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.541501    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.542391 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.542369    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vsdrm\""
Sep 08 04:00:42.542673 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.542652    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 08 04:00:42.542778 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.542680    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 08 04:00:42.543676 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.543241    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m2x6p"
Sep 08 04:00:42.544177 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.544157    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 08 04:00:42.544881 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.544860    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 08 04:00:42.544981 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.544913    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 08 04:00:42.545088 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.545067    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hnhn5"
Sep 08 04:00:42.545256 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.545238    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 08 04:00:42.545373 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.545346    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wp875\""
Sep 08 04:00:42.545653 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.545610    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 08 04:00:42.546167 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.546147    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 08 04:00:42.546271 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.546242    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 08 04:00:42.546523 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.546504    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 08 04:00:42.546655 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.546587    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 08 04:00:42.546938 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.546919    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bxmpk\""
Sep 08 04:00:42.547026 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.546946    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6qplb"
Sep 08 04:00:42.547830 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.547801    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 08 04:00:42.548699 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.548678    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a5ee9428-69ae-4c66-ab69-9bfc87706f42-sys-fs\") pod \"aws-ebs-csi-driver-node-k5tlp\" (UID: \"a5ee9428-69ae-4c66-ab69-9bfc87706f42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k5tlp"
Sep 08 04:00:42.548790 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.548710    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp8mm\" (UniqueName: \"kubernetes.io/projected/a5ee9428-69ae-4c66-ab69-9bfc87706f42-kube-api-access-gp8mm\") pod \"aws-ebs-csi-driver-node-k5tlp\" (UID: \"a5ee9428-69ae-4c66-ab69-9bfc87706f42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k5tlp"
Sep 08 04:00:42.548790 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.548730    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/64b3849f-b822-46f6-9926-0ec5a6997d65-cni-binary-copy\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.548790 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.548760    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/64b3849f-b822-46f6-9926-0ec5a6997d65-host-var-lib-cni-bin\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.548790 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.548783    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg5bf\" (UniqueName: \"kubernetes.io/projected/1082908b-13b3-42fe-952e-7512558aa436-kube-api-access-vg5bf\") pod \"network-metrics-daemon-kw824\" (UID: \"1082908b-13b3-42fe-952e-7512558aa436\") " pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:00:42.549002 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.548829    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/64b3849f-b822-46f6-9926-0ec5a6997d65-system-cni-dir\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.549002 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.548886    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/64b3849f-b822-46f6-9926-0ec5a6997d65-host-run-k8s-cni-cncf-io\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.549002 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.548916    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/64b3849f-b822-46f6-9926-0ec5a6997d65-multus-conf-dir\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.549002 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.548947    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/30ccf518-497a-4d21-9d53-c826843c18a8-etc-sysconfig\") pod \"tuned-pxrmh\" (UID: \"30ccf518-497a-4d21-9d53-c826843c18a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.549173 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.549008    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30ccf518-497a-4d21-9d53-c826843c18a8-etc-kubernetes\") pod \"tuned-pxrmh\" (UID: \"30ccf518-497a-4d21-9d53-c826843c18a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.549173 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.549048    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/30ccf518-497a-4d21-9d53-c826843c18a8-host\") pod \"tuned-pxrmh\" (UID: \"30ccf518-497a-4d21-9d53-c826843c18a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.549173 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.549073    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/64b3849f-b822-46f6-9926-0ec5a6997d65-multus-socket-dir-parent\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.549173 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.549115    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/64b3849f-b822-46f6-9926-0ec5a6997d65-host-var-lib-kubelet\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.549173 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.549135    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/64b3849f-b822-46f6-9926-0ec5a6997d65-multus-daemon-config\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.549173 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.549149    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/30ccf518-497a-4d21-9d53-c826843c18a8-etc-modprobe-d\") pod \"tuned-pxrmh\" (UID: \"30ccf518-497a-4d21-9d53-c826843c18a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.549173 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.549162    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/30ccf518-497a-4d21-9d53-c826843c18a8-etc-tuned\") pod \"tuned-pxrmh\" (UID: \"30ccf518-497a-4d21-9d53-c826843c18a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.549480 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.549194    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54zgb\" (UniqueName: \"kubernetes.io/projected/30ccf518-497a-4d21-9d53-c826843c18a8-kube-api-access-54zgb\") pod \"tuned-pxrmh\" (UID: \"30ccf518-497a-4d21-9d53-c826843c18a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.549480 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.549228    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab7d5093-fb91-4469-a88d-488d3ec56493-tmp-dir\") pod \"node-resolver-zkwhq\" (UID: \"ab7d5093-fb91-4469-a88d-488d3ec56493\") " pod="openshift-dns/node-resolver-zkwhq"
Sep 08 04:00:42.549480 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.549268    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7446436d-a655-4644-91b2-d2071bf4e925-original-pull-secret\") pod \"global-pull-secret-syncer-h6v7m\" (UID: \"7446436d-a655-4644-91b2-d2071bf4e925\") " pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:00:42.549480 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.549292    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/30ccf518-497a-4d21-9d53-c826843c18a8-run\") pod \"tuned-pxrmh\" (UID: \"30ccf518-497a-4d21-9d53-c826843c18a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.549480 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.549315    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30ccf518-497a-4d21-9d53-c826843c18a8-sys\") pod \"tuned-pxrmh\" (UID: \"30ccf518-497a-4d21-9d53-c826843c18a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.549480 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.549349    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh8gj\" (UniqueName: \"kubernetes.io/projected/15bf9e2a-b4c6-4c30-b7f2-8700093ee320-kube-api-access-nh8gj\") pod \"network-check-target-46n66\" (UID: \"15bf9e2a-b4c6-4c30-b7f2-8700093ee320\") " pod="openshift-network-diagnostics/network-check-target-46n66"
Sep 08 04:00:42.549480 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.549410    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a5ee9428-69ae-4c66-ab69-9bfc87706f42-registration-dir\") pod \"aws-ebs-csi-driver-node-k5tlp\" (UID: \"a5ee9428-69ae-4c66-ab69-9bfc87706f42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k5tlp"
Sep 08 04:00:42.549480 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.549465    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/64b3849f-b822-46f6-9926-0ec5a6997d65-cnibin\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.550016 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.549551    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/64b3849f-b822-46f6-9926-0ec5a6997d65-host-var-lib-cni-multus\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.550016 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.549606    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/64b3849f-b822-46f6-9926-0ec5a6997d65-etc-kubernetes\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.550016 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.549634    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7446436d-a655-4644-91b2-d2071bf4e925-dbus\") pod \"global-pull-secret-syncer-h6v7m\" (UID: \"7446436d-a655-4644-91b2-d2071bf4e925\") " pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:00:42.550016 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.549660    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a5ee9428-69ae-4c66-ab69-9bfc87706f42-socket-dir\") pod \"aws-ebs-csi-driver-node-k5tlp\" (UID: \"a5ee9428-69ae-4c66-ab69-9bfc87706f42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k5tlp"
Sep 08 04:00:42.550016 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.549656    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cc2z2\""
Sep 08 04:00:42.550016 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.549687    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/30ccf518-497a-4d21-9d53-c826843c18a8-etc-systemd\") pod \"tuned-pxrmh\" (UID: \"30ccf518-497a-4d21-9d53-c826843c18a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.550016 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.549712    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/30ccf518-497a-4d21-9d53-c826843c18a8-lib-modules\") pod \"tuned-pxrmh\" (UID: \"30ccf518-497a-4d21-9d53-c826843c18a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.550016 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.549738    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/30ccf518-497a-4d21-9d53-c826843c18a8-etc-sysctl-d\") pod \"tuned-pxrmh\" (UID: \"30ccf518-497a-4d21-9d53-c826843c18a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.550016 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.549767    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a5ee9428-69ae-4c66-ab69-9bfc87706f42-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k5tlp\" (UID: \"a5ee9428-69ae-4c66-ab69-9bfc87706f42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k5tlp"
Sep 08 04:00:42.550016 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.549848    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a5ee9428-69ae-4c66-ab69-9bfc87706f42-etc-selinux\") pod \"aws-ebs-csi-driver-node-k5tlp\" (UID: \"a5ee9428-69ae-4c66-ab69-9bfc87706f42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k5tlp"
Sep 08 04:00:42.550016 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.549876    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/64b3849f-b822-46f6-9926-0ec5a6997d65-multus-cni-dir\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.550016 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.549900    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/64b3849f-b822-46f6-9926-0ec5a6997d65-host-run-multus-certs\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.550649 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.550024    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vglpp\" (UniqueName: \"kubernetes.io/projected/64b3849f-b822-46f6-9926-0ec5a6997d65-kube-api-access-vglpp\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.550649 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.550052    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/30ccf518-497a-4d21-9d53-c826843c18a8-etc-sysctl-conf\") pod \"tuned-pxrmh\" (UID: \"30ccf518-497a-4d21-9d53-c826843c18a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.550649 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.550085    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30ccf518-497a-4d21-9d53-c826843c18a8-var-lib-kubelet\") pod \"tuned-pxrmh\" (UID: \"30ccf518-497a-4d21-9d53-c826843c18a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.550649 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.550108    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ab7d5093-fb91-4469-a88d-488d3ec56493-hosts-file\") pod \"node-resolver-zkwhq\" (UID: \"ab7d5093-fb91-4469-a88d-488d3ec56493\") " pod="openshift-dns/node-resolver-zkwhq"
Sep 08 04:00:42.550649 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.550137    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq5ld\" (UniqueName: \"kubernetes.io/projected/ab7d5093-fb91-4469-a88d-488d3ec56493-kube-api-access-kq5ld\") pod \"node-resolver-zkwhq\" (UID: \"ab7d5093-fb91-4469-a88d-488d3ec56493\") " pod="openshift-dns/node-resolver-zkwhq"
Sep 08 04:00:42.550649 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.550177    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 08 04:00:42.550649 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.550190    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1082908b-13b3-42fe-952e-7512558aa436-metrics-certs\") pod \"network-metrics-daemon-kw824\" (UID: \"1082908b-13b3-42fe-952e-7512558aa436\") " pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:00:42.550649 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.550231    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/64b3849f-b822-46f6-9926-0ec5a6997d65-host-run-netns\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.550649 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.550260    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/64b3849f-b822-46f6-9926-0ec5a6997d65-hostroot\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.550649 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.550285    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30ccf518-497a-4d21-9d53-c826843c18a8-tmp\") pod \"tuned-pxrmh\" (UID: \"30ccf518-497a-4d21-9d53-c826843c18a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.550649 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.550315    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7446436d-a655-4644-91b2-d2071bf4e925-kubelet-config\") pod \"global-pull-secret-syncer-h6v7m\" (UID: \"7446436d-a655-4644-91b2-d2071bf4e925\") " pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:00:42.550649 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.550339    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a5ee9428-69ae-4c66-ab69-9bfc87706f42-device-dir\") pod \"aws-ebs-csi-driver-node-k5tlp\" (UID: \"a5ee9428-69ae-4c66-ab69-9bfc87706f42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k5tlp"
Sep 08 04:00:42.550649 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.550362    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 08 04:00:42.551357 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.550711    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 08 04:00:42.551357 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.550815    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 08 04:00:42.551357 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.551156    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rgnxt\""
Sep 08 04:00:42.557984 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.557957    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 04:00:42.575365 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.575344    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-j79jd"
Sep 08 04:00:42.583742 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.583719    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-j79jd"
Sep 08 04:00:42.637741 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.637715    2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 08 04:00:42.650735 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.650625    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/30ccf518-497a-4d21-9d53-c826843c18a8-etc-systemd\") pod \"tuned-pxrmh\" (UID: \"30ccf518-497a-4d21-9d53-c826843c18a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.650735 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.650669    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/30ccf518-497a-4d21-9d53-c826843c18a8-lib-modules\") pod \"tuned-pxrmh\" (UID: \"30ccf518-497a-4d21-9d53-c826843c18a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.650735 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.650687    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/30ccf518-497a-4d21-9d53-c826843c18a8-etc-sysctl-d\") pod \"tuned-pxrmh\" (UID: \"30ccf518-497a-4d21-9d53-c826843c18a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.650735 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.650706    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-host-run-netns\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.651044 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.650733    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-host-cni-netd\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.651044 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.650757    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/30ccf518-497a-4d21-9d53-c826843c18a8-etc-systemd\") pod \"tuned-pxrmh\" (UID: \"30ccf518-497a-4d21-9d53-c826843c18a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.651044 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.650775    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9143f1e5-8533-4e17-ad90-8ea66fb38f98-env-overrides\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.651044 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.650825    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/64b3849f-b822-46f6-9926-0ec5a6997d65-multus-cni-dir\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.651044 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.650843    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/30ccf518-497a-4d21-9d53-c826843c18a8-etc-sysctl-d\") pod \"tuned-pxrmh\" (UID: \"30ccf518-497a-4d21-9d53-c826843c18a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.651044 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.650857    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ab7d5093-fb91-4469-a88d-488d3ec56493-hosts-file\") pod \"node-resolver-zkwhq\" (UID: \"ab7d5093-fb91-4469-a88d-488d3ec56493\") " pod="openshift-dns/node-resolver-zkwhq"
Sep 08 04:00:42.651044 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.650861    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/30ccf518-497a-4d21-9d53-c826843c18a8-lib-modules\") pod \"tuned-pxrmh\" (UID: \"30ccf518-497a-4d21-9d53-c826843c18a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.651044 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.650916    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq5ld\" (UniqueName: \"kubernetes.io/projected/ab7d5093-fb91-4469-a88d-488d3ec56493-kube-api-access-kq5ld\") pod \"node-resolver-zkwhq\" (UID: \"ab7d5093-fb91-4469-a88d-488d3ec56493\") " pod="openshift-dns/node-resolver-zkwhq"
Sep 08 04:00:42.651044 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.650951    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a5ee9428-69ae-4c66-ab69-9bfc87706f42-device-dir\") pod \"aws-ebs-csi-driver-node-k5tlp\" (UID: \"a5ee9428-69ae-4c66-ab69-9bfc87706f42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k5tlp"
Sep 08 04:00:42.651044 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.650978    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a5ee9428-69ae-4c66-ab69-9bfc87706f42-sys-fs\") pod \"aws-ebs-csi-driver-node-k5tlp\" (UID: \"a5ee9428-69ae-4c66-ab69-9bfc87706f42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k5tlp"
Sep 08 04:00:42.651044 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.650983    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/64b3849f-b822-46f6-9926-0ec5a6997d65-multus-cni-dir\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.651044 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.651010    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb5bd\" (UniqueName: \"kubernetes.io/projected/53487bf6-e14b-41e1-ac17-51fcd3b3768f-kube-api-access-vb5bd\") pod \"multus-additional-cni-plugins-6qplb\" (UID: \"53487bf6-e14b-41e1-ac17-51fcd3b3768f\") " pod="openshift-multus/multus-additional-cni-plugins-6qplb"
Sep 08 04:00:42.651044 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.651024    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a5ee9428-69ae-4c66-ab69-9bfc87706f42-device-dir\") pod \"aws-ebs-csi-driver-node-k5tlp\" (UID: \"a5ee9428-69ae-4c66-ab69-9bfc87706f42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k5tlp"
Sep 08 04:00:42.651044 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.650914    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ab7d5093-fb91-4469-a88d-488d3ec56493-hosts-file\") pod \"node-resolver-zkwhq\" (UID: \"ab7d5093-fb91-4469-a88d-488d3ec56493\") " pod="openshift-dns/node-resolver-zkwhq"
Sep 08 04:00:42.651044 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.651039    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-host-run-ovn-kubernetes\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.651851 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.651068    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9143f1e5-8533-4e17-ad90-8ea66fb38f98-ovnkube-script-lib\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.651851 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.651078    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a5ee9428-69ae-4c66-ab69-9bfc87706f42-sys-fs\") pod \"aws-ebs-csi-driver-node-k5tlp\" (UID: \"a5ee9428-69ae-4c66-ab69-9bfc87706f42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k5tlp"
Sep 08 04:00:42.651851 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.651097    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/64b3849f-b822-46f6-9926-0ec5a6997d65-cni-binary-copy\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.651851 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.651126    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vg5bf\" (UniqueName: \"kubernetes.io/projected/1082908b-13b3-42fe-952e-7512558aa436-kube-api-access-vg5bf\") pod \"network-metrics-daemon-kw824\" (UID: \"1082908b-13b3-42fe-952e-7512558aa436\") " pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:00:42.651851 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.651153    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/53487bf6-e14b-41e1-ac17-51fcd3b3768f-cni-binary-copy\") pod \"multus-additional-cni-plugins-6qplb\" (UID: \"53487bf6-e14b-41e1-ac17-51fcd3b3768f\") " pod="openshift-multus/multus-additional-cni-plugins-6qplb"
Sep 08 04:00:42.651851 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.651276    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdprc\" (UniqueName: \"kubernetes.io/projected/4724371e-7f6c-45ed-9843-fa2e2a15f93b-kube-api-access-pdprc\") pod \"iptables-alerter-hnhn5\" (UID: \"4724371e-7f6c-45ed-9843-fa2e2a15f93b\") " pod="openshift-network-operator/iptables-alerter-hnhn5"
Sep 08 04:00:42.651851 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.651299    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/64b3849f-b822-46f6-9926-0ec5a6997d65-multus-conf-dir\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.651851 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.651314    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/30ccf518-497a-4d21-9d53-c826843c18a8-etc-sysconfig\") pod \"tuned-pxrmh\" (UID: \"30ccf518-497a-4d21-9d53-c826843c18a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.651851 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.651351    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30ccf518-497a-4d21-9d53-c826843c18a8-etc-kubernetes\") pod \"tuned-pxrmh\" (UID: \"30ccf518-497a-4d21-9d53-c826843c18a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.651851 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.651366    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/30ccf518-497a-4d21-9d53-c826843c18a8-host\") pod \"tuned-pxrmh\" (UID: \"30ccf518-497a-4d21-9d53-c826843c18a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.651851 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.651380    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/30ccf518-497a-4d21-9d53-c826843c18a8-etc-tuned\") pod \"tuned-pxrmh\" (UID: \"30ccf518-497a-4d21-9d53-c826843c18a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.651851 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.651382    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/64b3849f-b822-46f6-9926-0ec5a6997d65-multus-conf-dir\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.651851 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.651439    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/30ccf518-497a-4d21-9d53-c826843c18a8-host\") pod \"tuned-pxrmh\" (UID: \"30ccf518-497a-4d21-9d53-c826843c18a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.651851 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.651466    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30ccf518-497a-4d21-9d53-c826843c18a8-etc-kubernetes\") pod \"tuned-pxrmh\" (UID: \"30ccf518-497a-4d21-9d53-c826843c18a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.651851 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.651468    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/30ccf518-497a-4d21-9d53-c826843c18a8-etc-sysconfig\") pod \"tuned-pxrmh\" (UID: \"30ccf518-497a-4d21-9d53-c826843c18a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.651851 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.651499    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7446436d-a655-4644-91b2-d2071bf4e925-original-pull-secret\") pod \"global-pull-secret-syncer-h6v7m\" (UID: \"7446436d-a655-4644-91b2-d2071bf4e925\") " pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:00:42.651851 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.651524    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/53487bf6-e14b-41e1-ac17-51fcd3b3768f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6qplb\" (UID: \"53487bf6-e14b-41e1-ac17-51fcd3b3768f\") " pod="openshift-multus/multus-additional-cni-plugins-6qplb"
Sep 08 04:00:42.652753 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.651557    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/64b3849f-b822-46f6-9926-0ec5a6997d65-host-var-lib-kubelet\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.652753 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.651605    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/64b3849f-b822-46f6-9926-0ec5a6997d65-multus-daemon-config\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.652753 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:42.651642    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 04:00:42.652753 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.651655    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/64b3849f-b822-46f6-9926-0ec5a6997d65-host-var-lib-kubelet\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.652753 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:42.651773    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7446436d-a655-4644-91b2-d2071bf4e925-original-pull-secret podName:7446436d-a655-4644-91b2-d2071bf4e925 nodeName:}" failed. No retries permitted until 2026-09-08 04:00:43.151748322 +0000 UTC m=+2.937039564 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7446436d-a655-4644-91b2-d2071bf4e925-original-pull-secret") pod "global-pull-secret-syncer-h6v7m" (UID: "7446436d-a655-4644-91b2-d2071bf4e925") : object "kube-system"/"original-pull-secret" not registered
Sep 08 04:00:42.652753 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.651794    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/30ccf518-497a-4d21-9d53-c826843c18a8-etc-modprobe-d\") pod \"tuned-pxrmh\" (UID: \"30ccf518-497a-4d21-9d53-c826843c18a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.652753 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.651885    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/30ccf518-497a-4d21-9d53-c826843c18a8-etc-modprobe-d\") pod \"tuned-pxrmh\" (UID: \"30ccf518-497a-4d21-9d53-c826843c18a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.652753 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.651907    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab7d5093-fb91-4469-a88d-488d3ec56493-tmp-dir\") pod \"node-resolver-zkwhq\" (UID: \"ab7d5093-fb91-4469-a88d-488d3ec56493\") " pod="openshift-dns/node-resolver-zkwhq"
Sep 08 04:00:42.652753 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.651974    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh8gj\" (UniqueName: \"kubernetes.io/projected/15bf9e2a-b4c6-4c30-b7f2-8700093ee320-kube-api-access-nh8gj\") pod \"network-check-target-46n66\" (UID: \"15bf9e2a-b4c6-4c30-b7f2-8700093ee320\") " pod="openshift-network-diagnostics/network-check-target-46n66"
Sep 08 04:00:42.652753 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.652011    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-var-lib-openvswitch\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.652753 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.652038    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-etc-openvswitch\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.652753 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.652070    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lggw\" (UniqueName: \"kubernetes.io/projected/9143f1e5-8533-4e17-ad90-8ea66fb38f98-kube-api-access-4lggw\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.652753 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.652095    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-run-openvswitch\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.652753 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.652108    2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 08 04:00:42.652753 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.652120    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2n5w\" (UniqueName: \"kubernetes.io/projected/3223e696-fb13-4dc2-a4fb-86ea4c014fa3-kube-api-access-g2n5w\") pod \"node-ca-m2x6p\" (UID: \"3223e696-fb13-4dc2-a4fb-86ea4c014fa3\") " pod="openshift-image-registry/node-ca-m2x6p"
Sep 08 04:00:42.652753 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.652148    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/53487bf6-e14b-41e1-ac17-51fcd3b3768f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6qplb\" (UID: \"53487bf6-e14b-41e1-ac17-51fcd3b3768f\") " pod="openshift-multus/multus-additional-cni-plugins-6qplb"
Sep 08 04:00:42.652753 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.652174    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a5ee9428-69ae-4c66-ab69-9bfc87706f42-socket-dir\") pod \"aws-ebs-csi-driver-node-k5tlp\" (UID: \"a5ee9428-69ae-4c66-ab69-9bfc87706f42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k5tlp"
Sep 08 04:00:42.653555 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.652223    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a5ee9428-69ae-4c66-ab69-9bfc87706f42-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k5tlp\" (UID: \"a5ee9428-69ae-4c66-ab69-9bfc87706f42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k5tlp"
Sep 08 04:00:42.653555 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.652250    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a5ee9428-69ae-4c66-ab69-9bfc87706f42-etc-selinux\") pod \"aws-ebs-csi-driver-node-k5tlp\" (UID: \"a5ee9428-69ae-4c66-ab69-9bfc87706f42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k5tlp"
Sep 08 04:00:42.653555 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.652263    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab7d5093-fb91-4469-a88d-488d3ec56493-tmp-dir\") pod \"node-resolver-zkwhq\" (UID: \"ab7d5093-fb91-4469-a88d-488d3ec56493\") " pod="openshift-dns/node-resolver-zkwhq"
Sep 08 04:00:42.653555 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.652275    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9143f1e5-8533-4e17-ad90-8ea66fb38f98-ovnkube-config\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.653555 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.652338    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53487bf6-e14b-41e1-ac17-51fcd3b3768f-system-cni-dir\") pod \"multus-additional-cni-plugins-6qplb\" (UID: \"53487bf6-e14b-41e1-ac17-51fcd3b3768f\") " pod="openshift-multus/multus-additional-cni-plugins-6qplb"
Sep 08 04:00:42.653555 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.652363    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4724371e-7f6c-45ed-9843-fa2e2a15f93b-host-slash\") pod \"iptables-alerter-hnhn5\" (UID: \"4724371e-7f6c-45ed-9843-fa2e2a15f93b\") " pod="openshift-network-operator/iptables-alerter-hnhn5"
Sep 08 04:00:42.653555 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.652391    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/64b3849f-b822-46f6-9926-0ec5a6997d65-host-run-multus-certs\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.653555 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.652405    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a5ee9428-69ae-4c66-ab69-9bfc87706f42-etc-selinux\") pod \"aws-ebs-csi-driver-node-k5tlp\" (UID: \"a5ee9428-69ae-4c66-ab69-9bfc87706f42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k5tlp"
Sep 08 04:00:42.653555 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.652420    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vglpp\" (UniqueName: \"kubernetes.io/projected/64b3849f-b822-46f6-9926-0ec5a6997d65-kube-api-access-vglpp\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.653555 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.652424    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a5ee9428-69ae-4c66-ab69-9bfc87706f42-socket-dir\") pod \"aws-ebs-csi-driver-node-k5tlp\" (UID: \"a5ee9428-69ae-4c66-ab69-9bfc87706f42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k5tlp"
Sep 08 04:00:42.653555 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.652446    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/30ccf518-497a-4d21-9d53-c826843c18a8-etc-sysctl-conf\") pod \"tuned-pxrmh\" (UID: \"30ccf518-497a-4d21-9d53-c826843c18a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.653555 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.652462    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a5ee9428-69ae-4c66-ab69-9bfc87706f42-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k5tlp\" (UID: \"a5ee9428-69ae-4c66-ab69-9bfc87706f42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k5tlp"
Sep 08 04:00:42.653555 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.652483    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30ccf518-497a-4d21-9d53-c826843c18a8-var-lib-kubelet\") pod \"tuned-pxrmh\" (UID: \"30ccf518-497a-4d21-9d53-c826843c18a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.653555 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.652533    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30ccf518-497a-4d21-9d53-c826843c18a8-var-lib-kubelet\") pod \"tuned-pxrmh\" (UID: \"30ccf518-497a-4d21-9d53-c826843c18a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.653555 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.652535    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/64b3849f-b822-46f6-9926-0ec5a6997d65-host-run-multus-certs\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.653555 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.652547    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/64b3849f-b822-46f6-9926-0ec5a6997d65-cni-binary-copy\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.653555 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.652563    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1082908b-13b3-42fe-952e-7512558aa436-metrics-certs\") pod \"network-metrics-daemon-kw824\" (UID: \"1082908b-13b3-42fe-952e-7512558aa436\") " pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:00:42.654371 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.652598    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-host-kubelet\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.654371 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.652609    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/64b3849f-b822-46f6-9926-0ec5a6997d65-multus-daemon-config\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.654371 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.652659    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9143f1e5-8533-4e17-ad90-8ea66fb38f98-ovn-node-metrics-cert\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.654371 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.652688    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/64b3849f-b822-46f6-9926-0ec5a6997d65-host-run-netns\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.654371 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:42.652699    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 04:00:42.654371 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.652717    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/64b3849f-b822-46f6-9926-0ec5a6997d65-hostroot\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.654371 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.652737    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/64b3849f-b822-46f6-9926-0ec5a6997d65-host-run-netns\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.654371 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.652741    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30ccf518-497a-4d21-9d53-c826843c18a8-tmp\") pod \"tuned-pxrmh\" (UID: \"30ccf518-497a-4d21-9d53-c826843c18a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.654371 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:42.652763    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1082908b-13b3-42fe-952e-7512558aa436-metrics-certs podName:1082908b-13b3-42fe-952e-7512558aa436 nodeName:}" failed. No retries permitted until 2026-09-08 04:00:43.152745932 +0000 UTC m=+2.938037167 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1082908b-13b3-42fe-952e-7512558aa436-metrics-certs") pod "network-metrics-daemon-kw824" (UID: "1082908b-13b3-42fe-952e-7512558aa436") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 04:00:42.654371 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.652804    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7446436d-a655-4644-91b2-d2071bf4e925-kubelet-config\") pod \"global-pull-secret-syncer-h6v7m\" (UID: \"7446436d-a655-4644-91b2-d2071bf4e925\") " pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:00:42.654371 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.652809    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/64b3849f-b822-46f6-9926-0ec5a6997d65-hostroot\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.654371 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.652822    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/30ccf518-497a-4d21-9d53-c826843c18a8-etc-sysctl-conf\") pod \"tuned-pxrmh\" (UID: \"30ccf518-497a-4d21-9d53-c826843c18a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.654371 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.652836    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp8mm\" (UniqueName: \"kubernetes.io/projected/a5ee9428-69ae-4c66-ab69-9bfc87706f42-kube-api-access-gp8mm\") pod \"aws-ebs-csi-driver-node-k5tlp\" (UID: \"a5ee9428-69ae-4c66-ab69-9bfc87706f42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k5tlp"
Sep 08 04:00:42.654371 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.652864    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-log-socket\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.654371 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.652870    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7446436d-a655-4644-91b2-d2071bf4e925-kubelet-config\") pod \"global-pull-secret-syncer-h6v7m\" (UID: \"7446436d-a655-4644-91b2-d2071bf4e925\") " pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:00:42.654371 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.652900    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a124d27d-8125-409b-a62b-769a35cdbe64-agent-certs\") pod \"konnectivity-agent-b7xw7\" (UID: \"a124d27d-8125-409b-a62b-769a35cdbe64\") " pod="kube-system/konnectivity-agent-b7xw7"
Sep 08 04:00:42.654371 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.653011    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/64b3849f-b822-46f6-9926-0ec5a6997d65-host-var-lib-cni-bin\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.655109 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.653049    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-systemd-units\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.655109 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.653075    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3223e696-fb13-4dc2-a4fb-86ea4c014fa3-host\") pod \"node-ca-m2x6p\" (UID: \"3223e696-fb13-4dc2-a4fb-86ea4c014fa3\") " pod="openshift-image-registry/node-ca-m2x6p"
Sep 08 04:00:42.655109 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.653100    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3223e696-fb13-4dc2-a4fb-86ea4c014fa3-serviceca\") pod \"node-ca-m2x6p\" (UID: \"3223e696-fb13-4dc2-a4fb-86ea4c014fa3\") " pod="openshift-image-registry/node-ca-m2x6p"
Sep 08 04:00:42.655109 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.653139    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a124d27d-8125-409b-a62b-769a35cdbe64-konnectivity-ca\") pod \"konnectivity-agent-b7xw7\" (UID: \"a124d27d-8125-409b-a62b-769a35cdbe64\") " pod="kube-system/konnectivity-agent-b7xw7"
Sep 08 04:00:42.655109 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.653160    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/64b3849f-b822-46f6-9926-0ec5a6997d65-host-var-lib-cni-bin\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.655109 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.653210    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/64b3849f-b822-46f6-9926-0ec5a6997d65-system-cni-dir\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.655109 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.653235    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/64b3849f-b822-46f6-9926-0ec5a6997d65-host-run-k8s-cni-cncf-io\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.655109 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.653276    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/64b3849f-b822-46f6-9926-0ec5a6997d65-host-run-k8s-cni-cncf-io\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.655109 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.653307    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-run-systemd\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.655109 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.653312    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/64b3849f-b822-46f6-9926-0ec5a6997d65-system-cni-dir\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.655109 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.653332    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/53487bf6-e14b-41e1-ac17-51fcd3b3768f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6qplb\" (UID: \"53487bf6-e14b-41e1-ac17-51fcd3b3768f\") " pod="openshift-multus/multus-additional-cni-plugins-6qplb"
Sep 08 04:00:42.655109 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.653368    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/64b3849f-b822-46f6-9926-0ec5a6997d65-multus-socket-dir-parent\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.655109 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.653398    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54zgb\" (UniqueName: \"kubernetes.io/projected/30ccf518-497a-4d21-9d53-c826843c18a8-kube-api-access-54zgb\") pod \"tuned-pxrmh\" (UID: \"30ccf518-497a-4d21-9d53-c826843c18a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.655109 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.653423    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-host-slash\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.655109 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.653451    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/64b3849f-b822-46f6-9926-0ec5a6997d65-multus-socket-dir-parent\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.655109 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.653539    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-run-ovn\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.655109 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.653596    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-host-cni-bin\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.655794 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.653639    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.655794 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.653666    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/53487bf6-e14b-41e1-ac17-51fcd3b3768f-cnibin\") pod \"multus-additional-cni-plugins-6qplb\" (UID: \"53487bf6-e14b-41e1-ac17-51fcd3b3768f\") " pod="openshift-multus/multus-additional-cni-plugins-6qplb"
Sep 08 04:00:42.655794 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.653695    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/30ccf518-497a-4d21-9d53-c826843c18a8-run\") pod \"tuned-pxrmh\" (UID: \"30ccf518-497a-4d21-9d53-c826843c18a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.655794 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.653719    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30ccf518-497a-4d21-9d53-c826843c18a8-sys\") pod \"tuned-pxrmh\" (UID: \"30ccf518-497a-4d21-9d53-c826843c18a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.655794 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.653745    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a5ee9428-69ae-4c66-ab69-9bfc87706f42-registration-dir\") pod \"aws-ebs-csi-driver-node-k5tlp\" (UID: \"a5ee9428-69ae-4c66-ab69-9bfc87706f42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k5tlp"
Sep 08 04:00:42.655794 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.653765    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/30ccf518-497a-4d21-9d53-c826843c18a8-run\") pod \"tuned-pxrmh\" (UID: \"30ccf518-497a-4d21-9d53-c826843c18a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.655794 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.653771    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/64b3849f-b822-46f6-9926-0ec5a6997d65-cnibin\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.655794 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.653809    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/64b3849f-b822-46f6-9926-0ec5a6997d65-host-var-lib-cni-multus\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.655794 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.653818    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30ccf518-497a-4d21-9d53-c826843c18a8-sys\") pod \"tuned-pxrmh\" (UID: \"30ccf518-497a-4d21-9d53-c826843c18a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.655794 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.653836    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/64b3849f-b822-46f6-9926-0ec5a6997d65-etc-kubernetes\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.655794 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.653881    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/64b3849f-b822-46f6-9926-0ec5a6997d65-cnibin\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.655794 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.653869    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7446436d-a655-4644-91b2-d2071bf4e925-dbus\") pod \"global-pull-secret-syncer-h6v7m\" (UID: \"7446436d-a655-4644-91b2-d2071bf4e925\") " pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:00:42.655794 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.653831    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a5ee9428-69ae-4c66-ab69-9bfc87706f42-registration-dir\") pod \"aws-ebs-csi-driver-node-k5tlp\" (UID: \"a5ee9428-69ae-4c66-ab69-9bfc87706f42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k5tlp"
Sep 08 04:00:42.655794 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.653911    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-node-log\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.655794 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.653878    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/64b3849f-b822-46f6-9926-0ec5a6997d65-host-var-lib-cni-multus\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.655794 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.653932    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/64b3849f-b822-46f6-9926-0ec5a6997d65-etc-kubernetes\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.655794 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.653941    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4724371e-7f6c-45ed-9843-fa2e2a15f93b-iptables-alerter-script\") pod \"iptables-alerter-hnhn5\" (UID: \"4724371e-7f6c-45ed-9843-fa2e2a15f93b\") " pod="openshift-network-operator/iptables-alerter-hnhn5"
Sep 08 04:00:42.656490 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.653950    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7446436d-a655-4644-91b2-d2071bf4e925-dbus\") pod \"global-pull-secret-syncer-h6v7m\" (UID: \"7446436d-a655-4644-91b2-d2071bf4e925\") " pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:00:42.656765 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.656744    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30ccf518-497a-4d21-9d53-c826843c18a8-tmp\") pod \"tuned-pxrmh\" (UID: \"30ccf518-497a-4d21-9d53-c826843c18a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.657018 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.657002    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/30ccf518-497a-4d21-9d53-c826843c18a8-etc-tuned\") pod \"tuned-pxrmh\" (UID: \"30ccf518-497a-4d21-9d53-c826843c18a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.672006 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.671965    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-35.ec2.internal" event={"ID":"d382fa944d7c9206c91fe951106292d7","Type":"ContainerStarted","Data":"0f53ed5b803b0d2492e3b66a8cab2516db77b7a27158279a5dfb3e1404476a97"}
Sep 08 04:00:42.678111 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.678085    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vglpp\" (UniqueName: \"kubernetes.io/projected/64b3849f-b822-46f6-9926-0ec5a6997d65-kube-api-access-vglpp\") pod \"multus-wmm7p\" (UID: \"64b3849f-b822-46f6-9926-0ec5a6997d65\") " pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.679114 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.679085    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq5ld\" (UniqueName: \"kubernetes.io/projected/ab7d5093-fb91-4469-a88d-488d3ec56493-kube-api-access-kq5ld\") pod \"node-resolver-zkwhq\" (UID: \"ab7d5093-fb91-4469-a88d-488d3ec56493\") " pod="openshift-dns/node-resolver-zkwhq"
Sep 08 04:00:42.694465 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:42.694412    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 04:00:42.694465 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:42.694443    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 04:00:42.694465 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:42.694459    2573 projected.go:196] Error preparing data for projected volume kube-api-access-nh8gj for pod openshift-network-diagnostics/network-check-target-46n66: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 04:00:42.694655 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:42.694530    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15bf9e2a-b4c6-4c30-b7f2-8700093ee320-kube-api-access-nh8gj podName:15bf9e2a-b4c6-4c30-b7f2-8700093ee320 nodeName:}" failed. No retries permitted until 2026-09-08 04:00:43.194511316 +0000 UTC m=+2.979802555 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nh8gj" (UniqueName: "kubernetes.io/projected/15bf9e2a-b4c6-4c30-b7f2-8700093ee320-kube-api-access-nh8gj") pod "network-check-target-46n66" (UID: "15bf9e2a-b4c6-4c30-b7f2-8700093ee320") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 04:00:42.700588 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.700562    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg5bf\" (UniqueName: \"kubernetes.io/projected/1082908b-13b3-42fe-952e-7512558aa436-kube-api-access-vg5bf\") pod \"network-metrics-daemon-kw824\" (UID: \"1082908b-13b3-42fe-952e-7512558aa436\") " pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:00:42.702425 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.702395    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp8mm\" (UniqueName: \"kubernetes.io/projected/a5ee9428-69ae-4c66-ab69-9bfc87706f42-kube-api-access-gp8mm\") pod \"aws-ebs-csi-driver-node-k5tlp\" (UID: \"a5ee9428-69ae-4c66-ab69-9bfc87706f42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k5tlp"
Sep 08 04:00:42.707393 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.707364    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54zgb\" (UniqueName: \"kubernetes.io/projected/30ccf518-497a-4d21-9d53-c826843c18a8-kube-api-access-54zgb\") pod \"tuned-pxrmh\" (UID: \"30ccf518-497a-4d21-9d53-c826843c18a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.754779 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.754746    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-host-run-netns\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.754779 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.754783    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-host-cni-netd\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.754982 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.754808    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9143f1e5-8533-4e17-ad90-8ea66fb38f98-env-overrides\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.754982 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.754829    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vb5bd\" (UniqueName: \"kubernetes.io/projected/53487bf6-e14b-41e1-ac17-51fcd3b3768f-kube-api-access-vb5bd\") pod \"multus-additional-cni-plugins-6qplb\" (UID: \"53487bf6-e14b-41e1-ac17-51fcd3b3768f\") " pod="openshift-multus/multus-additional-cni-plugins-6qplb"
Sep 08 04:00:42.754982 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.754844    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-host-run-netns\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.754982 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.754852    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-host-run-ovn-kubernetes\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.754982 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.754921    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-host-run-ovn-kubernetes\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.754982 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.754954    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-host-cni-netd\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.755293 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.755058    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9143f1e5-8533-4e17-ad90-8ea66fb38f98-ovnkube-script-lib\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.755293 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.755092    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/53487bf6-e14b-41e1-ac17-51fcd3b3768f-cni-binary-copy\") pod \"multus-additional-cni-plugins-6qplb\" (UID: \"53487bf6-e14b-41e1-ac17-51fcd3b3768f\") " pod="openshift-multus/multus-additional-cni-plugins-6qplb"
Sep 08 04:00:42.755293 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.755114    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdprc\" (UniqueName: \"kubernetes.io/projected/4724371e-7f6c-45ed-9843-fa2e2a15f93b-kube-api-access-pdprc\") pod \"iptables-alerter-hnhn5\" (UID: \"4724371e-7f6c-45ed-9843-fa2e2a15f93b\") " pod="openshift-network-operator/iptables-alerter-hnhn5"
Sep 08 04:00:42.755454 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.755360    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/53487bf6-e14b-41e1-ac17-51fcd3b3768f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6qplb\" (UID: \"53487bf6-e14b-41e1-ac17-51fcd3b3768f\") " pod="openshift-multus/multus-additional-cni-plugins-6qplb"
Sep 08 04:00:42.755454 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.755432    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-var-lib-openvswitch\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.755569 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.755459    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-etc-openvswitch\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.755569 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.755501    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lggw\" (UniqueName: \"kubernetes.io/projected/9143f1e5-8533-4e17-ad90-8ea66fb38f98-kube-api-access-4lggw\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.755569 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.755528    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-run-openvswitch\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.755569 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.755554    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2n5w\" (UniqueName: \"kubernetes.io/projected/3223e696-fb13-4dc2-a4fb-86ea4c014fa3-kube-api-access-g2n5w\") pod \"node-ca-m2x6p\" (UID: \"3223e696-fb13-4dc2-a4fb-86ea4c014fa3\") " pod="openshift-image-registry/node-ca-m2x6p"
Sep 08 04:00:42.755792 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.755581    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/53487bf6-e14b-41e1-ac17-51fcd3b3768f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6qplb\" (UID: \"53487bf6-e14b-41e1-ac17-51fcd3b3768f\") " pod="openshift-multus/multus-additional-cni-plugins-6qplb"
Sep 08 04:00:42.755792 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.755634    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9143f1e5-8533-4e17-ad90-8ea66fb38f98-ovnkube-config\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.755792 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.755664    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53487bf6-e14b-41e1-ac17-51fcd3b3768f-system-cni-dir\") pod \"multus-additional-cni-plugins-6qplb\" (UID: \"53487bf6-e14b-41e1-ac17-51fcd3b3768f\") " pod="openshift-multus/multus-additional-cni-plugins-6qplb"
Sep 08 04:00:42.755792 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.755711    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-etc-openvswitch\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.755792 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.755721    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53487bf6-e14b-41e1-ac17-51fcd3b3768f-system-cni-dir\") pod \"multus-additional-cni-plugins-6qplb\" (UID: \"53487bf6-e14b-41e1-ac17-51fcd3b3768f\") " pod="openshift-multus/multus-additional-cni-plugins-6qplb"
Sep 08 04:00:42.755792 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.755715    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-var-lib-openvswitch\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.755792 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.755584    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/53487bf6-e14b-41e1-ac17-51fcd3b3768f-cni-binary-copy\") pod \"multus-additional-cni-plugins-6qplb\" (UID: \"53487bf6-e14b-41e1-ac17-51fcd3b3768f\") " pod="openshift-multus/multus-additional-cni-plugins-6qplb"
Sep 08 04:00:42.756194 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.755816    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-run-openvswitch\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.756194 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.755851    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4724371e-7f6c-45ed-9843-fa2e2a15f93b-host-slash\") pod \"iptables-alerter-hnhn5\" (UID: \"4724371e-7f6c-45ed-9843-fa2e2a15f93b\") " pod="openshift-network-operator/iptables-alerter-hnhn5"
Sep 08 04:00:42.756194 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.755911    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-host-kubelet\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.756194 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.755939    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9143f1e5-8533-4e17-ad90-8ea66fb38f98-ovn-node-metrics-cert\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.756194 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.755972    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-log-socket\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.756194 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.756000    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a124d27d-8125-409b-a62b-769a35cdbe64-agent-certs\") pod \"konnectivity-agent-b7xw7\" (UID: \"a124d27d-8125-409b-a62b-769a35cdbe64\") " pod="kube-system/konnectivity-agent-b7xw7"
Sep 08 04:00:42.756194 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.756022    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4724371e-7f6c-45ed-9843-fa2e2a15f93b-host-slash\") pod \"iptables-alerter-hnhn5\" (UID: \"4724371e-7f6c-45ed-9843-fa2e2a15f93b\") " pod="openshift-network-operator/iptables-alerter-hnhn5"
Sep 08 04:00:42.756194 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.756029    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-systemd-units\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.756194 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.756040    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9143f1e5-8533-4e17-ad90-8ea66fb38f98-ovnkube-script-lib\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.756194 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.756065    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9143f1e5-8533-4e17-ad90-8ea66fb38f98-env-overrides\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.756194 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.756075    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-systemd-units\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.756194 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.756076    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3223e696-fb13-4dc2-a4fb-86ea4c014fa3-host\") pod \"node-ca-m2x6p\" (UID: \"3223e696-fb13-4dc2-a4fb-86ea4c014fa3\") " pod="openshift-image-registry/node-ca-m2x6p"
Sep 08 04:00:42.756194 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.756105    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3223e696-fb13-4dc2-a4fb-86ea4c014fa3-host\") pod \"node-ca-m2x6p\" (UID: \"3223e696-fb13-4dc2-a4fb-86ea4c014fa3\") " pod="openshift-image-registry/node-ca-m2x6p"
Sep 08 04:00:42.756194 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.756144    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-log-socket\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.756194 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.756151    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-host-kubelet\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.756859 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.756382    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/53487bf6-e14b-41e1-ac17-51fcd3b3768f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6qplb\" (UID: \"53487bf6-e14b-41e1-ac17-51fcd3b3768f\") " pod="openshift-multus/multus-additional-cni-plugins-6qplb"
Sep 08 04:00:42.756859 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.756428    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3223e696-fb13-4dc2-a4fb-86ea4c014fa3-serviceca\") pod \"node-ca-m2x6p\" (UID: \"3223e696-fb13-4dc2-a4fb-86ea4c014fa3\") " pod="openshift-image-registry/node-ca-m2x6p"
Sep 08 04:00:42.756859 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.756436    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9143f1e5-8533-4e17-ad90-8ea66fb38f98-ovnkube-config\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.756859 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.756469    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a124d27d-8125-409b-a62b-769a35cdbe64-konnectivity-ca\") pod \"konnectivity-agent-b7xw7\" (UID: \"a124d27d-8125-409b-a62b-769a35cdbe64\") " pod="kube-system/konnectivity-agent-b7xw7"
Sep 08 04:00:42.756859 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.756495    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-run-systemd\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.756859 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.756517    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/53487bf6-e14b-41e1-ac17-51fcd3b3768f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6qplb\" (UID: \"53487bf6-e14b-41e1-ac17-51fcd3b3768f\") " pod="openshift-multus/multus-additional-cni-plugins-6qplb"
Sep 08 04:00:42.756859 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.756521    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/53487bf6-e14b-41e1-ac17-51fcd3b3768f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6qplb\" (UID: \"53487bf6-e14b-41e1-ac17-51fcd3b3768f\") " pod="openshift-multus/multus-additional-cni-plugins-6qplb"
Sep 08 04:00:42.756859 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.756576    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-run-systemd\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.756859 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.756576    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-host-slash\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.756859 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.756614    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-host-slash\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.756859 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.756613    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-run-ovn\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.756859 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.756669    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-host-cni-bin\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.756859 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.756697    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.756859 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.756724    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/53487bf6-e14b-41e1-ac17-51fcd3b3768f-cnibin\") pod \"multus-additional-cni-plugins-6qplb\" (UID: \"53487bf6-e14b-41e1-ac17-51fcd3b3768f\") " pod="openshift-multus/multus-additional-cni-plugins-6qplb"
Sep 08 04:00:42.756859 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.756758    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-node-log\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.756859 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.756783    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4724371e-7f6c-45ed-9843-fa2e2a15f93b-iptables-alerter-script\") pod \"iptables-alerter-hnhn5\" (UID: \"4724371e-7f6c-45ed-9843-fa2e2a15f93b\") " pod="openshift-network-operator/iptables-alerter-hnhn5"
Sep 08 04:00:42.756859 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.756788    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/53487bf6-e14b-41e1-ac17-51fcd3b3768f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6qplb\" (UID: \"53487bf6-e14b-41e1-ac17-51fcd3b3768f\") " pod="openshift-multus/multus-additional-cni-plugins-6qplb"
Sep 08 04:00:42.757503 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.756859    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/53487bf6-e14b-41e1-ac17-51fcd3b3768f-cnibin\") pod \"multus-additional-cni-plugins-6qplb\" (UID: \"53487bf6-e14b-41e1-ac17-51fcd3b3768f\") " pod="openshift-multus/multus-additional-cni-plugins-6qplb"
Sep 08 04:00:42.758019 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.757981    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a124d27d-8125-409b-a62b-769a35cdbe64-konnectivity-ca\") pod \"konnectivity-agent-b7xw7\" (UID: \"a124d27d-8125-409b-a62b-769a35cdbe64\") " pod="kube-system/konnectivity-agent-b7xw7"
Sep 08 04:00:42.758107 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.756853    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3223e696-fb13-4dc2-a4fb-86ea4c014fa3-serviceca\") pod \"node-ca-m2x6p\" (UID: \"3223e696-fb13-4dc2-a4fb-86ea4c014fa3\") " pod="openshift-image-registry/node-ca-m2x6p"
Sep 08 04:00:42.758515 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.758494    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4724371e-7f6c-45ed-9843-fa2e2a15f93b-iptables-alerter-script\") pod \"iptables-alerter-hnhn5\" (UID: \"4724371e-7f6c-45ed-9843-fa2e2a15f93b\") " pod="openshift-network-operator/iptables-alerter-hnhn5"
Sep 08 04:00:42.758590 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.758546    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.758590 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.758575    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-run-ovn\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.758723 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.758600    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-node-log\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.758776 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.758761    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9143f1e5-8533-4e17-ad90-8ea66fb38f98-host-cni-bin\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.759309 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.759236    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a124d27d-8125-409b-a62b-769a35cdbe64-agent-certs\") pod \"konnectivity-agent-b7xw7\" (UID: \"a124d27d-8125-409b-a62b-769a35cdbe64\") " pod="kube-system/konnectivity-agent-b7xw7"
Sep 08 04:00:42.761037 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.759428    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9143f1e5-8533-4e17-ad90-8ea66fb38f98-ovn-node-metrics-cert\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.767771 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.767750    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb5bd\" (UniqueName: \"kubernetes.io/projected/53487bf6-e14b-41e1-ac17-51fcd3b3768f-kube-api-access-vb5bd\") pod \"multus-additional-cni-plugins-6qplb\" (UID: \"53487bf6-e14b-41e1-ac17-51fcd3b3768f\") " pod="openshift-multus/multus-additional-cni-plugins-6qplb"
Sep 08 04:00:42.771149 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.771128    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdprc\" (UniqueName: \"kubernetes.io/projected/4724371e-7f6c-45ed-9843-fa2e2a15f93b-kube-api-access-pdprc\") pod \"iptables-alerter-hnhn5\" (UID: \"4724371e-7f6c-45ed-9843-fa2e2a15f93b\") " pod="openshift-network-operator/iptables-alerter-hnhn5"
Sep 08 04:00:42.771474 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.771450    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lggw\" (UniqueName: \"kubernetes.io/projected/9143f1e5-8533-4e17-ad90-8ea66fb38f98-kube-api-access-4lggw\") pod \"ovnkube-node-fcwwv\" (UID: \"9143f1e5-8533-4e17-ad90-8ea66fb38f98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.772532 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.772515    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2n5w\" (UniqueName: \"kubernetes.io/projected/3223e696-fb13-4dc2-a4fb-86ea4c014fa3-kube-api-access-g2n5w\") pod \"node-ca-m2x6p\" (UID: \"3223e696-fb13-4dc2-a4fb-86ea4c014fa3\") " pod="openshift-image-registry/node-ca-m2x6p"
Sep 08 04:00:42.845601 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.845549    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wmm7p"
Sep 08 04:00:42.853694 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.853657    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k5tlp"
Sep 08 04:00:42.863438 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.863417    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pxrmh"
Sep 08 04:00:42.869695 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.869668    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zkwhq"
Sep 08 04:00:42.876588 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.876569    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-b7xw7"
Sep 08 04:00:42.883331 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.883313    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:00:42.890860 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.890835    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m2x6p"
Sep 08 04:00:42.898728 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.898711    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hnhn5"
Sep 08 04:00:42.904419 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:42.904399    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6qplb"
Sep 08 04:00:42.972763 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:42.972737    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3223e696_fb13_4dc2_a4fb_86ea4c014fa3.slice/crio-769161f36bddff876ea756400ed1a44609c3d66458e6c56b556d4105fd133a0b WatchSource:0}: Error finding container 769161f36bddff876ea756400ed1a44609c3d66458e6c56b556d4105fd133a0b: Status 404 returned error can't find the container with id 769161f36bddff876ea756400ed1a44609c3d66458e6c56b556d4105fd133a0b
Sep 08 04:00:42.973993 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:42.973967    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab7d5093_fb91_4469_a88d_488d3ec56493.slice/crio-fce74685fa938ba20d9a8156ce8b3b7de8d35f16a8c8e6db96df8eea4e852461 WatchSource:0}: Error finding container fce74685fa938ba20d9a8156ce8b3b7de8d35f16a8c8e6db96df8eea4e852461: Status 404 returned error can't find the container with id fce74685fa938ba20d9a8156ce8b3b7de8d35f16a8c8e6db96df8eea4e852461
Sep 08 04:00:42.975044 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:42.975019    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4724371e_7f6c_45ed_9843_fa2e2a15f93b.slice/crio-4197ae49c9995b86dec478e1469ff0c3094e62035056ef10f611346445f56868 WatchSource:0}: Error finding container 4197ae49c9995b86dec478e1469ff0c3094e62035056ef10f611346445f56868: Status 404 returned error can't find the container with id 4197ae49c9995b86dec478e1469ff0c3094e62035056ef10f611346445f56868
Sep 08 04:00:42.976733 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:42.976692    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64b3849f_b822_46f6_9926_0ec5a6997d65.slice/crio-fb5373110e2c9d50535053f5f554aad6860afd5eef645bdb3de4438ac6c31fe0 WatchSource:0}: Error finding container fb5373110e2c9d50535053f5f554aad6860afd5eef645bdb3de4438ac6c31fe0: Status 404 returned error can't find the container with id fb5373110e2c9d50535053f5f554aad6860afd5eef645bdb3de4438ac6c31fe0
Sep 08 04:00:42.979177 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:42.978846    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9143f1e5_8533_4e17_ad90_8ea66fb38f98.slice/crio-812fa26d79d7bc4bb3ee0404926cfc7162d1502e59976c87ab083555a0f7d531 WatchSource:0}: Error finding container 812fa26d79d7bc4bb3ee0404926cfc7162d1502e59976c87ab083555a0f7d531: Status 404 returned error can't find the container with id 812fa26d79d7bc4bb3ee0404926cfc7162d1502e59976c87ab083555a0f7d531
Sep 08 04:00:42.980425 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:42.980406    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30ccf518_497a_4d21_9d53_c826843c18a8.slice/crio-d84efc3fafc0fba92724031e4bd06abf1ab6876ab9e08beed4d5cb9fb51d5426 WatchSource:0}: Error finding container d84efc3fafc0fba92724031e4bd06abf1ab6876ab9e08beed4d5cb9fb51d5426: Status 404 returned error can't find the container with id d84efc3fafc0fba92724031e4bd06abf1ab6876ab9e08beed4d5cb9fb51d5426
Sep 08 04:00:42.981481 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:42.981451    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda124d27d_8125_409b_a62b_769a35cdbe64.slice/crio-1b295aedd2f20e1eab67ecb57d3bd09ed443f69e0ff4ea9cc7cd0cc8866650b0 WatchSource:0}: Error finding container 1b295aedd2f20e1eab67ecb57d3bd09ed443f69e0ff4ea9cc7cd0cc8866650b0: Status 404 returned error can't find the container with id 1b295aedd2f20e1eab67ecb57d3bd09ed443f69e0ff4ea9cc7cd0cc8866650b0
Sep 08 04:00:43.006063 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:43.006032    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5ee9428_69ae_4c66_ab69_9bfc87706f42.slice/crio-7d3e6e7c01a8189cc06e1fb320621599dded00cb7c8e3df5e71d1b4192c1832b WatchSource:0}: Error finding container 7d3e6e7c01a8189cc06e1fb320621599dded00cb7c8e3df5e71d1b4192c1832b: Status 404 returned error can't find the container with id 7d3e6e7c01a8189cc06e1fb320621599dded00cb7c8e3df5e71d1b4192c1832b
Sep 08 04:00:43.028352 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:00:43.028329    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f5a837540d716e426e6051c25aec9eb.slice/crio-7355b90151372c689c346933a0cb1dfecea439b315819cc8166c7b7e70bdb0fa WatchSource:0}: Error finding container 7355b90151372c689c346933a0cb1dfecea439b315819cc8166c7b7e70bdb0fa: Status 404 returned error can't find the container with id 7355b90151372c689c346933a0cb1dfecea439b315819cc8166c7b7e70bdb0fa
Sep 08 04:00:43.160261 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:43.160230    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7446436d-a655-4644-91b2-d2071bf4e925-original-pull-secret\") pod \"global-pull-secret-syncer-h6v7m\" (UID: \"7446436d-a655-4644-91b2-d2071bf4e925\") " pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:00:43.160413 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:43.160278    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1082908b-13b3-42fe-952e-7512558aa436-metrics-certs\") pod \"network-metrics-daemon-kw824\" (UID: \"1082908b-13b3-42fe-952e-7512558aa436\") " pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:00:43.160413 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:43.160386    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 04:00:43.160413 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:43.160385    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 04:00:43.160576 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:43.160458    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1082908b-13b3-42fe-952e-7512558aa436-metrics-certs podName:1082908b-13b3-42fe-952e-7512558aa436 nodeName:}" failed. No retries permitted until 2026-09-08 04:00:44.160431238 +0000 UTC m=+3.945722474 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1082908b-13b3-42fe-952e-7512558aa436-metrics-certs") pod "network-metrics-daemon-kw824" (UID: "1082908b-13b3-42fe-952e-7512558aa436") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 04:00:43.160576 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:43.160479    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7446436d-a655-4644-91b2-d2071bf4e925-original-pull-secret podName:7446436d-a655-4644-91b2-d2071bf4e925 nodeName:}" failed. No retries permitted until 2026-09-08 04:00:44.16046841 +0000 UTC m=+3.945759642 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7446436d-a655-4644-91b2-d2071bf4e925-original-pull-secret") pod "global-pull-secret-syncer-h6v7m" (UID: "7446436d-a655-4644-91b2-d2071bf4e925") : object "kube-system"/"original-pull-secret" not registered
Sep 08 04:00:43.261052 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:43.261020    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh8gj\" (UniqueName: \"kubernetes.io/projected/15bf9e2a-b4c6-4c30-b7f2-8700093ee320-kube-api-access-nh8gj\") pod \"network-check-target-46n66\" (UID: \"15bf9e2a-b4c6-4c30-b7f2-8700093ee320\") " pod="openshift-network-diagnostics/network-check-target-46n66"
Sep 08 04:00:43.261251 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:43.261230    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 04:00:43.261297 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:43.261261    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 04:00:43.261297 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:43.261273    2573 projected.go:196] Error preparing data for projected volume kube-api-access-nh8gj for pod openshift-network-diagnostics/network-check-target-46n66: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 04:00:43.261359 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:43.261342    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15bf9e2a-b4c6-4c30-b7f2-8700093ee320-kube-api-access-nh8gj podName:15bf9e2a-b4c6-4c30-b7f2-8700093ee320 nodeName:}" failed. No retries permitted until 2026-09-08 04:00:44.261321131 +0000 UTC m=+4.046612374 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nh8gj" (UniqueName: "kubernetes.io/projected/15bf9e2a-b4c6-4c30-b7f2-8700093ee320-kube-api-access-nh8gj") pod "network-check-target-46n66" (UID: "15bf9e2a-b4c6-4c30-b7f2-8700093ee320") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 04:00:43.586779 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:43.586639    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 03:55:42 +0000 UTC" deadline="2028-04-06 14:15:31.527906457 +0000 UTC"
Sep 08 04:00:43.586779 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:43.586675    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13834h14m47.941236581s"
Sep 08 04:00:43.681922 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:43.681854    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-b7xw7" event={"ID":"a124d27d-8125-409b-a62b-769a35cdbe64","Type":"ContainerStarted","Data":"1b295aedd2f20e1eab67ecb57d3bd09ed443f69e0ff4ea9cc7cd0cc8866650b0"}
Sep 08 04:00:43.688310 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:43.688272    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k5tlp" event={"ID":"a5ee9428-69ae-4c66-ab69-9bfc87706f42","Type":"ContainerStarted","Data":"7d3e6e7c01a8189cc06e1fb320621599dded00cb7c8e3df5e71d1b4192c1832b"}
Sep 08 04:00:43.693370 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:43.693342    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hnhn5" event={"ID":"4724371e-7f6c-45ed-9843-fa2e2a15f93b","Type":"ContainerStarted","Data":"4197ae49c9995b86dec478e1469ff0c3094e62035056ef10f611346445f56868"}
Sep 08 04:00:43.699655 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:43.699627    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zkwhq" event={"ID":"ab7d5093-fb91-4469-a88d-488d3ec56493","Type":"ContainerStarted","Data":"fce74685fa938ba20d9a8156ce8b3b7de8d35f16a8c8e6db96df8eea4e852461"}
Sep 08 04:00:43.709241 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:43.709207    2573 generic.go:356] "Generic (PLEG): container finished" podID="d382fa944d7c9206c91fe951106292d7" containerID="d13021ff35d50b4eff1a9c745cc6cc372fb1f29207db6a773d87871fa58dfd23" exitCode=0
Sep 08 04:00:43.709358 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:43.709294    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-35.ec2.internal" event={"ID":"d382fa944d7c9206c91fe951106292d7","Type":"ContainerDied","Data":"d13021ff35d50b4eff1a9c745cc6cc372fb1f29207db6a773d87871fa58dfd23"}
Sep 08 04:00:43.712963 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:43.712931    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-35.ec2.internal" event={"ID":"7f5a837540d716e426e6051c25aec9eb","Type":"ContainerStarted","Data":"7355b90151372c689c346933a0cb1dfecea439b315819cc8166c7b7e70bdb0fa"}
Sep 08 04:00:43.716038 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:43.716015    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6qplb" event={"ID":"53487bf6-e14b-41e1-ac17-51fcd3b3768f","Type":"ContainerStarted","Data":"b8f8a7598d94fb1e007e98759fe9dd287ea203d37e102571db85150f408fe4d0"}
Sep 08 04:00:43.720547 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:43.720483    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pxrmh" event={"ID":"30ccf518-497a-4d21-9d53-c826843c18a8","Type":"ContainerStarted","Data":"d84efc3fafc0fba92724031e4bd06abf1ab6876ab9e08beed4d5cb9fb51d5426"}
Sep 08 04:00:43.722694 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:43.722669    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wmm7p" event={"ID":"64b3849f-b822-46f6-9926-0ec5a6997d65","Type":"ContainerStarted","Data":"fb5373110e2c9d50535053f5f554aad6860afd5eef645bdb3de4438ac6c31fe0"}
Sep 08 04:00:43.725882 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:43.725799    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv" event={"ID":"9143f1e5-8533-4e17-ad90-8ea66fb38f98","Type":"ContainerStarted","Data":"812fa26d79d7bc4bb3ee0404926cfc7162d1502e59976c87ab083555a0f7d531"}
Sep 08 04:00:43.730904 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:43.730874    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m2x6p" event={"ID":"3223e696-fb13-4dc2-a4fb-86ea4c014fa3","Type":"ContainerStarted","Data":"769161f36bddff876ea756400ed1a44609c3d66458e6c56b556d4105fd133a0b"}
Sep 08 04:00:44.170293 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:44.170188    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7446436d-a655-4644-91b2-d2071bf4e925-original-pull-secret\") pod \"global-pull-secret-syncer-h6v7m\" (UID: \"7446436d-a655-4644-91b2-d2071bf4e925\") " pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:00:44.170293 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:44.170270    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1082908b-13b3-42fe-952e-7512558aa436-metrics-certs\") pod \"network-metrics-daemon-kw824\" (UID: \"1082908b-13b3-42fe-952e-7512558aa436\") " pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:00:44.170515 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:44.170415    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 04:00:44.170515 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:44.170483    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1082908b-13b3-42fe-952e-7512558aa436-metrics-certs podName:1082908b-13b3-42fe-952e-7512558aa436 nodeName:}" failed. No retries permitted until 2026-09-08 04:00:46.170461717 +0000 UTC m=+5.955752959 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1082908b-13b3-42fe-952e-7512558aa436-metrics-certs") pod "network-metrics-daemon-kw824" (UID: "1082908b-13b3-42fe-952e-7512558aa436") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 04:00:44.170949 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:44.170927    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 04:00:44.171053 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:44.170986    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7446436d-a655-4644-91b2-d2071bf4e925-original-pull-secret podName:7446436d-a655-4644-91b2-d2071bf4e925 nodeName:}" failed. No retries permitted until 2026-09-08 04:00:46.170970376 +0000 UTC m=+5.956261611 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7446436d-a655-4644-91b2-d2071bf4e925-original-pull-secret") pod "global-pull-secret-syncer-h6v7m" (UID: "7446436d-a655-4644-91b2-d2071bf4e925") : object "kube-system"/"original-pull-secret" not registered
Sep 08 04:00:44.273185 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:44.272515    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh8gj\" (UniqueName: \"kubernetes.io/projected/15bf9e2a-b4c6-4c30-b7f2-8700093ee320-kube-api-access-nh8gj\") pod \"network-check-target-46n66\" (UID: \"15bf9e2a-b4c6-4c30-b7f2-8700093ee320\") " pod="openshift-network-diagnostics/network-check-target-46n66"
Sep 08 04:00:44.273185 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:44.272746    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 04:00:44.273185 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:44.272774    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 04:00:44.273185 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:44.272788    2573 projected.go:196] Error preparing data for projected volume kube-api-access-nh8gj for pod openshift-network-diagnostics/network-check-target-46n66: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 04:00:44.273185 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:44.272851    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15bf9e2a-b4c6-4c30-b7f2-8700093ee320-kube-api-access-nh8gj podName:15bf9e2a-b4c6-4c30-b7f2-8700093ee320 nodeName:}" failed. No retries permitted until 2026-09-08 04:00:46.272832481 +0000 UTC m=+6.058123713 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nh8gj" (UniqueName: "kubernetes.io/projected/15bf9e2a-b4c6-4c30-b7f2-8700093ee320-kube-api-access-nh8gj") pod "network-check-target-46n66" (UID: "15bf9e2a-b4c6-4c30-b7f2-8700093ee320") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 04:00:44.587152 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:44.587082    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 03:55:42 +0000 UTC" deadline="2028-04-03 15:31:37.343398309 +0000 UTC"
Sep 08 04:00:44.587152 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:44.587149    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13763h30m52.756253668s"
Sep 08 04:00:44.672997 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:44.672961    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46n66"
Sep 08 04:00:44.673159 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:44.673101    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46n66" podUID="15bf9e2a-b4c6-4c30-b7f2-8700093ee320"
Sep 08 04:00:44.673538 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:44.673514    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:00:44.673682 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:44.673666    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kw824" podUID="1082908b-13b3-42fe-952e-7512558aa436"
Sep 08 04:00:44.673745 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:44.673736    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:00:44.673831 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:44.673811    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6v7m" podUID="7446436d-a655-4644-91b2-d2071bf4e925"
Sep 08 04:00:44.743550 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:44.743458    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-35.ec2.internal" event={"ID":"d382fa944d7c9206c91fe951106292d7","Type":"ContainerStarted","Data":"31615a14cae3cf0dbe07d1cd32b3bcd91b4dad2485dd64d3dc45fc2797b4aada"}
Sep 08 04:00:46.189542 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:46.189501    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7446436d-a655-4644-91b2-d2071bf4e925-original-pull-secret\") pod \"global-pull-secret-syncer-h6v7m\" (UID: \"7446436d-a655-4644-91b2-d2071bf4e925\") " pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:00:46.190048 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:46.189602    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1082908b-13b3-42fe-952e-7512558aa436-metrics-certs\") pod \"network-metrics-daemon-kw824\" (UID: \"1082908b-13b3-42fe-952e-7512558aa436\") " pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:00:46.190048 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:46.189764    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 04:00:46.190048 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:46.189769    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 04:00:46.190048 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:46.189834    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1082908b-13b3-42fe-952e-7512558aa436-metrics-certs podName:1082908b-13b3-42fe-952e-7512558aa436 nodeName:}" failed. No retries permitted until 2026-09-08 04:00:50.189814591 +0000 UTC m=+9.975105823 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1082908b-13b3-42fe-952e-7512558aa436-metrics-certs") pod "network-metrics-daemon-kw824" (UID: "1082908b-13b3-42fe-952e-7512558aa436") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 04:00:46.190048 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:46.189856    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7446436d-a655-4644-91b2-d2071bf4e925-original-pull-secret podName:7446436d-a655-4644-91b2-d2071bf4e925 nodeName:}" failed. No retries permitted until 2026-09-08 04:00:50.189843852 +0000 UTC m=+9.975135072 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7446436d-a655-4644-91b2-d2071bf4e925-original-pull-secret") pod "global-pull-secret-syncer-h6v7m" (UID: "7446436d-a655-4644-91b2-d2071bf4e925") : object "kube-system"/"original-pull-secret" not registered
Sep 08 04:00:46.291503 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:46.290812    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh8gj\" (UniqueName: \"kubernetes.io/projected/15bf9e2a-b4c6-4c30-b7f2-8700093ee320-kube-api-access-nh8gj\") pod \"network-check-target-46n66\" (UID: \"15bf9e2a-b4c6-4c30-b7f2-8700093ee320\") " pod="openshift-network-diagnostics/network-check-target-46n66"
Sep 08 04:00:46.291503 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:46.291048    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 04:00:46.291503 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:46.291073    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 04:00:46.291503 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:46.291087    2573 projected.go:196] Error preparing data for projected volume kube-api-access-nh8gj for pod openshift-network-diagnostics/network-check-target-46n66: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 04:00:46.291503 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:46.291152    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15bf9e2a-b4c6-4c30-b7f2-8700093ee320-kube-api-access-nh8gj podName:15bf9e2a-b4c6-4c30-b7f2-8700093ee320 nodeName:}" failed. No retries permitted until 2026-09-08 04:00:50.291131489 +0000 UTC m=+10.076422726 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nh8gj" (UniqueName: "kubernetes.io/projected/15bf9e2a-b4c6-4c30-b7f2-8700093ee320-kube-api-access-nh8gj") pod "network-check-target-46n66" (UID: "15bf9e2a-b4c6-4c30-b7f2-8700093ee320") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 04:00:46.669396 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:46.668464    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:00:46.669396 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:46.668631    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kw824" podUID="1082908b-13b3-42fe-952e-7512558aa436"
Sep 08 04:00:46.669396 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:46.669165    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:00:46.669396 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:46.669279    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6v7m" podUID="7446436d-a655-4644-91b2-d2071bf4e925"
Sep 08 04:00:46.670236 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:46.670049    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46n66"
Sep 08 04:00:46.670236 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:46.670146    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46n66" podUID="15bf9e2a-b4c6-4c30-b7f2-8700093ee320"
Sep 08 04:00:48.669588 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:48.668945    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:00:48.669588 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:48.669082    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6v7m" podUID="7446436d-a655-4644-91b2-d2071bf4e925"
Sep 08 04:00:48.669588 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:48.669437    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46n66"
Sep 08 04:00:48.669588 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:48.669526    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46n66" podUID="15bf9e2a-b4c6-4c30-b7f2-8700093ee320"
Sep 08 04:00:48.670180 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:48.669637    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:00:48.670180 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:48.669736    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kw824" podUID="1082908b-13b3-42fe-952e-7512558aa436"
Sep 08 04:00:50.224425 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:50.224348    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7446436d-a655-4644-91b2-d2071bf4e925-original-pull-secret\") pod \"global-pull-secret-syncer-h6v7m\" (UID: \"7446436d-a655-4644-91b2-d2071bf4e925\") " pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:00:50.224852 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:50.224424    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1082908b-13b3-42fe-952e-7512558aa436-metrics-certs\") pod \"network-metrics-daemon-kw824\" (UID: \"1082908b-13b3-42fe-952e-7512558aa436\") " pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:00:50.224852 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:50.224581    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 04:00:50.224852 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:50.224639    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1082908b-13b3-42fe-952e-7512558aa436-metrics-certs podName:1082908b-13b3-42fe-952e-7512558aa436 nodeName:}" failed. No retries permitted until 2026-09-08 04:00:58.224619016 +0000 UTC m=+18.009910229 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1082908b-13b3-42fe-952e-7512558aa436-metrics-certs") pod "network-metrics-daemon-kw824" (UID: "1082908b-13b3-42fe-952e-7512558aa436") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 04:00:50.225085 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:50.225028    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 04:00:50.225085 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:50.225085    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7446436d-a655-4644-91b2-d2071bf4e925-original-pull-secret podName:7446436d-a655-4644-91b2-d2071bf4e925 nodeName:}" failed. No retries permitted until 2026-09-08 04:00:58.225070625 +0000 UTC m=+18.010361842 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7446436d-a655-4644-91b2-d2071bf4e925-original-pull-secret") pod "global-pull-secret-syncer-h6v7m" (UID: "7446436d-a655-4644-91b2-d2071bf4e925") : object "kube-system"/"original-pull-secret" not registered
Sep 08 04:00:50.324963 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:50.324923    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh8gj\" (UniqueName: \"kubernetes.io/projected/15bf9e2a-b4c6-4c30-b7f2-8700093ee320-kube-api-access-nh8gj\") pod \"network-check-target-46n66\" (UID: \"15bf9e2a-b4c6-4c30-b7f2-8700093ee320\") " pod="openshift-network-diagnostics/network-check-target-46n66"
Sep 08 04:00:50.325133 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:50.325114    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 04:00:50.325215 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:50.325142    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 04:00:50.325215 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:50.325153    2573 projected.go:196] Error preparing data for projected volume kube-api-access-nh8gj for pod openshift-network-diagnostics/network-check-target-46n66: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 04:00:50.325215 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:50.325212    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15bf9e2a-b4c6-4c30-b7f2-8700093ee320-kube-api-access-nh8gj podName:15bf9e2a-b4c6-4c30-b7f2-8700093ee320 nodeName:}" failed. No retries permitted until 2026-09-08 04:00:58.325192798 +0000 UTC m=+18.110484027 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nh8gj" (UniqueName: "kubernetes.io/projected/15bf9e2a-b4c6-4c30-b7f2-8700093ee320-kube-api-access-nh8gj") pod "network-check-target-46n66" (UID: "15bf9e2a-b4c6-4c30-b7f2-8700093ee320") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 04:00:50.670595 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:50.669793    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:00:50.670595 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:50.669907    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kw824" podUID="1082908b-13b3-42fe-952e-7512558aa436"
Sep 08 04:00:50.670595 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:50.670274    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:00:50.670595 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:50.670365    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6v7m" podUID="7446436d-a655-4644-91b2-d2071bf4e925"
Sep 08 04:00:50.670595 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:50.670427    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46n66"
Sep 08 04:00:50.670595 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:50.670491    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46n66" podUID="15bf9e2a-b4c6-4c30-b7f2-8700093ee320"
Sep 08 04:00:52.668534 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:52.668284    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:00:52.668976 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:52.668292    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:00:52.668976 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:52.668671    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kw824" podUID="1082908b-13b3-42fe-952e-7512558aa436"
Sep 08 04:00:52.668976 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:52.668350    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46n66"
Sep 08 04:00:52.668976 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:52.668748    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6v7m" podUID="7446436d-a655-4644-91b2-d2071bf4e925"
Sep 08 04:00:52.668976 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:52.668797    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46n66" podUID="15bf9e2a-b4c6-4c30-b7f2-8700093ee320"
Sep 08 04:00:54.667961 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:54.667926    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:00:54.668852 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:54.667926    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:00:54.668852 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:54.668054    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6v7m" podUID="7446436d-a655-4644-91b2-d2071bf4e925"
Sep 08 04:00:54.668852 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:54.668160    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kw824" podUID="1082908b-13b3-42fe-952e-7512558aa436"
Sep 08 04:00:54.668852 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:54.667926    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46n66"
Sep 08 04:00:54.668852 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:54.668247    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46n66" podUID="15bf9e2a-b4c6-4c30-b7f2-8700093ee320"
Sep 08 04:00:56.668212 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:56.668170    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:00:56.668636 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:56.668170    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:00:56.668636 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:56.668305    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kw824" podUID="1082908b-13b3-42fe-952e-7512558aa436"
Sep 08 04:00:56.668636 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:56.668179    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46n66"
Sep 08 04:00:56.668636 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:56.668386    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6v7m" podUID="7446436d-a655-4644-91b2-d2071bf4e925"
Sep 08 04:00:56.668636 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:56.668450    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46n66" podUID="15bf9e2a-b4c6-4c30-b7f2-8700093ee320"
Sep 08 04:00:58.282309 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:58.282270    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1082908b-13b3-42fe-952e-7512558aa436-metrics-certs\") pod \"network-metrics-daemon-kw824\" (UID: \"1082908b-13b3-42fe-952e-7512558aa436\") " pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:00:58.282765 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:58.282335    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7446436d-a655-4644-91b2-d2071bf4e925-original-pull-secret\") pod \"global-pull-secret-syncer-h6v7m\" (UID: \"7446436d-a655-4644-91b2-d2071bf4e925\") " pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:00:58.282765 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:58.282427    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 04:00:58.282765 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:58.282426    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 04:00:58.282765 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:58.282481    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7446436d-a655-4644-91b2-d2071bf4e925-original-pull-secret podName:7446436d-a655-4644-91b2-d2071bf4e925 nodeName:}" failed. No retries permitted until 2026-09-08 04:01:14.282467999 +0000 UTC m=+34.067759212 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7446436d-a655-4644-91b2-d2071bf4e925-original-pull-secret") pod "global-pull-secret-syncer-h6v7m" (UID: "7446436d-a655-4644-91b2-d2071bf4e925") : object "kube-system"/"original-pull-secret" not registered
Sep 08 04:00:58.282765 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:58.282495    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1082908b-13b3-42fe-952e-7512558aa436-metrics-certs podName:1082908b-13b3-42fe-952e-7512558aa436 nodeName:}" failed. No retries permitted until 2026-09-08 04:01:14.282488479 +0000 UTC m=+34.067779695 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1082908b-13b3-42fe-952e-7512558aa436-metrics-certs") pod "network-metrics-daemon-kw824" (UID: "1082908b-13b3-42fe-952e-7512558aa436") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 04:00:58.382774 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:58.382743    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh8gj\" (UniqueName: \"kubernetes.io/projected/15bf9e2a-b4c6-4c30-b7f2-8700093ee320-kube-api-access-nh8gj\") pod \"network-check-target-46n66\" (UID: \"15bf9e2a-b4c6-4c30-b7f2-8700093ee320\") " pod="openshift-network-diagnostics/network-check-target-46n66"
Sep 08 04:00:58.382901 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:58.382846    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 04:00:58.382901 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:58.382861    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 04:00:58.382901 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:58.382872    2573 projected.go:196] Error preparing data for projected volume kube-api-access-nh8gj for pod openshift-network-diagnostics/network-check-target-46n66: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 04:00:58.382996 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:58.382912    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15bf9e2a-b4c6-4c30-b7f2-8700093ee320-kube-api-access-nh8gj podName:15bf9e2a-b4c6-4c30-b7f2-8700093ee320 nodeName:}" failed. No retries permitted until 2026-09-08 04:01:14.382900686 +0000 UTC m=+34.168191901 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nh8gj" (UniqueName: "kubernetes.io/projected/15bf9e2a-b4c6-4c30-b7f2-8700093ee320-kube-api-access-nh8gj") pod "network-check-target-46n66" (UID: "15bf9e2a-b4c6-4c30-b7f2-8700093ee320") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 04:00:58.668886 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:58.668849    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:00:58.668886 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:58.668877    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:00:58.669109 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:00:58.668962    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46n66"
Sep 08 04:00:58.669109 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:58.669063    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kw824" podUID="1082908b-13b3-42fe-952e-7512558aa436"
Sep 08 04:00:58.669210 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:58.669137    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46n66" podUID="15bf9e2a-b4c6-4c30-b7f2-8700093ee320"
Sep 08 04:00:58.669261 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:00:58.669229    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6v7m" podUID="7446436d-a655-4644-91b2-d2071bf4e925"
Sep 08 04:01:00.669199 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:00.669165    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46n66"
Sep 08 04:01:00.669711 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:00.669257    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46n66" podUID="15bf9e2a-b4c6-4c30-b7f2-8700093ee320"
Sep 08 04:01:00.669711 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:00.669355    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:01:00.669711 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:00.669481    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kw824" podUID="1082908b-13b3-42fe-952e-7512558aa436"
Sep 08 04:01:00.669711 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:00.669514    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:01:00.669711 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:00.669615    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6v7m" podUID="7446436d-a655-4644-91b2-d2071bf4e925"
Sep 08 04:01:02.669153 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:02.668947    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:01:02.669862 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:02.668947    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:01:02.669862 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:02.669210    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kw824" podUID="1082908b-13b3-42fe-952e-7512558aa436"
Sep 08 04:01:02.669862 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:02.668948    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46n66"
Sep 08 04:01:02.669862 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:02.669261    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6v7m" podUID="7446436d-a655-4644-91b2-d2071bf4e925"
Sep 08 04:01:02.669862 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:02.669350    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46n66" podUID="15bf9e2a-b4c6-4c30-b7f2-8700093ee320"
Sep 08 04:01:02.780325 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:02.780287    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pxrmh" event={"ID":"30ccf518-497a-4d21-9d53-c826843c18a8","Type":"ContainerStarted","Data":"7d9ce34828f527c2eec0b9181c06e4b71f8ba1c652b75f57f221b66ae8e6b162"}
Sep 08 04:01:02.782251 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:02.782143    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wmm7p" event={"ID":"64b3849f-b822-46f6-9926-0ec5a6997d65","Type":"ContainerStarted","Data":"7bf9dcb1533f565acb10c13678e83edaf07d82e7210428f75c5938911f644fe3"}
Sep 08 04:01:02.785701 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:02.785668    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv" event={"ID":"9143f1e5-8533-4e17-ad90-8ea66fb38f98","Type":"ContainerStarted","Data":"4d0fef8ea49ceef1a47239f03d5979defd60584d484343526eb0b94f2402670a"}
Sep 08 04:01:02.785800 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:02.785753    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv" event={"ID":"9143f1e5-8533-4e17-ad90-8ea66fb38f98","Type":"ContainerStarted","Data":"984fd56b733b569c368b586c0cc2dc20c3c94f04dc32e64356ddb5e570455c50"}
Sep 08 04:01:02.785848 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:02.785805    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv" event={"ID":"9143f1e5-8533-4e17-ad90-8ea66fb38f98","Type":"ContainerStarted","Data":"cad03a3759695c5bcddb83b0f2173f1a26e1f85c67ea01434a08d8d1142270b2"}
Sep 08 04:01:02.785902 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:02.785852    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv" event={"ID":"9143f1e5-8533-4e17-ad90-8ea66fb38f98","Type":"ContainerStarted","Data":"e5aa86152085d02b7002916f06f0400f3204ba4acd93aa1b46219af538aa10cb"}
Sep 08 04:01:02.785902 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:02.785898    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv" event={"ID":"9143f1e5-8533-4e17-ad90-8ea66fb38f98","Type":"ContainerStarted","Data":"7b4c062dcc13049e76ae0144c167bb5db787fb98b94a2e2ce31c8d0790838509"}
Sep 08 04:01:02.785998 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:02.785945    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv" event={"ID":"9143f1e5-8533-4e17-ad90-8ea66fb38f98","Type":"ContainerStarted","Data":"8b83640be43be4962c2405a62742ac17af2b2275f04b955b4718a82ac2d28d90"}
Sep 08 04:01:02.787369 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:02.787344    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m2x6p" event={"ID":"3223e696-fb13-4dc2-a4fb-86ea4c014fa3","Type":"ContainerStarted","Data":"ef6719a9554064e6bd75b6eb7b90fa5041404a6a09d6fb0c10fcd1618cbb7942"}
Sep 08 04:01:02.791634 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:02.791609    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-b7xw7" event={"ID":"a124d27d-8125-409b-a62b-769a35cdbe64","Type":"ContainerStarted","Data":"4a55555f9ddd10ec5b0bcdfa09a8eefcca821de161b173e74eeb259afed56cb2"}
Sep 08 04:01:02.793152 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:02.793115    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k5tlp" event={"ID":"a5ee9428-69ae-4c66-ab69-9bfc87706f42","Type":"ContainerStarted","Data":"3ff8d10f0fb83f9392727074e450d737fd258e1b413920554df1cdb20e8f0b4a"}
Sep 08 04:01:02.794636 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:02.794613    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zkwhq" event={"ID":"ab7d5093-fb91-4469-a88d-488d3ec56493","Type":"ContainerStarted","Data":"b2fbdf43628d9075e2624fcef0b18be916b41e7f5b93e851f5a40809a49d69e1"}
Sep 08 04:01:02.796195 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:02.796173    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-35.ec2.internal" event={"ID":"7f5a837540d716e426e6051c25aec9eb","Type":"ContainerStarted","Data":"865c658aac532f42a6c0c2b9b209369ff43a2c316bbba7ae5faaf47decf4f378"}
Sep 08 04:01:02.797723 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:02.797673    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pxrmh" podStartSLOduration=3.043361864 podStartE2EDuration="21.797659646s" totalImagesPullingTime="18.754297782s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 04:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:01:02.797140859 +0000 UTC m=+22.582432095" watchObservedRunningTime="2026-09-08 04:01:02.797659646 +0000 UTC m=+22.582950882"
Sep 08 04:01:02.797884 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:02.797766    2573 generic.go:356] "Generic (PLEG): container finished" podID="53487bf6-e14b-41e1-ac17-51fcd3b3768f" containerID="b7a6387b9b67e636b6188955e9644c91536c8ed7798aaa07224ef546a8783939" exitCode=0
Sep 08 04:01:02.797884 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:02.797794    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6qplb" event={"ID":"53487bf6-e14b-41e1-ac17-51fcd3b3768f","Type":"ContainerDied","Data":"b7a6387b9b67e636b6188955e9644c91536c8ed7798aaa07224ef546a8783939"}
Sep 08 04:01:02.798014 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:02.797988    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-35.ec2.internal" podStartSLOduration=20.797981701 podStartE2EDuration="20.797981701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 04:00:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:00:44.765823869 +0000 UTC m=+4.551115108" watchObservedRunningTime="2026-09-08 04:01:02.797981701 +0000 UTC m=+22.583272936"
Sep 08 04:01:02.813371 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:02.813328    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zkwhq" podStartSLOduration=7.492494595 podStartE2EDuration="21.813316313s" totalImagesPullingTime="14.320821718s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 04:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:01:02.813205915 +0000 UTC m=+22.598497152" watchObservedRunningTime="2026-09-08 04:01:02.813316313 +0000 UTC m=+22.598607548"
Sep 08 04:01:02.828082 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:02.828039    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-b7xw7" podStartSLOduration=3.077029055 podStartE2EDuration="21.828023565s" totalImagesPullingTime="18.75099451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:01:02.827500778 +0000 UTC m=+22.612792016" watchObservedRunningTime="2026-09-08 04:01:02.828023565 +0000 UTC m=+22.613314806"
Sep 08 04:01:02.839741 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:02.839704    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-35.ec2.internal" podStartSLOduration=20.839688333 podStartE2EDuration="20.839688333s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 04:00:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:01:02.839687585 +0000 UTC m=+22.624978821" watchObservedRunningTime="2026-09-08 04:01:02.839688333 +0000 UTC m=+22.624979571"
Sep 08 04:01:02.856389 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:02.856350    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wmm7p" podStartSLOduration=3.077044859 podStartE2EDuration="21.856333912s" totalImagesPullingTime="18.779289053s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 04:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:01:02.856199595 +0000 UTC m=+22.641490831" watchObservedRunningTime="2026-09-08 04:01:02.856333912 +0000 UTC m=+22.641625149"
Sep 08 04:01:02.870168 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:02.870110    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-m2x6p" podStartSLOduration=3.086394815 podStartE2EDuration="21.870093519s" totalImagesPullingTime="18.783698704s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 04:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:01:02.870068071 +0000 UTC m=+22.655359310" watchObservedRunningTime="2026-09-08 04:01:02.870093519 +0000 UTC m=+22.655384757"
Sep 08 04:01:03.370082 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:03.369937    2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 08 04:01:03.608818 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:03.608628    2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-08T04:01:03.370078849Z","UUID":"222c0a23-cc02-42e6-960a-220d2de0b2c4","Handler":null,"Name":"","Endpoint":""}
Sep 08 04:01:03.610261 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:03.610240    2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 08 04:01:03.610391 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:03.610272    2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 08 04:01:03.803007 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:03.802967    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k5tlp" event={"ID":"a5ee9428-69ae-4c66-ab69-9bfc87706f42","Type":"ContainerStarted","Data":"bda15ecd7738111e9d81e6832ee59b6e85aeb6c4a262976c694475937fefdb01"}
Sep 08 04:01:03.805711 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:03.805671    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hnhn5" event={"ID":"4724371e-7f6c-45ed-9843-fa2e2a15f93b","Type":"ContainerStarted","Data":"bd50152186901c868c77b1d887f7436dd568f3d64a7e16be34a84852f77351d2"}
Sep 08 04:01:04.669013 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:04.668932    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46n66"
Sep 08 04:01:04.669013 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:04.668926    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:01:04.669208 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:04.669057    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:01:04.669208 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:04.669070    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46n66" podUID="15bf9e2a-b4c6-4c30-b7f2-8700093ee320"
Sep 08 04:01:04.669208 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:04.669167    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6v7m" podUID="7446436d-a655-4644-91b2-d2071bf4e925"
Sep 08 04:01:04.669326 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:04.669246    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kw824" podUID="1082908b-13b3-42fe-952e-7512558aa436"
Sep 08 04:01:04.810212 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:04.810174    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k5tlp" event={"ID":"a5ee9428-69ae-4c66-ab69-9bfc87706f42","Type":"ContainerStarted","Data":"e014af8f5b0033f0c281cc3cfaba77a2291b3adf9e67da76ae49a488b4af59ca"}
Sep 08 04:01:04.813933 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:04.813904    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv" event={"ID":"9143f1e5-8533-4e17-ad90-8ea66fb38f98","Type":"ContainerStarted","Data":"6268bfc7b4f5e06a7ad3736f239c0197f9c6ba8ddfad5e88a91c0181d44bb621"}
Sep 08 04:01:04.851040 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:04.850986    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k5tlp" podStartSLOduration=3.013499433 podStartE2EDuration="23.850970287s" totalImagesPullingTime="20.837470854s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 04:00:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:01:04.850949273 +0000 UTC m=+24.636240508" watchObservedRunningTime="2026-09-08 04:01:04.850970287 +0000 UTC m=+24.636261504"
Sep 08 04:01:04.851363 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:04.851336    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hnhn5" podStartSLOduration=5.06696977 podStartE2EDuration="23.8513259s" totalImagesPullingTime="18.78435613s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 04:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:01:03.821625575 +0000 UTC m=+23.606916812" watchObservedRunningTime="2026-09-08 04:01:04.8513259 +0000 UTC m=+24.636617136"
Sep 08 04:01:06.164764 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:06.164726    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-b7xw7"
Sep 08 04:01:06.165395 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:06.165376    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-b7xw7"
Sep 08 04:01:06.668166 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:06.668130    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:01:06.668338 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:06.668190    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46n66"
Sep 08 04:01:06.668338 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:06.668214    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:01:06.668338 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:06.668293    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46n66" podUID="15bf9e2a-b4c6-4c30-b7f2-8700093ee320"
Sep 08 04:01:06.668491 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:06.668421    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kw824" podUID="1082908b-13b3-42fe-952e-7512558aa436"
Sep 08 04:01:06.668549 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:06.668508    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6v7m" podUID="7446436d-a655-4644-91b2-d2071bf4e925"
Sep 08 04:01:06.818895 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:06.818813    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-b7xw7"
Sep 08 04:01:06.819345 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:06.819325    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-b7xw7"
Sep 08 04:01:07.823104 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:07.822928    2573 generic.go:356] "Generic (PLEG): container finished" podID="53487bf6-e14b-41e1-ac17-51fcd3b3768f" containerID="b6174f6dda5727b62ac675266fb8f396db2c05ce2e5a94d4d5513a660af5e9a8" exitCode=0
Sep 08 04:01:07.823711 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:07.822999    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6qplb" event={"ID":"53487bf6-e14b-41e1-ac17-51fcd3b3768f","Type":"ContainerDied","Data":"b6174f6dda5727b62ac675266fb8f396db2c05ce2e5a94d4d5513a660af5e9a8"}
Sep 08 04:01:07.826915 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:07.826895    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv" event={"ID":"9143f1e5-8533-4e17-ad90-8ea66fb38f98","Type":"ContainerStarted","Data":"d0cd928387b2411e2e8c16cd865c84d3e77e9334214a5708755e0707f75a41af"}
Sep 08 04:01:07.872093 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:07.872016    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv" podStartSLOduration=8.002749631 podStartE2EDuration="26.872000921s" totalImagesPullingTime="18.86925129s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 04:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:01:07.870794411 +0000 UTC m=+27.656085647" watchObservedRunningTime="2026-09-08 04:01:07.872000921 +0000 UTC m=+27.657292156"
Sep 08 04:01:08.668691 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:08.668659    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:01:08.668860 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:08.668659    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46n66"
Sep 08 04:01:08.668860 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:08.668807    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kw824" podUID="1082908b-13b3-42fe-952e-7512558aa436"
Sep 08 04:01:08.668860 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:08.668842    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46n66" podUID="15bf9e2a-b4c6-4c30-b7f2-8700093ee320"
Sep 08 04:01:08.668860 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:08.668659    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:01:08.668980 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:08.668917    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6v7m" podUID="7446436d-a655-4644-91b2-d2071bf4e925"
Sep 08 04:01:08.829314 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:08.829277    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:01:08.829787 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:08.829362    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:01:08.829787 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:08.829411    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:01:08.844330 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:08.844299    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:01:08.844442 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:08.844407    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:01:09.399341 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:09.399027    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-h6v7m"]
Sep 08 04:01:09.399523 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:09.399505    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:01:09.399712 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:09.399647    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6v7m" podUID="7446436d-a655-4644-91b2-d2071bf4e925"
Sep 08 04:01:09.399856 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:09.399837    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-46n66"]
Sep 08 04:01:09.399936 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:09.399923    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46n66"
Sep 08 04:01:09.400053 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:09.400032    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46n66" podUID="15bf9e2a-b4c6-4c30-b7f2-8700093ee320"
Sep 08 04:01:09.400464 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:09.400411    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kw824"]
Sep 08 04:01:09.400595 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:09.400519    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:01:09.400665 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:09.400637    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kw824" podUID="1082908b-13b3-42fe-952e-7512558aa436"
Sep 08 04:01:09.833506 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:09.833469    2573 generic.go:356] "Generic (PLEG): container finished" podID="53487bf6-e14b-41e1-ac17-51fcd3b3768f" containerID="ef5f70d9429767f7dce4f1390c059c4daf123ec39fb9978ecc64308d95f3b677" exitCode=0
Sep 08 04:01:09.833955 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:09.833552    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6qplb" event={"ID":"53487bf6-e14b-41e1-ac17-51fcd3b3768f","Type":"ContainerDied","Data":"ef5f70d9429767f7dce4f1390c059c4daf123ec39fb9978ecc64308d95f3b677"}
Sep 08 04:01:10.837720 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:10.837656    2573 generic.go:356] "Generic (PLEG): container finished" podID="53487bf6-e14b-41e1-ac17-51fcd3b3768f" containerID="f058bb1f00071d3f784846179a35f80172b3f5242b4166a2de688a9ce939e740" exitCode=0
Sep 08 04:01:10.838077 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:10.837734    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6qplb" event={"ID":"53487bf6-e14b-41e1-ac17-51fcd3b3768f","Type":"ContainerDied","Data":"f058bb1f00071d3f784846179a35f80172b3f5242b4166a2de688a9ce939e740"}
Sep 08 04:01:11.668857 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:11.668810    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:01:11.669003 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:11.668810    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46n66"
Sep 08 04:01:11.669003 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:11.668928    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6v7m" podUID="7446436d-a655-4644-91b2-d2071bf4e925"
Sep 08 04:01:11.669003 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:11.668948    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:01:11.669087 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:11.669019    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46n66" podUID="15bf9e2a-b4c6-4c30-b7f2-8700093ee320"
Sep 08 04:01:11.669087 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:11.669067    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kw824" podUID="1082908b-13b3-42fe-952e-7512558aa436"
Sep 08 04:01:13.616864 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:13.616838    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zkwhq_ab7d5093-fb91-4469-a88d-488d3ec56493/dns-node-resolver/0.log"
Sep 08 04:01:13.668219 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:13.668189    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:01:13.668219 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:13.668218    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:01:13.668417 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:13.668303    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6v7m" podUID="7446436d-a655-4644-91b2-d2071bf4e925"
Sep 08 04:01:13.668417 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:13.668345    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46n66"
Sep 08 04:01:13.668515 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:13.668436    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46n66" podUID="15bf9e2a-b4c6-4c30-b7f2-8700093ee320"
Sep 08 04:01:13.668584 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:13.668513    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kw824" podUID="1082908b-13b3-42fe-952e-7512558aa436"
Sep 08 04:01:14.189869 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:14.189841    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m2x6p_3223e696-fb13-4dc2-a4fb-86ea4c014fa3/node-ca/0.log"
Sep 08 04:01:14.312412 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:14.312370    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7446436d-a655-4644-91b2-d2071bf4e925-original-pull-secret\") pod \"global-pull-secret-syncer-h6v7m\" (UID: \"7446436d-a655-4644-91b2-d2071bf4e925\") " pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:01:14.312613 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:14.312502    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 04:01:14.312613 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:14.312543    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1082908b-13b3-42fe-952e-7512558aa436-metrics-certs\") pod \"network-metrics-daemon-kw824\" (UID: \"1082908b-13b3-42fe-952e-7512558aa436\") " pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:01:14.312613 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:14.312594    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7446436d-a655-4644-91b2-d2071bf4e925-original-pull-secret podName:7446436d-a655-4644-91b2-d2071bf4e925 nodeName:}" failed. No retries permitted until 2026-09-08 04:01:46.312551668 +0000 UTC m=+66.097842882 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7446436d-a655-4644-91b2-d2071bf4e925-original-pull-secret") pod "global-pull-secret-syncer-h6v7m" (UID: "7446436d-a655-4644-91b2-d2071bf4e925") : object "kube-system"/"original-pull-secret" not registered
Sep 08 04:01:14.312798 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:14.312647    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 04:01:14.312798 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:14.312700    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1082908b-13b3-42fe-952e-7512558aa436-metrics-certs podName:1082908b-13b3-42fe-952e-7512558aa436 nodeName:}" failed. No retries permitted until 2026-09-08 04:01:46.312683115 +0000 UTC m=+66.097974333 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1082908b-13b3-42fe-952e-7512558aa436-metrics-certs") pod "network-metrics-daemon-kw824" (UID: "1082908b-13b3-42fe-952e-7512558aa436") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 04:01:14.413152 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:14.413121    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh8gj\" (UniqueName: \"kubernetes.io/projected/15bf9e2a-b4c6-4c30-b7f2-8700093ee320-kube-api-access-nh8gj\") pod \"network-check-target-46n66\" (UID: \"15bf9e2a-b4c6-4c30-b7f2-8700093ee320\") " pod="openshift-network-diagnostics/network-check-target-46n66"
Sep 08 04:01:14.413337 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:14.413299    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 04:01:14.413337 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:14.413324    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 04:01:14.413337 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:14.413334    2573 projected.go:196] Error preparing data for projected volume kube-api-access-nh8gj for pod openshift-network-diagnostics/network-check-target-46n66: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 04:01:14.413577 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:14.413388    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15bf9e2a-b4c6-4c30-b7f2-8700093ee320-kube-api-access-nh8gj podName:15bf9e2a-b4c6-4c30-b7f2-8700093ee320 nodeName:}" failed. No retries permitted until 2026-09-08 04:01:46.413371325 +0000 UTC m=+66.198662542 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nh8gj" (UniqueName: "kubernetes.io/projected/15bf9e2a-b4c6-4c30-b7f2-8700093ee320-kube-api-access-nh8gj") pod "network-check-target-46n66" (UID: "15bf9e2a-b4c6-4c30-b7f2-8700093ee320") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 04:01:15.668502 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:15.668466    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46n66"
Sep 08 04:01:15.668958 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:15.668619    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46n66" podUID="15bf9e2a-b4c6-4c30-b7f2-8700093ee320"
Sep 08 04:01:15.669047 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:15.669022    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:01:15.669114 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:15.669061    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:01:15.669167 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:15.669147    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6v7m" podUID="7446436d-a655-4644-91b2-d2071bf4e925"
Sep 08 04:01:15.669258 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:15.669236    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kw824" podUID="1082908b-13b3-42fe-952e-7512558aa436"
Sep 08 04:01:16.853693 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:16.853660    2573 generic.go:356] "Generic (PLEG): container finished" podID="53487bf6-e14b-41e1-ac17-51fcd3b3768f" containerID="501dedb2813dc5dc970764722fefab867312140858b203dad26e5fcc10770347" exitCode=0
Sep 08 04:01:16.854046 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:16.853705    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6qplb" event={"ID":"53487bf6-e14b-41e1-ac17-51fcd3b3768f","Type":"ContainerDied","Data":"501dedb2813dc5dc970764722fefab867312140858b203dad26e5fcc10770347"}
Sep 08 04:01:17.668239 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:17.668209    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46n66"
Sep 08 04:01:17.668407 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:17.668214    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:01:17.668407 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:17.668309    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46n66" podUID="15bf9e2a-b4c6-4c30-b7f2-8700093ee320"
Sep 08 04:01:17.668523 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:17.668407    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kw824" podUID="1082908b-13b3-42fe-952e-7512558aa436"
Sep 08 04:01:17.668523 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:17.668215    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:01:17.668523 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:17.668512    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6v7m" podUID="7446436d-a655-4644-91b2-d2071bf4e925"
Sep 08 04:01:17.859092 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:17.859061    2573 generic.go:356] "Generic (PLEG): container finished" podID="53487bf6-e14b-41e1-ac17-51fcd3b3768f" containerID="dd8df619c8a3244b30616c9e720ce162b5011c5967beb201545c2c4428458cbd" exitCode=0
Sep 08 04:01:17.859092 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:17.859097    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6qplb" event={"ID":"53487bf6-e14b-41e1-ac17-51fcd3b3768f","Type":"ContainerDied","Data":"dd8df619c8a3244b30616c9e720ce162b5011c5967beb201545c2c4428458cbd"}
Sep 08 04:01:18.864492 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:18.864415    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6qplb" event={"ID":"53487bf6-e14b-41e1-ac17-51fcd3b3768f","Type":"ContainerStarted","Data":"301b179c230bf14adbcb5b950dc402b36b89f5fbf8277df337b300a48ba2eb05"}
Sep 08 04:01:19.668968 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:19.668934    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46n66"
Sep 08 04:01:19.669129 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:19.669029    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46n66" podUID="15bf9e2a-b4c6-4c30-b7f2-8700093ee320"
Sep 08 04:01:19.669129 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:19.668937    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:01:19.669129 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:19.669065    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:01:19.669229 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:19.669132    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kw824" podUID="1082908b-13b3-42fe-952e-7512558aa436"
Sep 08 04:01:19.669229 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:19.669197    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6v7m" podUID="7446436d-a655-4644-91b2-d2071bf4e925"
Sep 08 04:01:21.668640 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:21.668612    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46n66"
Sep 08 04:01:21.668990 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:21.668704    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:01:21.668990 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:21.668713    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:01:21.668990 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:21.668707    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46n66" podUID="15bf9e2a-b4c6-4c30-b7f2-8700093ee320"
Sep 08 04:01:21.668990 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:21.668805    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kw824" podUID="1082908b-13b3-42fe-952e-7512558aa436"
Sep 08 04:01:21.668990 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:21.668856    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6v7m" podUID="7446436d-a655-4644-91b2-d2071bf4e925"
Sep 08 04:01:23.668867 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:23.668833    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46n66"
Sep 08 04:01:23.668867 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:23.668863    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:01:23.669244 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:23.668931    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46n66" podUID="15bf9e2a-b4c6-4c30-b7f2-8700093ee320"
Sep 08 04:01:23.669244 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:23.668944    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:01:23.669244 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:23.669013    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kw824" podUID="1082908b-13b3-42fe-952e-7512558aa436"
Sep 08 04:01:23.669244 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:23.669090    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6v7m" podUID="7446436d-a655-4644-91b2-d2071bf4e925"
Sep 08 04:01:25.668790 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:25.668757    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:01:25.669235 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:25.668763    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46n66"
Sep 08 04:01:25.669235 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:25.668886    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kw824" podUID="1082908b-13b3-42fe-952e-7512558aa436"
Sep 08 04:01:25.669235 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:25.668763    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:01:25.669235 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:25.668955    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46n66" podUID="15bf9e2a-b4c6-4c30-b7f2-8700093ee320"
Sep 08 04:01:25.669235 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:25.668999    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6v7m" podUID="7446436d-a655-4644-91b2-d2071bf4e925"
Sep 08 04:01:27.667931 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:27.667900    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46n66"
Sep 08 04:01:27.668310 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:27.667949    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:01:27.668310 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:27.667961    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:01:27.668310 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:27.668032    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kw824" podUID="1082908b-13b3-42fe-952e-7512558aa436"
Sep 08 04:01:27.668310 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:27.668099    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6v7m" podUID="7446436d-a655-4644-91b2-d2071bf4e925"
Sep 08 04:01:27.668310 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:27.668175    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46n66" podUID="15bf9e2a-b4c6-4c30-b7f2-8700093ee320"
Sep 08 04:01:29.667910 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:29.667879    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46n66"
Sep 08 04:01:29.668332 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:29.667977    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46n66" podUID="15bf9e2a-b4c6-4c30-b7f2-8700093ee320"
Sep 08 04:01:29.668332 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:29.668055    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:01:29.668332 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:29.668145    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kw824" podUID="1082908b-13b3-42fe-952e-7512558aa436"
Sep 08 04:01:29.668332 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:29.668226    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:01:29.668332 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:29.668302    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6v7m" podUID="7446436d-a655-4644-91b2-d2071bf4e925"
Sep 08 04:01:31.668646 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:31.668611    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:01:31.668646 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:31.668656    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46n66"
Sep 08 04:01:31.669031 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:31.668673    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:01:31.669031 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:31.668721    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46n66" podUID="15bf9e2a-b4c6-4c30-b7f2-8700093ee320"
Sep 08 04:01:31.669031 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:31.668784    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kw824" podUID="1082908b-13b3-42fe-952e-7512558aa436"
Sep 08 04:01:31.669031 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:31.668860    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6v7m" podUID="7446436d-a655-4644-91b2-d2071bf4e925"
Sep 08 04:01:33.668687 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:33.668661    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46n66"
Sep 08 04:01:33.669107 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:33.668692    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:01:33.669107 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:33.668743    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:01:33.669107 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:33.668826    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46n66" podUID="15bf9e2a-b4c6-4c30-b7f2-8700093ee320"
Sep 08 04:01:33.669107 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:33.668941    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6v7m" podUID="7446436d-a655-4644-91b2-d2071bf4e925"
Sep 08 04:01:33.669107 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:33.669030    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kw824" podUID="1082908b-13b3-42fe-952e-7512558aa436"
Sep 08 04:01:35.668039 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:35.668009    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46n66"
Sep 08 04:01:35.668039 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:35.668024    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:01:35.668422 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:35.668099    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46n66" podUID="15bf9e2a-b4c6-4c30-b7f2-8700093ee320"
Sep 08 04:01:35.668422 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:35.668125    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:01:35.668422 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:35.668178    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kw824" podUID="1082908b-13b3-42fe-952e-7512558aa436"
Sep 08 04:01:35.668422 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:35.668232    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6v7m" podUID="7446436d-a655-4644-91b2-d2071bf4e925"
Sep 08 04:01:36.457072 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.457043    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-35.ec2.internal" event="NodeReady"
Sep 08 04:01:36.457212 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.457160    2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 08 04:01:36.505814 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.505768    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6qplb" podStartSLOduration=24.948755502 podStartE2EDuration="55.505752733s" totalImagesPullingTime="30.556997231s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 04:00:41 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:01:18.89398453 +0000 UTC m=+38.679275766" watchObservedRunningTime="2026-09-08 04:01:36.505752733 +0000 UTC m=+56.291043990"
Sep 08 04:01:36.505958 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.505948    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-c9r58"]
Sep 08 04:01:36.507569 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.507543    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-c9r58"
Sep 08 04:01:36.510196 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.510066    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 08 04:01:36.510353 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.510283    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 08 04:01:36.510416 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.510368    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9nxct\""
Sep 08 04:01:36.510474 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.510447    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 08 04:01:36.510835 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.510818    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xv8jz"]
Sep 08 04:01:36.512338 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.512321    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xv8jz"
Sep 08 04:01:36.515934 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.515913    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 08 04:01:36.515934 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.515920    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 08 04:01:36.516292 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.516266    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7wgqk\""
Sep 08 04:01:36.516393 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.516334    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 08 04:01:36.517017 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.517000    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 08 04:01:36.517724 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.517705    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-c9r58"]
Sep 08 04:01:36.527459 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.527437    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xv8jz"]
Sep 08 04:01:36.577102 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.577033    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8rnr\" (UniqueName: \"kubernetes.io/projected/e1cfc3e6-358d-4c0a-9fe0-ef347b598eed-kube-api-access-n8rnr\") pod \"insights-runtime-extractor-xv8jz\" (UID: \"e1cfc3e6-358d-4c0a-9fe0-ef347b598eed\") " pod="openshift-insights/insights-runtime-extractor-xv8jz"
Sep 08 04:01:36.577102 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.577071    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67c20357-ed4c-4e0d-9c10-39a6acf1a312-cert\") pod \"ingress-canary-c9r58\" (UID: \"67c20357-ed4c-4e0d-9c10-39a6acf1a312\") " pod="openshift-ingress-canary/ingress-canary-c9r58"
Sep 08 04:01:36.577102 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.577092    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m8db\" (UniqueName: \"kubernetes.io/projected/67c20357-ed4c-4e0d-9c10-39a6acf1a312-kube-api-access-5m8db\") pod \"ingress-canary-c9r58\" (UID: \"67c20357-ed4c-4e0d-9c10-39a6acf1a312\") " pod="openshift-ingress-canary/ingress-canary-c9r58"
Sep 08 04:01:36.577274 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.577116    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e1cfc3e6-358d-4c0a-9fe0-ef347b598eed-crio-socket\") pod \"insights-runtime-extractor-xv8jz\" (UID: \"e1cfc3e6-358d-4c0a-9fe0-ef347b598eed\") " pod="openshift-insights/insights-runtime-extractor-xv8jz"
Sep 08 04:01:36.577274 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.577150    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e1cfc3e6-358d-4c0a-9fe0-ef347b598eed-data-volume\") pod \"insights-runtime-extractor-xv8jz\" (UID: \"e1cfc3e6-358d-4c0a-9fe0-ef347b598eed\") " pod="openshift-insights/insights-runtime-extractor-xv8jz"
Sep 08 04:01:36.577274 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.577191    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e1cfc3e6-358d-4c0a-9fe0-ef347b598eed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xv8jz\" (UID: \"e1cfc3e6-358d-4c0a-9fe0-ef347b598eed\") " pod="openshift-insights/insights-runtime-extractor-xv8jz"
Sep 08 04:01:36.577274 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.577211    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e1cfc3e6-358d-4c0a-9fe0-ef347b598eed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xv8jz\" (UID: \"e1cfc3e6-358d-4c0a-9fe0-ef347b598eed\") " pod="openshift-insights/insights-runtime-extractor-xv8jz"
Sep 08 04:01:36.615041 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.615012    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vj8wn"]
Sep 08 04:01:36.617891 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.617877    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vj8wn"
Sep 08 04:01:36.620163 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.620145    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 08 04:01:36.620261 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.620146    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-26sdq\""
Sep 08 04:01:36.620726 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.620711    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 08 04:01:36.629230 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.629207    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vj8wn"]
Sep 08 04:01:36.677733 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.677703    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8rnr\" (UniqueName: \"kubernetes.io/projected/e1cfc3e6-358d-4c0a-9fe0-ef347b598eed-kube-api-access-n8rnr\") pod \"insights-runtime-extractor-xv8jz\" (UID: \"e1cfc3e6-358d-4c0a-9fe0-ef347b598eed\") " pod="openshift-insights/insights-runtime-extractor-xv8jz"
Sep 08 04:01:36.678170 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.677740    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a1b995a0-28cf-4f60-aa01-9cf3c768f4d3-config-volume\") pod \"dns-default-vj8wn\" (UID: \"a1b995a0-28cf-4f60-aa01-9cf3c768f4d3\") " pod="openshift-dns/dns-default-vj8wn"
Sep 08 04:01:36.678170 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.677778    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67c20357-ed4c-4e0d-9c10-39a6acf1a312-cert\") pod \"ingress-canary-c9r58\" (UID: \"67c20357-ed4c-4e0d-9c10-39a6acf1a312\") " pod="openshift-ingress-canary/ingress-canary-c9r58"
Sep 08 04:01:36.678170 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.677805    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m8db\" (UniqueName: \"kubernetes.io/projected/67c20357-ed4c-4e0d-9c10-39a6acf1a312-kube-api-access-5m8db\") pod \"ingress-canary-c9r58\" (UID: \"67c20357-ed4c-4e0d-9c10-39a6acf1a312\") " pod="openshift-ingress-canary/ingress-canary-c9r58"
Sep 08 04:01:36.678170 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.677829    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1b995a0-28cf-4f60-aa01-9cf3c768f4d3-tmp-dir\") pod \"dns-default-vj8wn\" (UID: \"a1b995a0-28cf-4f60-aa01-9cf3c768f4d3\") " pod="openshift-dns/dns-default-vj8wn"
Sep 08 04:01:36.678170 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.677852    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4s5h\" (UniqueName: \"kubernetes.io/projected/a1b995a0-28cf-4f60-aa01-9cf3c768f4d3-kube-api-access-v4s5h\") pod \"dns-default-vj8wn\" (UID: \"a1b995a0-28cf-4f60-aa01-9cf3c768f4d3\") " pod="openshift-dns/dns-default-vj8wn"
Sep 08 04:01:36.678170 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.677884    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e1cfc3e6-358d-4c0a-9fe0-ef347b598eed-crio-socket\") pod \"insights-runtime-extractor-xv8jz\" (UID: \"e1cfc3e6-358d-4c0a-9fe0-ef347b598eed\") " pod="openshift-insights/insights-runtime-extractor-xv8jz"
Sep 08 04:01:36.678170 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.677943    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e1cfc3e6-358d-4c0a-9fe0-ef347b598eed-crio-socket\") pod \"insights-runtime-extractor-xv8jz\" (UID: \"e1cfc3e6-358d-4c0a-9fe0-ef347b598eed\") " pod="openshift-insights/insights-runtime-extractor-xv8jz"
Sep 08 04:01:36.678170 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.677950    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e1cfc3e6-358d-4c0a-9fe0-ef347b598eed-data-volume\") pod \"insights-runtime-extractor-xv8jz\" (UID: \"e1cfc3e6-358d-4c0a-9fe0-ef347b598eed\") " pod="openshift-insights/insights-runtime-extractor-xv8jz"
Sep 08 04:01:36.678170 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.677979    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e1cfc3e6-358d-4c0a-9fe0-ef347b598eed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xv8jz\" (UID: \"e1cfc3e6-358d-4c0a-9fe0-ef347b598eed\") " pod="openshift-insights/insights-runtime-extractor-xv8jz"
Sep 08 04:01:36.678170 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.677997    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e1cfc3e6-358d-4c0a-9fe0-ef347b598eed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xv8jz\" (UID: \"e1cfc3e6-358d-4c0a-9fe0-ef347b598eed\") " pod="openshift-insights/insights-runtime-extractor-xv8jz"
Sep 08 04:01:36.678170 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.678029    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1b995a0-28cf-4f60-aa01-9cf3c768f4d3-metrics-tls\") pod \"dns-default-vj8wn\" (UID: \"a1b995a0-28cf-4f60-aa01-9cf3c768f4d3\") " pod="openshift-dns/dns-default-vj8wn"
Sep 08 04:01:36.678648 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.678223    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e1cfc3e6-358d-4c0a-9fe0-ef347b598eed-data-volume\") pod \"insights-runtime-extractor-xv8jz\" (UID: \"e1cfc3e6-358d-4c0a-9fe0-ef347b598eed\") " pod="openshift-insights/insights-runtime-extractor-xv8jz"
Sep 08 04:01:36.678853 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.678837    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e1cfc3e6-358d-4c0a-9fe0-ef347b598eed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xv8jz\" (UID: \"e1cfc3e6-358d-4c0a-9fe0-ef347b598eed\") " pod="openshift-insights/insights-runtime-extractor-xv8jz"
Sep 08 04:01:36.681919 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.681889    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e1cfc3e6-358d-4c0a-9fe0-ef347b598eed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xv8jz\" (UID: \"e1cfc3e6-358d-4c0a-9fe0-ef347b598eed\") " pod="openshift-insights/insights-runtime-extractor-xv8jz"
Sep 08 04:01:36.682015 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.682007    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67c20357-ed4c-4e0d-9c10-39a6acf1a312-cert\") pod \"ingress-canary-c9r58\" (UID: \"67c20357-ed4c-4e0d-9c10-39a6acf1a312\") " pod="openshift-ingress-canary/ingress-canary-c9r58"
Sep 08 04:01:36.686584 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.686537    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m8db\" (UniqueName: \"kubernetes.io/projected/67c20357-ed4c-4e0d-9c10-39a6acf1a312-kube-api-access-5m8db\") pod \"ingress-canary-c9r58\" (UID: \"67c20357-ed4c-4e0d-9c10-39a6acf1a312\") " pod="openshift-ingress-canary/ingress-canary-c9r58"
Sep 08 04:01:36.686689 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.686605    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8rnr\" (UniqueName: \"kubernetes.io/projected/e1cfc3e6-358d-4c0a-9fe0-ef347b598eed-kube-api-access-n8rnr\") pod \"insights-runtime-extractor-xv8jz\" (UID: \"e1cfc3e6-358d-4c0a-9fe0-ef347b598eed\") " pod="openshift-insights/insights-runtime-extractor-xv8jz"
Sep 08 04:01:36.778420 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.778381    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1b995a0-28cf-4f60-aa01-9cf3c768f4d3-tmp-dir\") pod \"dns-default-vj8wn\" (UID: \"a1b995a0-28cf-4f60-aa01-9cf3c768f4d3\") " pod="openshift-dns/dns-default-vj8wn"
Sep 08 04:01:36.778420 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.778419    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4s5h\" (UniqueName: \"kubernetes.io/projected/a1b995a0-28cf-4f60-aa01-9cf3c768f4d3-kube-api-access-v4s5h\") pod \"dns-default-vj8wn\" (UID: \"a1b995a0-28cf-4f60-aa01-9cf3c768f4d3\") " pod="openshift-dns/dns-default-vj8wn"
Sep 08 04:01:36.778673 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.778463    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1b995a0-28cf-4f60-aa01-9cf3c768f4d3-metrics-tls\") pod \"dns-default-vj8wn\" (UID: \"a1b995a0-28cf-4f60-aa01-9cf3c768f4d3\") " pod="openshift-dns/dns-default-vj8wn"
Sep 08 04:01:36.778673 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.778519    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a1b995a0-28cf-4f60-aa01-9cf3c768f4d3-config-volume\") pod \"dns-default-vj8wn\" (UID: \"a1b995a0-28cf-4f60-aa01-9cf3c768f4d3\") " pod="openshift-dns/dns-default-vj8wn"
Sep 08 04:01:36.778803 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.778781    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1b995a0-28cf-4f60-aa01-9cf3c768f4d3-tmp-dir\") pod \"dns-default-vj8wn\" (UID: \"a1b995a0-28cf-4f60-aa01-9cf3c768f4d3\") " pod="openshift-dns/dns-default-vj8wn"
Sep 08 04:01:36.779113 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.779092    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a1b995a0-28cf-4f60-aa01-9cf3c768f4d3-config-volume\") pod \"dns-default-vj8wn\" (UID: \"a1b995a0-28cf-4f60-aa01-9cf3c768f4d3\") " pod="openshift-dns/dns-default-vj8wn"
Sep 08 04:01:36.780923 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.780901    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1b995a0-28cf-4f60-aa01-9cf3c768f4d3-metrics-tls\") pod \"dns-default-vj8wn\" (UID: \"a1b995a0-28cf-4f60-aa01-9cf3c768f4d3\") " pod="openshift-dns/dns-default-vj8wn"
Sep 08 04:01:36.786744 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.786721    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4s5h\" (UniqueName: \"kubernetes.io/projected/a1b995a0-28cf-4f60-aa01-9cf3c768f4d3-kube-api-access-v4s5h\") pod \"dns-default-vj8wn\" (UID: \"a1b995a0-28cf-4f60-aa01-9cf3c768f4d3\") " pod="openshift-dns/dns-default-vj8wn"
Sep 08 04:01:36.818643 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.818619    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-c9r58"
Sep 08 04:01:36.823359 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.823341    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xv8jz"
Sep 08 04:01:36.925946 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:36.925911    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vj8wn"
Sep 08 04:01:37.137631 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:37.137547    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xv8jz"]
Sep 08 04:01:37.142915 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:37.141239    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-c9r58"]
Sep 08 04:01:37.144349 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:01:37.144303    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67c20357_ed4c_4e0d_9c10_39a6acf1a312.slice/crio-2f03a025d623a7ef61f6b8cd128530675158cd5a104ac7e5eec1a5fca075090b WatchSource:0}: Error finding container 2f03a025d623a7ef61f6b8cd128530675158cd5a104ac7e5eec1a5fca075090b: Status 404 returned error can't find the container with id 2f03a025d623a7ef61f6b8cd128530675158cd5a104ac7e5eec1a5fca075090b
Sep 08 04:01:37.212446 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:37.212424    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vj8wn"]
Sep 08 04:01:37.215530 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:01:37.215506    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1b995a0_28cf_4f60_aa01_9cf3c768f4d3.slice/crio-0cbd0a82104e85602a0154d22d6b1d922ad34dd614202e1f4ca5d38426bc4f2f WatchSource:0}: Error finding container 0cbd0a82104e85602a0154d22d6b1d922ad34dd614202e1f4ca5d38426bc4f2f: Status 404 returned error can't find the container with id 0cbd0a82104e85602a0154d22d6b1d922ad34dd614202e1f4ca5d38426bc4f2f
Sep 08 04:01:37.668970 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:37.668934    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46n66"
Sep 08 04:01:37.669338 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:37.668934    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:01:37.669767 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:37.668947    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:01:37.671629 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:37.671610    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 04:01:37.671887 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:37.671866    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 04:01:37.672802 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:37.672777    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 04:01:37.673091 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:37.673076    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 04:01:37.673262 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:37.673247    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-blqwr\""
Sep 08 04:01:37.673461 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:37.673446    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f9485\""
Sep 08 04:01:37.909918 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:37.909858    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vj8wn" event={"ID":"a1b995a0-28cf-4f60-aa01-9cf3c768f4d3","Type":"ContainerStarted","Data":"0cbd0a82104e85602a0154d22d6b1d922ad34dd614202e1f4ca5d38426bc4f2f"}
Sep 08 04:01:37.912500 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:37.912474    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xv8jz" event={"ID":"e1cfc3e6-358d-4c0a-9fe0-ef347b598eed","Type":"ContainerStarted","Data":"cfb9e31698e8c1d2be226af5f7931077d10bd72ae70a682804b027be8517d7be"}
Sep 08 04:01:37.912622 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:37.912518    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xv8jz" event={"ID":"e1cfc3e6-358d-4c0a-9fe0-ef347b598eed","Type":"ContainerStarted","Data":"1900b297be5b5a95d3a4c220ea572e89c463250b50353fffd96bff2fd773a76b"}
Sep 08 04:01:37.915234 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:37.915191    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-c9r58" event={"ID":"67c20357-ed4c-4e0d-9c10-39a6acf1a312","Type":"ContainerStarted","Data":"2f03a025d623a7ef61f6b8cd128530675158cd5a104ac7e5eec1a5fca075090b"}
Sep 08 04:01:39.922316 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:39.922285    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vj8wn" event={"ID":"a1b995a0-28cf-4f60-aa01-9cf3c768f4d3","Type":"ContainerStarted","Data":"a449d4d59a97deb9b57f52f8a297578470e05c99cd48d6d90097085f28302b80"}
Sep 08 04:01:39.922706 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:39.922349    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vj8wn" event={"ID":"a1b995a0-28cf-4f60-aa01-9cf3c768f4d3","Type":"ContainerStarted","Data":"6c0b660e1c2ee3baa538a38153d80d67b6d41d27cdf4cedb4a554a75e573f6fc"}
Sep 08 04:01:39.922706 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:39.922381    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vj8wn"
Sep 08 04:01:39.924192 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:39.924164    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xv8jz" event={"ID":"e1cfc3e6-358d-4c0a-9fe0-ef347b598eed","Type":"ContainerStarted","Data":"f556a8ebae90ced4a2645d6b1c4a38d46862bfb7db7ff44bfebbad637bd109a3"}
Sep 08 04:01:39.925771 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:39.925734    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-c9r58" event={"ID":"67c20357-ed4c-4e0d-9c10-39a6acf1a312","Type":"ContainerStarted","Data":"a5dfd7a5389147ceec5d167f5cd2e54ff58b0cc57e883dd99dd12b700b8d8382"}
Sep 08 04:01:39.938548 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:39.938504    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vj8wn" podStartSLOduration=1.428886732 podStartE2EDuration="3.938490096s" totalImagesPullingTime="2.509603364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:01:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:01:39.937761549 +0000 UTC m=+59.723052785" watchObservedRunningTime="2026-09-08 04:01:39.938490096 +0000 UTC m=+59.723781375"
Sep 08 04:01:39.954816 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:39.954779    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-c9r58" podStartSLOduration=1.3677944389999999 podStartE2EDuration="3.954762464s" totalImagesPullingTime="2.586968025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:01:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:01:39.95384786 +0000 UTC m=+59.739139099" watchObservedRunningTime="2026-09-08 04:01:39.954762464 +0000 UTC m=+59.740053700"
Sep 08 04:01:40.849274 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:40.849245    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fcwwv"
Sep 08 04:01:41.937034 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:41.937000    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xv8jz" event={"ID":"e1cfc3e6-358d-4c0a-9fe0-ef347b598eed","Type":"ContainerStarted","Data":"72a48c17f3ef960c6de31ad48c8a8fe092b4fa97bf189bc44b9844bdc2604ae9"}
Sep 08 04:01:41.956533 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:41.956492    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xv8jz" podStartSLOduration=3.285258443 podStartE2EDuration="5.956479113s" totalImagesPullingTime="2.67122067s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 04:01:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:01:41.955884136 +0000 UTC m=+61.741175373" watchObservedRunningTime="2026-09-08 04:01:41.956479113 +0000 UTC m=+61.741770348"
Sep 08 04:01:42.765637 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:42.765601    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-mmmhp"]
Sep 08 04:01:42.767302 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:42.767285    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-mmmhp"
Sep 08 04:01:42.769790 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:42.769769    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 08 04:01:42.769871 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:42.769773    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-r6xgc\""
Sep 08 04:01:42.779074 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:42.779054    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-mmmhp"]
Sep 08 04:01:42.821010 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:42.820984    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/33d98bab-6aac-4b0f-bac6-75228cbe87ba-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-mmmhp\" (UID: \"33d98bab-6aac-4b0f-bac6-75228cbe87ba\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-mmmhp"
Sep 08 04:01:42.921829 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:42.921797    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/33d98bab-6aac-4b0f-bac6-75228cbe87ba-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-mmmhp\" (UID: \"33d98bab-6aac-4b0f-bac6-75228cbe87ba\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-mmmhp"
Sep 08 04:01:42.921938 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:42.921912    2573 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 08 04:01:42.921977 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:42.921963    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33d98bab-6aac-4b0f-bac6-75228cbe87ba-tls-certificates podName:33d98bab-6aac-4b0f-bac6-75228cbe87ba nodeName:}" failed. No retries permitted until 2026-09-08 04:01:43.421950922 +0000 UTC m=+63.207242136 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/33d98bab-6aac-4b0f-bac6-75228cbe87ba-tls-certificates") pod "prometheus-operator-admission-webhook-78f599db79-mmmhp" (UID: "33d98bab-6aac-4b0f-bac6-75228cbe87ba") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 08 04:01:43.426853 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:43.426824    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/33d98bab-6aac-4b0f-bac6-75228cbe87ba-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-mmmhp\" (UID: \"33d98bab-6aac-4b0f-bac6-75228cbe87ba\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-mmmhp"
Sep 08 04:01:43.429326 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:43.429305    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/33d98bab-6aac-4b0f-bac6-75228cbe87ba-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-mmmhp\" (UID: \"33d98bab-6aac-4b0f-bac6-75228cbe87ba\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-mmmhp"
Sep 08 04:01:43.675383 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:43.675349    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-mmmhp"
Sep 08 04:01:43.943693 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:43.943668    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-mmmhp"]
Sep 08 04:01:43.943806 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:01:43.943710    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33d98bab_6aac_4b0f_bac6_75228cbe87ba.slice/crio-1a73b26eddff39f792b81e0301db739a5e8c1150c96b3b8449b9640c297995ba WatchSource:0}: Error finding container 1a73b26eddff39f792b81e0301db739a5e8c1150c96b3b8449b9640c297995ba: Status 404 returned error can't find the container with id 1a73b26eddff39f792b81e0301db739a5e8c1150c96b3b8449b9640c297995ba
Sep 08 04:01:44.950847 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:44.950784    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-mmmhp" event={"ID":"33d98bab-6aac-4b0f-bac6-75228cbe87ba","Type":"ContainerStarted","Data":"1a73b26eddff39f792b81e0301db739a5e8c1150c96b3b8449b9640c297995ba"}
Sep 08 04:01:45.955107 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:45.955069    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-mmmhp" event={"ID":"33d98bab-6aac-4b0f-bac6-75228cbe87ba","Type":"ContainerStarted","Data":"91a17c3d7c19c108908e04afb21f8e6528b7ebbd8a9dd0d8dc091bda8b77b5a5"}
Sep 08 04:01:45.955575 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:45.955287    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-mmmhp"
Sep 08 04:01:45.959972 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:45.959951    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-mmmhp"
Sep 08 04:01:45.972851 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:45.972812    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-mmmhp" podStartSLOduration=2.889513833 podStartE2EDuration="3.972800636s" totalImagesPullingTime="1.083286803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:01:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:01:45.972062328 +0000 UTC m=+65.757353574" watchObservedRunningTime="2026-09-08 04:01:45.972800636 +0000 UTC m=+65.758091871"
Sep 08 04:01:46.344908 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:46.344870    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1082908b-13b3-42fe-952e-7512558aa436-metrics-certs\") pod \"network-metrics-daemon-kw824\" (UID: \"1082908b-13b3-42fe-952e-7512558aa436\") " pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:01:46.345085 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:46.344928    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7446436d-a655-4644-91b2-d2071bf4e925-original-pull-secret\") pod \"global-pull-secret-syncer-h6v7m\" (UID: \"7446436d-a655-4644-91b2-d2071bf4e925\") " pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:01:46.347519 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:46.347498    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 04:01:46.347640 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:46.347499    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 04:01:46.357617 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:46.357598    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7446436d-a655-4644-91b2-d2071bf4e925-original-pull-secret\") pod \"global-pull-secret-syncer-h6v7m\" (UID: \"7446436d-a655-4644-91b2-d2071bf4e925\") " pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:01:46.357691 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:46.357648    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1082908b-13b3-42fe-952e-7512558aa436-metrics-certs\") pod \"network-metrics-daemon-kw824\" (UID: \"1082908b-13b3-42fe-952e-7512558aa436\") " pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:01:46.404343 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:46.404314    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6v7m"
Sep 08 04:01:46.413610 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:46.413587    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-blqwr\""
Sep 08 04:01:46.421326 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:46.421308    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kw824"
Sep 08 04:01:46.445373 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:46.445341    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh8gj\" (UniqueName: \"kubernetes.io/projected/15bf9e2a-b4c6-4c30-b7f2-8700093ee320-kube-api-access-nh8gj\") pod \"network-check-target-46n66\" (UID: \"15bf9e2a-b4c6-4c30-b7f2-8700093ee320\") " pod="openshift-network-diagnostics/network-check-target-46n66"
Sep 08 04:01:46.448125 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:46.448100    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 04:01:46.458674 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:46.458189    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 04:01:46.468526 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:46.468503    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh8gj\" (UniqueName: \"kubernetes.io/projected/15bf9e2a-b4c6-4c30-b7f2-8700093ee320-kube-api-access-nh8gj\") pod \"network-check-target-46n66\" (UID: \"15bf9e2a-b4c6-4c30-b7f2-8700093ee320\") " pod="openshift-network-diagnostics/network-check-target-46n66"
Sep 08 04:01:46.672566 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:46.672531    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-h6v7m"]
Sep 08 04:01:46.673041 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:01:46.673013    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7446436d_a655_4644_91b2_d2071bf4e925.slice/crio-c715496518467bcbe7348faa2a34f2372a65f598fbbc24f00981f75357cdbf57 WatchSource:0}: Error finding container c715496518467bcbe7348faa2a34f2372a65f598fbbc24f00981f75357cdbf57: Status 404 returned error can't find the container with id c715496518467bcbe7348faa2a34f2372a65f598fbbc24f00981f75357cdbf57
Sep 08 04:01:46.685675 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:46.685650    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f9485\""
Sep 08 04:01:46.692542 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:46.692499    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kw824"]
Sep 08 04:01:46.693712 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:46.693695    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46n66"
Sep 08 04:01:46.694753 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:01:46.694731    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1082908b_13b3_42fe_952e_7512558aa436.slice/crio-465dcae2c69a34e327abb6630cf65c71127be89b52b51f3c4ace4da30922b64b WatchSource:0}: Error finding container 465dcae2c69a34e327abb6630cf65c71127be89b52b51f3c4ace4da30922b64b: Status 404 returned error can't find the container with id 465dcae2c69a34e327abb6630cf65c71127be89b52b51f3c4ace4da30922b64b
Sep 08 04:01:46.845178 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:46.845147    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-v9kft"]
Sep 08 04:01:46.849145 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:46.849128    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-v9kft"
Sep 08 04:01:46.853169 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:46.853139    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 08 04:01:46.853262 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:46.853202    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 08 04:01:46.853335 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:46.853304    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 08 04:01:46.853461 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:46.853335    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 08 04:01:46.853461 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:46.853406    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-7sp9x\""
Sep 08 04:01:46.853592 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:46.853466    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 08 04:01:46.864194 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:46.864173    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-v9kft"]
Sep 08 04:01:46.948689 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:46.948632    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0b163fe-6d60-4468-939d-91540e48a582-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-v9kft\" (UID: \"e0b163fe-6d60-4468-939d-91540e48a582\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-v9kft"
Sep 08 04:01:46.948689 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:46.948678    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0b163fe-6d60-4468-939d-91540e48a582-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-v9kft\" (UID: \"e0b163fe-6d60-4468-939d-91540e48a582\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-v9kft"
Sep 08 04:01:46.948837 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:46.948697    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pkbt\" (UniqueName: \"kubernetes.io/projected/e0b163fe-6d60-4468-939d-91540e48a582-kube-api-access-9pkbt\") pod \"prometheus-operator-6f4946db56-v9kft\" (UID: \"e0b163fe-6d60-4468-939d-91540e48a582\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-v9kft"
Sep 08 04:01:46.948837 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:46.948762    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0b163fe-6d60-4468-939d-91540e48a582-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-v9kft\" (UID: \"e0b163fe-6d60-4468-939d-91540e48a582\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-v9kft"
Sep 08 04:01:46.959054 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:46.959025    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kw824" event={"ID":"1082908b-13b3-42fe-952e-7512558aa436","Type":"ContainerStarted","Data":"465dcae2c69a34e327abb6630cf65c71127be89b52b51f3c4ace4da30922b64b"}
Sep 08 04:01:46.960450 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:46.960410    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-h6v7m" event={"ID":"7446436d-a655-4644-91b2-d2071bf4e925","Type":"ContainerStarted","Data":"c715496518467bcbe7348faa2a34f2372a65f598fbbc24f00981f75357cdbf57"}
Sep 08 04:01:46.961432 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:46.961411    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-46n66"]
Sep 08 04:01:46.965614 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:01:46.965595    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15bf9e2a_b4c6_4c30_b7f2_8700093ee320.slice/crio-b662cca5ba737dd829cad0246876b4c80be3677ba8e1776806d348dae658c140 WatchSource:0}: Error finding container b662cca5ba737dd829cad0246876b4c80be3677ba8e1776806d348dae658c140: Status 404 returned error can't find the container with id b662cca5ba737dd829cad0246876b4c80be3677ba8e1776806d348dae658c140
Sep 08 04:01:47.049199 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:47.049171    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0b163fe-6d60-4468-939d-91540e48a582-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-v9kft\" (UID: \"e0b163fe-6d60-4468-939d-91540e48a582\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-v9kft"
Sep 08 04:01:47.049305 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:47.049209    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pkbt\" (UniqueName: \"kubernetes.io/projected/e0b163fe-6d60-4468-939d-91540e48a582-kube-api-access-9pkbt\") pod \"prometheus-operator-6f4946db56-v9kft\" (UID: \"e0b163fe-6d60-4468-939d-91540e48a582\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-v9kft"
Sep 08 04:01:47.049305 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:47.049236    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0b163fe-6d60-4468-939d-91540e48a582-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-v9kft\" (UID: \"e0b163fe-6d60-4468-939d-91540e48a582\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-v9kft"
Sep 08 04:01:47.049305 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:47.049290    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0b163fe-6d60-4468-939d-91540e48a582-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-v9kft\" (UID: \"e0b163fe-6d60-4468-939d-91540e48a582\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-v9kft"
Sep 08 04:01:47.049458 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:47.049384    2573 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 08 04:01:47.049458 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:47.049455    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0b163fe-6d60-4468-939d-91540e48a582-prometheus-operator-tls podName:e0b163fe-6d60-4468-939d-91540e48a582 nodeName:}" failed. No retries permitted until 2026-09-08 04:01:47.54943377 +0000 UTC m=+67.334724985 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/e0b163fe-6d60-4468-939d-91540e48a582-prometheus-operator-tls") pod "prometheus-operator-6f4946db56-v9kft" (UID: "e0b163fe-6d60-4468-939d-91540e48a582") : secret "prometheus-operator-tls" not found
Sep 08 04:01:47.049925 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:47.049904    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0b163fe-6d60-4468-939d-91540e48a582-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-v9kft\" (UID: \"e0b163fe-6d60-4468-939d-91540e48a582\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-v9kft"
Sep 08 04:01:47.051594 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:47.051573    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0b163fe-6d60-4468-939d-91540e48a582-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-v9kft\" (UID: \"e0b163fe-6d60-4468-939d-91540e48a582\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-v9kft"
Sep 08 04:01:47.060270 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:47.060249    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pkbt\" (UniqueName: \"kubernetes.io/projected/e0b163fe-6d60-4468-939d-91540e48a582-kube-api-access-9pkbt\") pod \"prometheus-operator-6f4946db56-v9kft\" (UID: \"e0b163fe-6d60-4468-939d-91540e48a582\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-v9kft"
Sep 08 04:01:47.552936 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:47.552892    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0b163fe-6d60-4468-939d-91540e48a582-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-v9kft\" (UID: \"e0b163fe-6d60-4468-939d-91540e48a582\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-v9kft"
Sep 08 04:01:47.555717 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:47.555672    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0b163fe-6d60-4468-939d-91540e48a582-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-v9kft\" (UID: \"e0b163fe-6d60-4468-939d-91540e48a582\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-v9kft"
Sep 08 04:01:47.758124 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:47.758100    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-v9kft"
Sep 08 04:01:47.965701 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:47.965670    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kw824" event={"ID":"1082908b-13b3-42fe-952e-7512558aa436","Type":"ContainerStarted","Data":"715be5e916b58ca944ee652c3b34813876d6302ea7ab4122b80049cf434af4cf"}
Sep 08 04:01:47.966093 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:47.965722    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kw824" event={"ID":"1082908b-13b3-42fe-952e-7512558aa436","Type":"ContainerStarted","Data":"7f67b3c32a83f67c49f01a730c71b4040368095c6943e1280bccde17e6a2e937"}
Sep 08 04:01:47.966888 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:47.966866    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-46n66" event={"ID":"15bf9e2a-b4c6-4c30-b7f2-8700093ee320","Type":"ContainerStarted","Data":"b662cca5ba737dd829cad0246876b4c80be3677ba8e1776806d348dae658c140"}
Sep 08 04:01:48.032404 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:48.032360    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kw824" podStartSLOduration=66.004896949 podStartE2EDuration="1m7.032341745s" totalImagesPullingTime="1.027444796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:01:47.985225148 +0000 UTC m=+67.770516386" watchObservedRunningTime="2026-09-08 04:01:48.032341745 +0000 UTC m=+67.817632981"
Sep 08 04:01:48.032931 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:48.032916    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-v9kft"]
Sep 08 04:01:48.035289 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:01:48.035267    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0b163fe_6d60_4468_939d_91540e48a582.slice/crio-ff992b2b34ff11e76a8ec533b620f10349357fc463a75ab4eef298cc977f7679 WatchSource:0}: Error finding container ff992b2b34ff11e76a8ec533b620f10349357fc463a75ab4eef298cc977f7679: Status 404 returned error can't find the container with id ff992b2b34ff11e76a8ec533b620f10349357fc463a75ab4eef298cc977f7679
Sep 08 04:01:48.184042 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:48.183979    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-p9x5z"]
Sep 08 04:01:48.186953 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:48.186939    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-p9x5z"
Sep 08 04:01:48.189489 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:48.189470    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-rvdjd\""
Sep 08 04:01:48.189591 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:48.189517    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 08 04:01:48.190013 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:48.189975    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 08 04:01:48.198087 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:48.198067    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-p9x5z"]
Sep 08 04:01:48.257925 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:48.257899    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6w24\" (UniqueName: \"kubernetes.io/projected/32b9b5a6-6468-4313-9b58-3c4daca3ab41-kube-api-access-n6w24\") pod \"downloads-85d98c998f-p9x5z\" (UID: \"32b9b5a6-6468-4313-9b58-3c4daca3ab41\") " pod="openshift-console/downloads-85d98c998f-p9x5z"
Sep 08 04:01:48.358154 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:48.358117    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6w24\" (UniqueName: \"kubernetes.io/projected/32b9b5a6-6468-4313-9b58-3c4daca3ab41-kube-api-access-n6w24\") pod \"downloads-85d98c998f-p9x5z\" (UID: \"32b9b5a6-6468-4313-9b58-3c4daca3ab41\") " pod="openshift-console/downloads-85d98c998f-p9x5z"
Sep 08 04:01:48.366433 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:48.366405    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6w24\" (UniqueName: \"kubernetes.io/projected/32b9b5a6-6468-4313-9b58-3c4daca3ab41-kube-api-access-n6w24\") pod \"downloads-85d98c998f-p9x5z\" (UID: \"32b9b5a6-6468-4313-9b58-3c4daca3ab41\") " pod="openshift-console/downloads-85d98c998f-p9x5z"
Sep 08 04:01:48.495688 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:48.495617    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-p9x5z"
Sep 08 04:01:48.768869 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:48.768841    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-p9x5z"]
Sep 08 04:01:48.772973 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:01:48.772943    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32b9b5a6_6468_4313_9b58_3c4daca3ab41.slice/crio-96eb390ed22465e9ceaf8a96e380b0c5e6178b06d9a7cde5ca25f907ec0478c2 WatchSource:0}: Error finding container 96eb390ed22465e9ceaf8a96e380b0c5e6178b06d9a7cde5ca25f907ec0478c2: Status 404 returned error can't find the container with id 96eb390ed22465e9ceaf8a96e380b0c5e6178b06d9a7cde5ca25f907ec0478c2
Sep 08 04:01:48.972463 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:48.972429    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-p9x5z" event={"ID":"32b9b5a6-6468-4313-9b58-3c4daca3ab41","Type":"ContainerStarted","Data":"96eb390ed22465e9ceaf8a96e380b0c5e6178b06d9a7cde5ca25f907ec0478c2"}
Sep 08 04:01:48.975520 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:48.975334    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-v9kft" event={"ID":"e0b163fe-6d60-4468-939d-91540e48a582","Type":"ContainerStarted","Data":"ff992b2b34ff11e76a8ec533b620f10349357fc463a75ab4eef298cc977f7679"}
Sep 08 04:01:49.930867 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:49.930841    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vj8wn"
Sep 08 04:01:49.988330 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:49.988269    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-v9kft" event={"ID":"e0b163fe-6d60-4468-939d-91540e48a582","Type":"ContainerStarted","Data":"e11c9fbed381835f08b578b0d04bbe5d9c019215e4b852e1769c77c806535fab"}
Sep 08 04:01:50.994973 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:50.994939    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-v9kft" event={"ID":"e0b163fe-6d60-4468-939d-91540e48a582","Type":"ContainerStarted","Data":"46e4917bbffbb5db38a5adb24592bbedfaf36c8899d954750e19e0fa1b68281a"}
Sep 08 04:01:51.015194 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:51.015141    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-v9kft" podStartSLOduration=3.224944511 podStartE2EDuration="5.015119014s" totalImagesPullingTime="1.790174503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:01:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:01:51.013820011 +0000 UTC m=+70.799111243" watchObservedRunningTime="2026-09-08 04:01:51.015119014 +0000 UTC m=+70.800410254"
Sep 08 04:01:53.285875 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.285828    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-hfks7"]
Sep 08 04:01:53.289448 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.289428    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-hfks7"
Sep 08 04:01:53.293500 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.293422    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 08 04:01:53.293646 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.293612    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-2f2qs\""
Sep 08 04:01:53.293984 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.293953    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 08 04:01:53.314677 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.314593    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-hfks7"]
Sep 08 04:01:53.315748 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.315726    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-twm95"]
Sep 08 04:01:53.318934 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.318912    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-rh6pm"]
Sep 08 04:01:53.320259 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.319054    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-twm95"
Sep 08 04:01:53.322243 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.322221    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-rh6pm"
Sep 08 04:01:53.324795 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.324578    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 08 04:01:53.325036 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.325014    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 08 04:01:53.326437 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.326418    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 08 04:01:53.326676 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.326661    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nrb2v\""
Sep 08 04:01:53.326873 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.326858    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 08 04:01:53.327072 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.327058    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 08 04:01:53.327244 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.327230    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-gftcb\""
Sep 08 04:01:53.327595 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.327577    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 08 04:01:53.341596 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.341574    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-rh6pm"]
Sep 08 04:01:53.402876 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.402847    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a4f27328-cc57-42ba-b5f9-43591a0d4018-node-exporter-wtmp\") pod \"node-exporter-twm95\" (UID: \"a4f27328-cc57-42ba-b5f9-43591a0d4018\") " pod="openshift-monitoring/node-exporter-twm95"
Sep 08 04:01:53.403049 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.402903    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpbgb\" (UniqueName: \"kubernetes.io/projected/a4f27328-cc57-42ba-b5f9-43591a0d4018-kube-api-access-gpbgb\") pod \"node-exporter-twm95\" (UID: \"a4f27328-cc57-42ba-b5f9-43591a0d4018\") " pod="openshift-monitoring/node-exporter-twm95"
Sep 08 04:01:53.403049 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.402933    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ff040b2-1200-4e9f-95a9-7a98bbda02e7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-rh6pm\" (UID: \"3ff040b2-1200-4e9f-95a9-7a98bbda02e7\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-rh6pm"
Sep 08 04:01:53.403049 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.402964    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6zww\" (UniqueName: \"kubernetes.io/projected/3ff040b2-1200-4e9f-95a9-7a98bbda02e7-kube-api-access-v6zww\") pod \"kube-state-metrics-74cb57df7-rh6pm\" (UID: \"3ff040b2-1200-4e9f-95a9-7a98bbda02e7\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-rh6pm"
Sep 08 04:01:53.403049 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.402989    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a4f27328-cc57-42ba-b5f9-43591a0d4018-node-exporter-tls\") pod \"node-exporter-twm95\" (UID: \"a4f27328-cc57-42ba-b5f9-43591a0d4018\") " pod="openshift-monitoring/node-exporter-twm95"
Sep 08 04:01:53.403049 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.403017    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3f8818d-3f43-4adc-b903-657942814226-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-hfks7\" (UID: \"c3f8818d-3f43-4adc-b903-657942814226\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-hfks7"
Sep 08 04:01:53.403049 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.403042    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a4f27328-cc57-42ba-b5f9-43591a0d4018-node-exporter-textfile\") pod \"node-exporter-twm95\" (UID: \"a4f27328-cc57-42ba-b5f9-43591a0d4018\") " pod="openshift-monitoring/node-exporter-twm95"
Sep 08 04:01:53.403362 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.403063    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4f27328-cc57-42ba-b5f9-43591a0d4018-metrics-client-ca\") pod \"node-exporter-twm95\" (UID: \"a4f27328-cc57-42ba-b5f9-43591a0d4018\") " pod="openshift-monitoring/node-exporter-twm95"
Sep 08 04:01:53.403362 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.403090    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ff040b2-1200-4e9f-95a9-7a98bbda02e7-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-rh6pm\" (UID: \"3ff040b2-1200-4e9f-95a9-7a98bbda02e7\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-rh6pm"
Sep 08 04:01:53.403362 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.403124    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ff040b2-1200-4e9f-95a9-7a98bbda02e7-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-rh6pm\" (UID: \"3ff040b2-1200-4e9f-95a9-7a98bbda02e7\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-rh6pm"
Sep 08 04:01:53.403362 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.403146    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4f27328-cc57-42ba-b5f9-43591a0d4018-sys\") pod \"node-exporter-twm95\" (UID: \"a4f27328-cc57-42ba-b5f9-43591a0d4018\") " pod="openshift-monitoring/node-exporter-twm95"
Sep 08 04:01:53.403362 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.403175    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3ff040b2-1200-4e9f-95a9-7a98bbda02e7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-rh6pm\" (UID: \"3ff040b2-1200-4e9f-95a9-7a98bbda02e7\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-rh6pm"
Sep 08 04:01:53.403362 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.403209    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3ff040b2-1200-4e9f-95a9-7a98bbda02e7-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-rh6pm\" (UID: \"3ff040b2-1200-4e9f-95a9-7a98bbda02e7\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-rh6pm"
Sep 08 04:01:53.403362 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.403240    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a4f27328-cc57-42ba-b5f9-43591a0d4018-root\") pod \"node-exporter-twm95\" (UID: \"a4f27328-cc57-42ba-b5f9-43591a0d4018\") " pod="openshift-monitoring/node-exporter-twm95"
Sep 08 04:01:53.403362 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.403268    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a4f27328-cc57-42ba-b5f9-43591a0d4018-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-twm95\" (UID: \"a4f27328-cc57-42ba-b5f9-43591a0d4018\") " pod="openshift-monitoring/node-exporter-twm95"
Sep 08 04:01:53.403362 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.403302    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a4f27328-cc57-42ba-b5f9-43591a0d4018-node-exporter-accelerators-collector-config\") pod \"node-exporter-twm95\" (UID: \"a4f27328-cc57-42ba-b5f9-43591a0d4018\") " pod="openshift-monitoring/node-exporter-twm95"
Sep 08 04:01:53.403362 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.403327    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3f8818d-3f43-4adc-b903-657942814226-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-hfks7\" (UID: \"c3f8818d-3f43-4adc-b903-657942814226\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-hfks7"
Sep 08 04:01:53.403362 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.403361    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3f8818d-3f43-4adc-b903-657942814226-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-hfks7\" (UID: \"c3f8818d-3f43-4adc-b903-657942814226\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-hfks7"
Sep 08 04:01:53.403876 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.403387    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdf79\" (UniqueName: \"kubernetes.io/projected/c3f8818d-3f43-4adc-b903-657942814226-kube-api-access-rdf79\") pod \"openshift-state-metrics-657fd6c54-hfks7\" (UID: \"c3f8818d-3f43-4adc-b903-657942814226\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-hfks7"
Sep 08 04:01:53.504775 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.504744    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3f8818d-3f43-4adc-b903-657942814226-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-hfks7\" (UID: \"c3f8818d-3f43-4adc-b903-657942814226\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-hfks7"
Sep 08 04:01:53.504957 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.504787    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a4f27328-cc57-42ba-b5f9-43591a0d4018-node-exporter-textfile\") pod \"node-exporter-twm95\" (UID: \"a4f27328-cc57-42ba-b5f9-43591a0d4018\") " pod="openshift-monitoring/node-exporter-twm95"
Sep 08 04:01:53.504957 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.504812    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4f27328-cc57-42ba-b5f9-43591a0d4018-metrics-client-ca\") pod \"node-exporter-twm95\" (UID: \"a4f27328-cc57-42ba-b5f9-43591a0d4018\") " pod="openshift-monitoring/node-exporter-twm95"
Sep 08 04:01:53.504957 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.504834    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ff040b2-1200-4e9f-95a9-7a98bbda02e7-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-rh6pm\" (UID: \"3ff040b2-1200-4e9f-95a9-7a98bbda02e7\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-rh6pm"
Sep 08 04:01:53.504957 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.504865    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ff040b2-1200-4e9f-95a9-7a98bbda02e7-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-rh6pm\" (UID: \"3ff040b2-1200-4e9f-95a9-7a98bbda02e7\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-rh6pm"
Sep 08 04:01:53.504957 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.504885    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4f27328-cc57-42ba-b5f9-43591a0d4018-sys\") pod \"node-exporter-twm95\" (UID: \"a4f27328-cc57-42ba-b5f9-43591a0d4018\") " pod="openshift-monitoring/node-exporter-twm95"
Sep 08 04:01:53.504957 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.504912    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3ff040b2-1200-4e9f-95a9-7a98bbda02e7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-rh6pm\" (UID: \"3ff040b2-1200-4e9f-95a9-7a98bbda02e7\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-rh6pm"
Sep 08 04:01:53.504957 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.504939    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3ff040b2-1200-4e9f-95a9-7a98bbda02e7-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-rh6pm\" (UID: \"3ff040b2-1200-4e9f-95a9-7a98bbda02e7\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-rh6pm"
Sep 08 04:01:53.505356 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.504964    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a4f27328-cc57-42ba-b5f9-43591a0d4018-root\") pod \"node-exporter-twm95\" (UID: \"a4f27328-cc57-42ba-b5f9-43591a0d4018\") " pod="openshift-monitoring/node-exporter-twm95"
Sep 08 04:01:53.505356 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.504991    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a4f27328-cc57-42ba-b5f9-43591a0d4018-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-twm95\" (UID: \"a4f27328-cc57-42ba-b5f9-43591a0d4018\") " pod="openshift-monitoring/node-exporter-twm95"
Sep 08 04:01:53.505356 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.505024    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a4f27328-cc57-42ba-b5f9-43591a0d4018-node-exporter-accelerators-collector-config\") pod \"node-exporter-twm95\" (UID: \"a4f27328-cc57-42ba-b5f9-43591a0d4018\") " pod="openshift-monitoring/node-exporter-twm95"
Sep 08 04:01:53.505356 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.505049    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3f8818d-3f43-4adc-b903-657942814226-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-hfks7\" (UID: \"c3f8818d-3f43-4adc-b903-657942814226\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-hfks7"
Sep 08 04:01:53.505356 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.505082    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3f8818d-3f43-4adc-b903-657942814226-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-hfks7\" (UID: \"c3f8818d-3f43-4adc-b903-657942814226\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-hfks7"
Sep 08 04:01:53.505356 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.505109    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdf79\" (UniqueName: \"kubernetes.io/projected/c3f8818d-3f43-4adc-b903-657942814226-kube-api-access-rdf79\") pod \"openshift-state-metrics-657fd6c54-hfks7\" (UID: \"c3f8818d-3f43-4adc-b903-657942814226\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-hfks7"
Sep 08 04:01:53.505356 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.505144    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a4f27328-cc57-42ba-b5f9-43591a0d4018-node-exporter-wtmp\") pod \"node-exporter-twm95\" (UID: \"a4f27328-cc57-42ba-b5f9-43591a0d4018\") " pod="openshift-monitoring/node-exporter-twm95"
Sep 08 04:01:53.505356 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.505168    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpbgb\" (UniqueName: \"kubernetes.io/projected/a4f27328-cc57-42ba-b5f9-43591a0d4018-kube-api-access-gpbgb\") pod \"node-exporter-twm95\" (UID: \"a4f27328-cc57-42ba-b5f9-43591a0d4018\") " pod="openshift-monitoring/node-exporter-twm95"
Sep 08 04:01:53.505356 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.505194    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ff040b2-1200-4e9f-95a9-7a98bbda02e7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-rh6pm\" (UID: \"3ff040b2-1200-4e9f-95a9-7a98bbda02e7\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-rh6pm"
Sep 08 04:01:53.505356 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.505231    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6zww\" (UniqueName: \"kubernetes.io/projected/3ff040b2-1200-4e9f-95a9-7a98bbda02e7-kube-api-access-v6zww\") pod \"kube-state-metrics-74cb57df7-rh6pm\" (UID: \"3ff040b2-1200-4e9f-95a9-7a98bbda02e7\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-rh6pm"
Sep 08 04:01:53.505356 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.505256    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a4f27328-cc57-42ba-b5f9-43591a0d4018-node-exporter-tls\") pod \"node-exporter-twm95\" (UID: \"a4f27328-cc57-42ba-b5f9-43591a0d4018\") " pod="openshift-monitoring/node-exporter-twm95"
Sep 08 04:01:53.505852 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.505717    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a4f27328-cc57-42ba-b5f9-43591a0d4018-root\") pod \"node-exporter-twm95\" (UID: \"a4f27328-cc57-42ba-b5f9-43591a0d4018\") " pod="openshift-monitoring/node-exporter-twm95"
Sep 08 04:01:53.506745 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.506710    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3f8818d-3f43-4adc-b903-657942814226-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-hfks7\" (UID: \"c3f8818d-3f43-4adc-b903-657942814226\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-hfks7"
Sep 08 04:01:53.506867 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.506764    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a4f27328-cc57-42ba-b5f9-43591a0d4018-node-exporter-wtmp\") pod \"node-exporter-twm95\" (UID: \"a4f27328-cc57-42ba-b5f9-43591a0d4018\") " pod="openshift-monitoring/node-exporter-twm95"
Sep 08 04:01:53.506867 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.506788    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4f27328-cc57-42ba-b5f9-43591a0d4018-sys\") pod \"node-exporter-twm95\" (UID: \"a4f27328-cc57-42ba-b5f9-43591a0d4018\") " pod="openshift-monitoring/node-exporter-twm95"
Sep 08 04:01:53.507914 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.507262    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ff040b2-1200-4e9f-95a9-7a98bbda02e7-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-rh6pm\" (UID: \"3ff040b2-1200-4e9f-95a9-7a98bbda02e7\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-rh6pm"
Sep 08 04:01:53.507914 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.507400    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3ff040b2-1200-4e9f-95a9-7a98bbda02e7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-rh6pm\" (UID: \"3ff040b2-1200-4e9f-95a9-7a98bbda02e7\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-rh6pm"
Sep 08 04:01:53.507914 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.507724    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4f27328-cc57-42ba-b5f9-43591a0d4018-metrics-client-ca\") pod \"node-exporter-twm95\" (UID: \"a4f27328-cc57-42ba-b5f9-43591a0d4018\") " pod="openshift-monitoring/node-exporter-twm95"
Sep 08 04:01:53.507914 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.507736    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3ff040b2-1200-4e9f-95a9-7a98bbda02e7-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-rh6pm\" (UID: \"3ff040b2-1200-4e9f-95a9-7a98bbda02e7\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-rh6pm"
Sep 08 04:01:53.507914 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.507868    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a4f27328-cc57-42ba-b5f9-43591a0d4018-node-exporter-textfile\") pod \"node-exporter-twm95\" (UID: \"a4f27328-cc57-42ba-b5f9-43591a0d4018\") " pod="openshift-monitoring/node-exporter-twm95"
Sep 08 04:01:53.508215 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.508164    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a4f27328-cc57-42ba-b5f9-43591a0d4018-node-exporter-accelerators-collector-config\") pod \"node-exporter-twm95\" (UID: \"a4f27328-cc57-42ba-b5f9-43591a0d4018\") " pod="openshift-monitoring/node-exporter-twm95"
Sep 08 04:01:53.508547 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.508522    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a4f27328-cc57-42ba-b5f9-43591a0d4018-node-exporter-tls\") pod \"node-exporter-twm95\" (UID: \"a4f27328-cc57-42ba-b5f9-43591a0d4018\") " pod="openshift-monitoring/node-exporter-twm95"
Sep 08 04:01:53.510830 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.510800    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ff040b2-1200-4e9f-95a9-7a98bbda02e7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-rh6pm\" (UID: \"3ff040b2-1200-4e9f-95a9-7a98bbda02e7\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-rh6pm"
Sep 08 04:01:53.510830 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.510815    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3f8818d-3f43-4adc-b903-657942814226-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-hfks7\" (UID: \"c3f8818d-3f43-4adc-b903-657942814226\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-hfks7"
Sep 08 04:01:53.511188 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.511167    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ff040b2-1200-4e9f-95a9-7a98bbda02e7-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-rh6pm\" (UID: \"3ff040b2-1200-4e9f-95a9-7a98bbda02e7\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-rh6pm"
Sep 08 04:01:53.512275 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.512250    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a4f27328-cc57-42ba-b5f9-43591a0d4018-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-twm95\" (UID: \"a4f27328-cc57-42ba-b5f9-43591a0d4018\") " pod="openshift-monitoring/node-exporter-twm95"
Sep 08 04:01:53.512486 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.512463    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3f8818d-3f43-4adc-b903-657942814226-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-hfks7\" (UID: \"c3f8818d-3f43-4adc-b903-657942814226\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-hfks7"
Sep 08 04:01:53.521026 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.521001    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpbgb\" (UniqueName: \"kubernetes.io/projected/a4f27328-cc57-42ba-b5f9-43591a0d4018-kube-api-access-gpbgb\") pod \"node-exporter-twm95\" (UID: \"a4f27328-cc57-42ba-b5f9-43591a0d4018\") " pod="openshift-monitoring/node-exporter-twm95"
Sep 08 04:01:53.521122 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.521106    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdf79\" (UniqueName: \"kubernetes.io/projected/c3f8818d-3f43-4adc-b903-657942814226-kube-api-access-rdf79\") pod \"openshift-state-metrics-657fd6c54-hfks7\" (UID: \"c3f8818d-3f43-4adc-b903-657942814226\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-hfks7"
Sep 08 04:01:53.523364 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.523339    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6zww\" (UniqueName: \"kubernetes.io/projected/3ff040b2-1200-4e9f-95a9-7a98bbda02e7-kube-api-access-v6zww\") pod \"kube-state-metrics-74cb57df7-rh6pm\" (UID: \"3ff040b2-1200-4e9f-95a9-7a98bbda02e7\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-rh6pm"
Sep 08 04:01:53.602306 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.602227    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-hfks7"
Sep 08 04:01:53.633055 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.633024    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-twm95"
Sep 08 04:01:53.640059 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:53.640039    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-rh6pm"
Sep 08 04:01:54.009137 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.009097    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-46n66" event={"ID":"15bf9e2a-b4c6-4c30-b7f2-8700093ee320","Type":"ContainerStarted","Data":"f567b288c4169ff0b17d7a9c080658e5d1d34a80c7c837f9011932c383f7fe28"}
Sep 08 04:01:54.009326 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.009195    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-46n66"
Sep 08 04:01:54.011355 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.011332    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-h6v7m" event={"ID":"7446436d-a655-4644-91b2-d2071bf4e925","Type":"ContainerStarted","Data":"6be557845aebf93019bb3c0b7d22393ace6eb88fbfb73c3d5c5a290c38128f0f"}
Sep 08 04:01:54.012905 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.012884    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-twm95" event={"ID":"a4f27328-cc57-42ba-b5f9-43591a0d4018","Type":"ContainerStarted","Data":"c001eb094d9fd20879d1bca603636c2937403b156512b305b9c5b56e49cb967c"}
Sep 08 04:01:54.044582 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.042489    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-46n66" podStartSLOduration=66.265823415 podStartE2EDuration="1m13.042468567s" totalImagesPullingTime="6.776645152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:01:54.038746136 +0000 UTC m=+73.824037374" watchObservedRunningTime="2026-09-08 04:01:54.042468567 +0000 UTC m=+73.827759803"
Sep 08 04:01:54.045583 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.045534    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-hfks7"]
Sep 08 04:01:54.047587 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.047542    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-rh6pm"]
Sep 08 04:01:54.049377 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:01:54.049351    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3f8818d_3f43_4adc_b903_657942814226.slice/crio-9276828cb1d914bccf8c7106df85b274eadc72a856b1e681007ae632c625ae8d WatchSource:0}: Error finding container 9276828cb1d914bccf8c7106df85b274eadc72a856b1e681007ae632c625ae8d: Status 404 returned error can't find the container with id 9276828cb1d914bccf8c7106df85b274eadc72a856b1e681007ae632c625ae8d
Sep 08 04:01:54.050585 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:01:54.050537    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ff040b2_1200_4e9f_95a9_7a98bbda02e7.slice/crio-f8e8027cd10815bbe5ba50569380d2dc6af661d1d2e68774599acd4ac035b79f WatchSource:0}: Error finding container f8e8027cd10815bbe5ba50569380d2dc6af661d1d2e68774599acd4ac035b79f: Status 404 returned error can't find the container with id f8e8027cd10815bbe5ba50569380d2dc6af661d1d2e68774599acd4ac035b79f
Sep 08 04:01:54.062771 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.062721    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-h6v7m" podStartSLOduration=65.986107022 podStartE2EDuration="1m13.062702302s" totalImagesPullingTime="7.07659528s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 04:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:01:54.061620245 +0000 UTC m=+73.846911492" watchObservedRunningTime="2026-09-08 04:01:54.062702302 +0000 UTC m=+73.847993535"
Sep 08 04:01:54.312938 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.312902    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 04:01:54.318668 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.318627    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:01:54.323099 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.323069    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 08 04:01:54.323580 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.323533    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 08 04:01:54.323708 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.323690    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 08 04:01:54.323870 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.323847    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 08 04:01:54.324047 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.324024    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 08 04:01:54.324116 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.324050    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-5db7q\""
Sep 08 04:01:54.324404 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.324248    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 08 04:01:54.326475 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.326047    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 08 04:01:54.326475 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.326131    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 08 04:01:54.326475 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.326321    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 08 04:01:54.335719 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.335634    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 04:01:54.431250 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.431160    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/497a5276-8391-430f-94b0-0ca6e03b84b8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:01:54.431250 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.431207    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/497a5276-8391-430f-94b0-0ca6e03b84b8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:01:54.431473 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.431283    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/497a5276-8391-430f-94b0-0ca6e03b84b8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:01:54.431473 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.431342    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/497a5276-8391-430f-94b0-0ca6e03b84b8-config-out\") pod \"alertmanager-main-0\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:01:54.431473 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.431369    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/497a5276-8391-430f-94b0-0ca6e03b84b8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:01:54.431473 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.431395    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/497a5276-8391-430f-94b0-0ca6e03b84b8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:01:54.431473 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.431422    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/497a5276-8391-430f-94b0-0ca6e03b84b8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:01:54.431473 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.431444    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flhr6\" (UniqueName: \"kubernetes.io/projected/497a5276-8391-430f-94b0-0ca6e03b84b8-kube-api-access-flhr6\") pod \"alertmanager-main-0\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:01:54.431839 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.431477    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/497a5276-8391-430f-94b0-0ca6e03b84b8-web-config\") pod \"alertmanager-main-0\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:01:54.431839 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.431517    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/497a5276-8391-430f-94b0-0ca6e03b84b8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:01:54.431839 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.431548    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/497a5276-8391-430f-94b0-0ca6e03b84b8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:01:54.431839 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.431595    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/497a5276-8391-430f-94b0-0ca6e03b84b8-config-volume\") pod \"alertmanager-main-0\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:01:54.431839 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.431629    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/497a5276-8391-430f-94b0-0ca6e03b84b8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:01:54.532365 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.532279    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/497a5276-8391-430f-94b0-0ca6e03b84b8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:01:54.532365 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.532330    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/497a5276-8391-430f-94b0-0ca6e03b84b8-config-volume\") pod \"alertmanager-main-0\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:01:54.532365 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.532367    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/497a5276-8391-430f-94b0-0ca6e03b84b8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:01:54.532766 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.532409    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/497a5276-8391-430f-94b0-0ca6e03b84b8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:01:54.532766 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.532444    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/497a5276-8391-430f-94b0-0ca6e03b84b8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:01:54.532766 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.532481    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/497a5276-8391-430f-94b0-0ca6e03b84b8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:01:54.532766 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.532516    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/497a5276-8391-430f-94b0-0ca6e03b84b8-config-out\") pod \"alertmanager-main-0\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:01:54.532766 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.532534    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/497a5276-8391-430f-94b0-0ca6e03b84b8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:01:54.532766 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.532550    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/497a5276-8391-430f-94b0-0ca6e03b84b8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:01:54.532766 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.532594    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/497a5276-8391-430f-94b0-0ca6e03b84b8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:01:54.532766 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.532608    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flhr6\" (UniqueName: \"kubernetes.io/projected/497a5276-8391-430f-94b0-0ca6e03b84b8-kube-api-access-flhr6\") pod \"alertmanager-main-0\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:01:54.532766 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.532629    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/497a5276-8391-430f-94b0-0ca6e03b84b8-web-config\") pod \"alertmanager-main-0\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:01:54.532766 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.532660    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/497a5276-8391-430f-94b0-0ca6e03b84b8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:01:54.533882 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.533852    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/497a5276-8391-430f-94b0-0ca6e03b84b8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:01:54.535063 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.534996    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/497a5276-8391-430f-94b0-0ca6e03b84b8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:01:54.535158 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.535084    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/497a5276-8391-430f-94b0-0ca6e03b84b8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:01:54.535996 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.535937    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/497a5276-8391-430f-94b0-0ca6e03b84b8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:01:54.536897 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.536870    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/497a5276-8391-430f-94b0-0ca6e03b84b8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:01:54.538637 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.537469    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/497a5276-8391-430f-94b0-0ca6e03b84b8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:01:54.538637 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.537779    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/497a5276-8391-430f-94b0-0ca6e03b84b8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:01:54.538637 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.537879    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/497a5276-8391-430f-94b0-0ca6e03b84b8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:01:54.538637 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.537952    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/497a5276-8391-430f-94b0-0ca6e03b84b8-web-config\") pod \"alertmanager-main-0\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:01:54.538637 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.538293    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/497a5276-8391-430f-94b0-0ca6e03b84b8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:01:54.539676 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.539308    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/497a5276-8391-430f-94b0-0ca6e03b84b8-config-out\") pod \"alertmanager-main-0\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:01:54.541015 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.540994    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/497a5276-8391-430f-94b0-0ca6e03b84b8-config-volume\") pod \"alertmanager-main-0\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:01:54.542255 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.542235    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flhr6\" (UniqueName: \"kubernetes.io/projected/497a5276-8391-430f-94b0-0ca6e03b84b8-kube-api-access-flhr6\") pod \"alertmanager-main-0\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:01:54.631545 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:54.631508    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:01:55.021363 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:55.021325    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-twm95" event={"ID":"a4f27328-cc57-42ba-b5f9-43591a0d4018","Type":"ContainerStarted","Data":"8c1d548ee467d6dde342eaea61c6076bb31c7916f45f7b96a6aa779a36757388"}
Sep 08 04:01:55.025077 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:55.025007    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-rh6pm" event={"ID":"3ff040b2-1200-4e9f-95a9-7a98bbda02e7","Type":"ContainerStarted","Data":"f8e8027cd10815bbe5ba50569380d2dc6af661d1d2e68774599acd4ac035b79f"}
Sep 08 04:01:55.028473 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:55.028445    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-hfks7" event={"ID":"c3f8818d-3f43-4adc-b903-657942814226","Type":"ContainerStarted","Data":"7e783bb7644e5e535fc5447067a4e4fe41be1e134928bf4d6fd45455d24c9a2a"}
Sep 08 04:01:55.028608 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:55.028506    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-hfks7" event={"ID":"c3f8818d-3f43-4adc-b903-657942814226","Type":"ContainerStarted","Data":"fbf9c175652a33e43ce15458a4ce8f7ca403ede39444347703f65375cafa1a9b"}
Sep 08 04:01:55.028608 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:55.028539    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-hfks7" event={"ID":"c3f8818d-3f43-4adc-b903-657942814226","Type":"ContainerStarted","Data":"9276828cb1d914bccf8c7106df85b274eadc72a856b1e681007ae632c625ae8d"}
Sep 08 04:01:55.076787 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:55.076697    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 04:01:55.079324 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:01:55.079292    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod497a5276_8391_430f_94b0_0ca6e03b84b8.slice/crio-3c2af11ade4b6c38ef3d787f0125a0490deff895024f41fe16bc8c2a4a953dcf WatchSource:0}: Error finding container 3c2af11ade4b6c38ef3d787f0125a0490deff895024f41fe16bc8c2a4a953dcf: Status 404 returned error can't find the container with id 3c2af11ade4b6c38ef3d787f0125a0490deff895024f41fe16bc8c2a4a953dcf
Sep 08 04:01:55.315403 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:55.315363    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-c8fb8d787-rf72p"]
Sep 08 04:01:55.320750 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:55.320717    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-c8fb8d787-rf72p"
Sep 08 04:01:55.323741 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:55.323715    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 08 04:01:55.324684 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:55.324662    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 08 04:01:55.324795 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:55.324746    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 08 04:01:55.324953 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:55.324909    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 08 04:01:55.325026 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:55.324969    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-hvspq\""
Sep 08 04:01:55.325230 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:55.325208    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-dcb6m243h7bek\""
Sep 08 04:01:55.325230 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:55.325219    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 08 04:01:55.333601 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:55.333578    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-c8fb8d787-rf72p"]
Sep 08 04:01:55.440996 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:55.440960    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/80c88ae8-b14a-44bc-b932-f9a52d521c2a-secret-grpc-tls\") pod \"thanos-querier-c8fb8d787-rf72p\" (UID: \"80c88ae8-b14a-44bc-b932-f9a52d521c2a\") " pod="openshift-monitoring/thanos-querier-c8fb8d787-rf72p"
Sep 08 04:01:55.441164 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:55.441005    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z96xz\" (UniqueName: \"kubernetes.io/projected/80c88ae8-b14a-44bc-b932-f9a52d521c2a-kube-api-access-z96xz\") pod \"thanos-querier-c8fb8d787-rf72p\" (UID: \"80c88ae8-b14a-44bc-b932-f9a52d521c2a\") " pod="openshift-monitoring/thanos-querier-c8fb8d787-rf72p"
Sep 08 04:01:55.441164 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:55.441036    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/80c88ae8-b14a-44bc-b932-f9a52d521c2a-secret-thanos-querier-tls\") pod \"thanos-querier-c8fb8d787-rf72p\" (UID: \"80c88ae8-b14a-44bc-b932-f9a52d521c2a\") " pod="openshift-monitoring/thanos-querier-c8fb8d787-rf72p"
Sep 08 04:01:55.441164 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:55.441089    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80c88ae8-b14a-44bc-b932-f9a52d521c2a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-c8fb8d787-rf72p\" (UID: \"80c88ae8-b14a-44bc-b932-f9a52d521c2a\") " pod="openshift-monitoring/thanos-querier-c8fb8d787-rf72p"
Sep 08 04:01:55.441164 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:55.441113    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/80c88ae8-b14a-44bc-b932-f9a52d521c2a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-c8fb8d787-rf72p\" (UID: \"80c88ae8-b14a-44bc-b932-f9a52d521c2a\") " pod="openshift-monitoring/thanos-querier-c8fb8d787-rf72p"
Sep 08 04:01:55.441390 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:55.441193    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/80c88ae8-b14a-44bc-b932-f9a52d521c2a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-c8fb8d787-rf72p\" (UID: \"80c88ae8-b14a-44bc-b932-f9a52d521c2a\") " pod="openshift-monitoring/thanos-querier-c8fb8d787-rf72p"
Sep 08 04:01:55.441390 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:55.441234    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80c88ae8-b14a-44bc-b932-f9a52d521c2a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-c8fb8d787-rf72p\" (UID: \"80c88ae8-b14a-44bc-b932-f9a52d521c2a\") " pod="openshift-monitoring/thanos-querier-c8fb8d787-rf72p"
Sep 08 04:01:55.441390 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:55.441265    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80c88ae8-b14a-44bc-b932-f9a52d521c2a-metrics-client-ca\") pod \"thanos-querier-c8fb8d787-rf72p\" (UID: \"80c88ae8-b14a-44bc-b932-f9a52d521c2a\") " pod="openshift-monitoring/thanos-querier-c8fb8d787-rf72p"
Sep 08 04:01:55.541708 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:55.541675    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/80c88ae8-b14a-44bc-b932-f9a52d521c2a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-c8fb8d787-rf72p\" (UID: \"80c88ae8-b14a-44bc-b932-f9a52d521c2a\") " pod="openshift-monitoring/thanos-querier-c8fb8d787-rf72p"
Sep 08 04:01:55.541863 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:55.541712    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80c88ae8-b14a-44bc-b932-f9a52d521c2a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-c8fb8d787-rf72p\" (UID: \"80c88ae8-b14a-44bc-b932-f9a52d521c2a\") " pod="openshift-monitoring/thanos-querier-c8fb8d787-rf72p"
Sep 08 04:01:55.541863 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:55.541743    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80c88ae8-b14a-44bc-b932-f9a52d521c2a-metrics-client-ca\") pod \"thanos-querier-c8fb8d787-rf72p\" (UID: \"80c88ae8-b14a-44bc-b932-f9a52d521c2a\") " pod="openshift-monitoring/thanos-querier-c8fb8d787-rf72p"
Sep 08 04:01:55.541863 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:55.541777    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/80c88ae8-b14a-44bc-b932-f9a52d521c2a-secret-grpc-tls\") pod \"thanos-querier-c8fb8d787-rf72p\" (UID: \"80c88ae8-b14a-44bc-b932-f9a52d521c2a\") " pod="openshift-monitoring/thanos-querier-c8fb8d787-rf72p"
Sep 08 04:01:55.541863 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:55.541808    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z96xz\" (UniqueName: \"kubernetes.io/projected/80c88ae8-b14a-44bc-b932-f9a52d521c2a-kube-api-access-z96xz\") pod \"thanos-querier-c8fb8d787-rf72p\" (UID: \"80c88ae8-b14a-44bc-b932-f9a52d521c2a\") " pod="openshift-monitoring/thanos-querier-c8fb8d787-rf72p"
Sep 08 04:01:55.541863 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:55.541838    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/80c88ae8-b14a-44bc-b932-f9a52d521c2a-secret-thanos-querier-tls\") pod \"thanos-querier-c8fb8d787-rf72p\" (UID: \"80c88ae8-b14a-44bc-b932-f9a52d521c2a\") " pod="openshift-monitoring/thanos-querier-c8fb8d787-rf72p"
Sep 08 04:01:55.542100 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:55.541873    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80c88ae8-b14a-44bc-b932-f9a52d521c2a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-c8fb8d787-rf72p\" (UID: \"80c88ae8-b14a-44bc-b932-f9a52d521c2a\") " pod="openshift-monitoring/thanos-querier-c8fb8d787-rf72p"
Sep 08 04:01:55.542100 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:55.541896    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/80c88ae8-b14a-44bc-b932-f9a52d521c2a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-c8fb8d787-rf72p\" (UID: \"80c88ae8-b14a-44bc-b932-f9a52d521c2a\") " pod="openshift-monitoring/thanos-querier-c8fb8d787-rf72p"
Sep 08 04:01:55.543690 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:55.542958    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80c88ae8-b14a-44bc-b932-f9a52d521c2a-metrics-client-ca\") pod \"thanos-querier-c8fb8d787-rf72p\" (UID: \"80c88ae8-b14a-44bc-b932-f9a52d521c2a\") " pod="openshift-monitoring/thanos-querier-c8fb8d787-rf72p"
Sep 08 04:01:55.545255 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:55.545209    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80c88ae8-b14a-44bc-b932-f9a52d521c2a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-c8fb8d787-rf72p\" (UID: \"80c88ae8-b14a-44bc-b932-f9a52d521c2a\") " pod="openshift-monitoring/thanos-querier-c8fb8d787-rf72p"
Sep 08 04:01:55.545873 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:55.545831    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/80c88ae8-b14a-44bc-b932-f9a52d521c2a-secret-grpc-tls\") pod \"thanos-querier-c8fb8d787-rf72p\" (UID: \"80c88ae8-b14a-44bc-b932-f9a52d521c2a\") " pod="openshift-monitoring/thanos-querier-c8fb8d787-rf72p"
Sep 08 04:01:55.546536 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:55.546508    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/80c88ae8-b14a-44bc-b932-f9a52d521c2a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-c8fb8d787-rf72p\" (UID: \"80c88ae8-b14a-44bc-b932-f9a52d521c2a\") " pod="openshift-monitoring/thanos-querier-c8fb8d787-rf72p"
Sep 08 04:01:55.547064 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:55.547045    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80c88ae8-b14a-44bc-b932-f9a52d521c2a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-c8fb8d787-rf72p\" (UID: \"80c88ae8-b14a-44bc-b932-f9a52d521c2a\") " pod="openshift-monitoring/thanos-querier-c8fb8d787-rf72p"
Sep 08 04:01:55.547153 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:55.547050    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/80c88ae8-b14a-44bc-b932-f9a52d521c2a-secret-thanos-querier-tls\") pod \"thanos-querier-c8fb8d787-rf72p\" (UID: \"80c88ae8-b14a-44bc-b932-f9a52d521c2a\") " pod="openshift-monitoring/thanos-querier-c8fb8d787-rf72p"
Sep 08 04:01:55.548764 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:55.548730    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/80c88ae8-b14a-44bc-b932-f9a52d521c2a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-c8fb8d787-rf72p\" (UID: \"80c88ae8-b14a-44bc-b932-f9a52d521c2a\") " pod="openshift-monitoring/thanos-querier-c8fb8d787-rf72p"
Sep 08 04:01:55.552656 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:55.552634    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z96xz\" (UniqueName: \"kubernetes.io/projected/80c88ae8-b14a-44bc-b932-f9a52d521c2a-kube-api-access-z96xz\") pod \"thanos-querier-c8fb8d787-rf72p\" (UID: \"80c88ae8-b14a-44bc-b932-f9a52d521c2a\") " pod="openshift-monitoring/thanos-querier-c8fb8d787-rf72p"
Sep 08 04:01:55.633237 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:55.633166    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-c8fb8d787-rf72p"
Sep 08 04:01:56.037194 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:56.037081    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"497a5276-8391-430f-94b0-0ca6e03b84b8","Type":"ContainerStarted","Data":"3c2af11ade4b6c38ef3d787f0125a0490deff895024f41fe16bc8c2a4a953dcf"}
Sep 08 04:01:56.041844 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:56.041705    2573 generic.go:356] "Generic (PLEG): container finished" podID="a4f27328-cc57-42ba-b5f9-43591a0d4018" containerID="8c1d548ee467d6dde342eaea61c6076bb31c7916f45f7b96a6aa779a36757388" exitCode=0
Sep 08 04:01:56.041844 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:56.041780    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-twm95" event={"ID":"a4f27328-cc57-42ba-b5f9-43591a0d4018","Type":"ContainerDied","Data":"8c1d548ee467d6dde342eaea61c6076bb31c7916f45f7b96a6aa779a36757388"}
Sep 08 04:01:56.051342 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:56.051228    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-rh6pm" event={"ID":"3ff040b2-1200-4e9f-95a9-7a98bbda02e7","Type":"ContainerStarted","Data":"af63ce9bbdbe581b32a055ef2b14fa0ef80c23158274fbd3dfe6495e182d8912"}
Sep 08 04:01:56.051342 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:56.051285    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-rh6pm" event={"ID":"3ff040b2-1200-4e9f-95a9-7a98bbda02e7","Type":"ContainerStarted","Data":"888371e618221ba91227fe6d6969f451078a0b41d9818882672969896c14379e"}
Sep 08 04:01:56.056681 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:56.055894    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-hfks7" event={"ID":"c3f8818d-3f43-4adc-b903-657942814226","Type":"ContainerStarted","Data":"a78230a0acf0f8737958fde8ac4cc785ecd2fe3d0b300180677e4ebac61d95ae"}
Sep 08 04:01:56.083629 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:56.083537    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-hfks7" podStartSLOduration=1.478946146 podStartE2EDuration="3.083519769s" totalImagesPullingTime="1.604573623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:01:56.082589356 +0000 UTC m=+75.867880591" watchObservedRunningTime="2026-09-08 04:01:56.083519769 +0000 UTC m=+75.868811005"
Sep 08 04:01:56.088805 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:56.088717    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-c8fb8d787-rf72p"]
Sep 08 04:01:56.093682 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:01:56.093652    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80c88ae8_b14a_44bc_b932_f9a52d521c2a.slice/crio-cb482f3fd9a719bfbf6c68b365ab0e25610f91ab9c0864749983e920d80265f2 WatchSource:0}: Error finding container cb482f3fd9a719bfbf6c68b365ab0e25610f91ab9c0864749983e920d80265f2: Status 404 returned error can't find the container with id cb482f3fd9a719bfbf6c68b365ab0e25610f91ab9c0864749983e920d80265f2
Sep 08 04:01:57.062783 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:57.062746    2573 generic.go:356] "Generic (PLEG): container finished" podID="497a5276-8391-430f-94b0-0ca6e03b84b8" containerID="9748bbfc248a0c4459c5ef09ac1b5b1ec0cef9748ffad598d18c9ffce33c1c99" exitCode=0
Sep 08 04:01:57.063214 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:57.062788    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"497a5276-8391-430f-94b0-0ca6e03b84b8","Type":"ContainerDied","Data":"9748bbfc248a0c4459c5ef09ac1b5b1ec0cef9748ffad598d18c9ffce33c1c99"}
Sep 08 04:01:57.064709 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:57.064633    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c8fb8d787-rf72p" event={"ID":"80c88ae8-b14a-44bc-b932-f9a52d521c2a","Type":"ContainerStarted","Data":"cb482f3fd9a719bfbf6c68b365ab0e25610f91ab9c0864749983e920d80265f2"}
Sep 08 04:01:57.068105 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:57.067585    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-twm95" event={"ID":"a4f27328-cc57-42ba-b5f9-43591a0d4018","Type":"ContainerStarted","Data":"d3d205ccafcd4581a7febf9120653fc4cfd1d9832ead4c62790b21d0a9bfe49d"}
Sep 08 04:01:57.068105 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:57.067638    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-twm95" event={"ID":"a4f27328-cc57-42ba-b5f9-43591a0d4018","Type":"ContainerStarted","Data":"8c3ad9406e9a8ff1a89bcee9ed84c1a85cdd31107c4ffae181a4d57aeb9347c1"}
Sep 08 04:01:57.075172 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:57.073621    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-rh6pm" event={"ID":"3ff040b2-1200-4e9f-95a9-7a98bbda02e7","Type":"ContainerStarted","Data":"7c404708634d367d28dd4008822bdf85d6741e6b92bcd3fccef6d431c9f6cc27"}
Sep 08 04:01:57.125478 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:57.125416    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-rh6pm" podStartSLOduration=2.384640899 podStartE2EDuration="4.125397012s" totalImagesPullingTime="1.740756113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:01:57.125064066 +0000 UTC m=+76.910355303" watchObservedRunningTime="2026-09-08 04:01:57.125397012 +0000 UTC m=+76.910688253"
Sep 08 04:01:57.149011 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:57.148958    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-twm95" podStartSLOduration=2.968517746 podStartE2EDuration="4.148940141s" totalImagesPullingTime="1.089557706s" totalInitContainerRuntime="90.864689ms" isStatefulPod=true podCreationTimestamp="2026-09-08 04:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:01:57.147897092 +0000 UTC m=+76.933188328" watchObservedRunningTime="2026-09-08 04:01:57.148940141 +0000 UTC m=+76.934231378"
Sep 08 04:01:57.759392 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:57.759351    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-57f4c8ddfc-l4w4v"]
Sep 08 04:01:57.762887 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:57.762858    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-57f4c8ddfc-l4w4v"
Sep 08 04:01:57.765907 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:57.765883    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-es9ufq5hfc285\""
Sep 08 04:01:57.766357 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:57.766333    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 08 04:01:57.767825 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:57.767095    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-4wtqt\""
Sep 08 04:01:57.767825 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:57.767115    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 08 04:01:57.767825 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:57.767161    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 08 04:01:57.767825 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:57.767386    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 08 04:01:57.774870 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:57.774841    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-57f4c8ddfc-l4w4v"]
Sep 08 04:01:57.866464 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:57.866428    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b54d42b4-ebc7-41db-b7ac-b14b4de8eda3-metrics-server-audit-profiles\") pod \"metrics-server-57f4c8ddfc-l4w4v\" (UID: \"b54d42b4-ebc7-41db-b7ac-b14b4de8eda3\") " pod="openshift-monitoring/metrics-server-57f4c8ddfc-l4w4v"
Sep 08 04:01:57.866673 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:57.866471    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b54d42b4-ebc7-41db-b7ac-b14b4de8eda3-client-ca-bundle\") pod \"metrics-server-57f4c8ddfc-l4w4v\" (UID: \"b54d42b4-ebc7-41db-b7ac-b14b4de8eda3\") " pod="openshift-monitoring/metrics-server-57f4c8ddfc-l4w4v"
Sep 08 04:01:57.866673 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:57.866500    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7sqg\" (UniqueName: \"kubernetes.io/projected/b54d42b4-ebc7-41db-b7ac-b14b4de8eda3-kube-api-access-r7sqg\") pod \"metrics-server-57f4c8ddfc-l4w4v\" (UID: \"b54d42b4-ebc7-41db-b7ac-b14b4de8eda3\") " pod="openshift-monitoring/metrics-server-57f4c8ddfc-l4w4v"
Sep 08 04:01:57.866673 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:57.866534    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b54d42b4-ebc7-41db-b7ac-b14b4de8eda3-audit-log\") pod \"metrics-server-57f4c8ddfc-l4w4v\" (UID: \"b54d42b4-ebc7-41db-b7ac-b14b4de8eda3\") " pod="openshift-monitoring/metrics-server-57f4c8ddfc-l4w4v"
Sep 08 04:01:57.866673 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:57.866632    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b54d42b4-ebc7-41db-b7ac-b14b4de8eda3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-57f4c8ddfc-l4w4v\" (UID: \"b54d42b4-ebc7-41db-b7ac-b14b4de8eda3\") " pod="openshift-monitoring/metrics-server-57f4c8ddfc-l4w4v"
Sep 08 04:01:57.866673 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:57.866665    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b54d42b4-ebc7-41db-b7ac-b14b4de8eda3-secret-metrics-server-tls\") pod \"metrics-server-57f4c8ddfc-l4w4v\" (UID: \"b54d42b4-ebc7-41db-b7ac-b14b4de8eda3\") " pod="openshift-monitoring/metrics-server-57f4c8ddfc-l4w4v"
Sep 08 04:01:57.866917 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:57.866706    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b54d42b4-ebc7-41db-b7ac-b14b4de8eda3-secret-metrics-server-client-certs\") pod \"metrics-server-57f4c8ddfc-l4w4v\" (UID: \"b54d42b4-ebc7-41db-b7ac-b14b4de8eda3\") " pod="openshift-monitoring/metrics-server-57f4c8ddfc-l4w4v"
Sep 08 04:01:57.967965 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:57.967928    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b54d42b4-ebc7-41db-b7ac-b14b4de8eda3-audit-log\") pod \"metrics-server-57f4c8ddfc-l4w4v\" (UID: \"b54d42b4-ebc7-41db-b7ac-b14b4de8eda3\") " pod="openshift-monitoring/metrics-server-57f4c8ddfc-l4w4v"
Sep 08 04:01:57.968213 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:57.967987    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b54d42b4-ebc7-41db-b7ac-b14b4de8eda3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-57f4c8ddfc-l4w4v\" (UID: \"b54d42b4-ebc7-41db-b7ac-b14b4de8eda3\") " pod="openshift-monitoring/metrics-server-57f4c8ddfc-l4w4v"
Sep 08 04:01:57.968213 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:57.968116    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b54d42b4-ebc7-41db-b7ac-b14b4de8eda3-secret-metrics-server-tls\") pod \"metrics-server-57f4c8ddfc-l4w4v\" (UID: \"b54d42b4-ebc7-41db-b7ac-b14b4de8eda3\") " pod="openshift-monitoring/metrics-server-57f4c8ddfc-l4w4v"
Sep 08 04:01:57.968213 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:57.968167    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b54d42b4-ebc7-41db-b7ac-b14b4de8eda3-secret-metrics-server-client-certs\") pod \"metrics-server-57f4c8ddfc-l4w4v\" (UID: \"b54d42b4-ebc7-41db-b7ac-b14b4de8eda3\") " pod="openshift-monitoring/metrics-server-57f4c8ddfc-l4w4v"
Sep 08 04:01:57.968403 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:57.968242    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b54d42b4-ebc7-41db-b7ac-b14b4de8eda3-metrics-server-audit-profiles\") pod \"metrics-server-57f4c8ddfc-l4w4v\" (UID: \"b54d42b4-ebc7-41db-b7ac-b14b4de8eda3\") " pod="openshift-monitoring/metrics-server-57f4c8ddfc-l4w4v"
Sep 08 04:01:57.968403 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:57.968268    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b54d42b4-ebc7-41db-b7ac-b14b4de8eda3-client-ca-bundle\") pod \"metrics-server-57f4c8ddfc-l4w4v\" (UID: \"b54d42b4-ebc7-41db-b7ac-b14b4de8eda3\") " pod="openshift-monitoring/metrics-server-57f4c8ddfc-l4w4v"
Sep 08 04:01:57.968403 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:57.968308    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7sqg\" (UniqueName: \"kubernetes.io/projected/b54d42b4-ebc7-41db-b7ac-b14b4de8eda3-kube-api-access-r7sqg\") pod \"metrics-server-57f4c8ddfc-l4w4v\" (UID: \"b54d42b4-ebc7-41db-b7ac-b14b4de8eda3\") " pod="openshift-monitoring/metrics-server-57f4c8ddfc-l4w4v"
Sep 08 04:01:57.970150 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:57.969041    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b54d42b4-ebc7-41db-b7ac-b14b4de8eda3-audit-log\") pod \"metrics-server-57f4c8ddfc-l4w4v\" (UID: \"b54d42b4-ebc7-41db-b7ac-b14b4de8eda3\") " pod="openshift-monitoring/metrics-server-57f4c8ddfc-l4w4v"
Sep 08 04:01:57.970150 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:57.969687    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b54d42b4-ebc7-41db-b7ac-b14b4de8eda3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-57f4c8ddfc-l4w4v\" (UID: \"b54d42b4-ebc7-41db-b7ac-b14b4de8eda3\") " pod="openshift-monitoring/metrics-server-57f4c8ddfc-l4w4v"
Sep 08 04:01:57.971198 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:57.971119    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b54d42b4-ebc7-41db-b7ac-b14b4de8eda3-metrics-server-audit-profiles\") pod \"metrics-server-57f4c8ddfc-l4w4v\" (UID: \"b54d42b4-ebc7-41db-b7ac-b14b4de8eda3\") " pod="openshift-monitoring/metrics-server-57f4c8ddfc-l4w4v"
Sep 08 04:01:57.972959 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:57.972918    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b54d42b4-ebc7-41db-b7ac-b14b4de8eda3-secret-metrics-server-tls\") pod \"metrics-server-57f4c8ddfc-l4w4v\" (UID: \"b54d42b4-ebc7-41db-b7ac-b14b4de8eda3\") " pod="openshift-monitoring/metrics-server-57f4c8ddfc-l4w4v"
Sep 08 04:01:57.973952 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:57.973918    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b54d42b4-ebc7-41db-b7ac-b14b4de8eda3-secret-metrics-server-client-certs\") pod \"metrics-server-57f4c8ddfc-l4w4v\" (UID: \"b54d42b4-ebc7-41db-b7ac-b14b4de8eda3\") " pod="openshift-monitoring/metrics-server-57f4c8ddfc-l4w4v"
Sep 08 04:01:57.980520 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:57.980497    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b54d42b4-ebc7-41db-b7ac-b14b4de8eda3-client-ca-bundle\") pod \"metrics-server-57f4c8ddfc-l4w4v\" (UID: \"b54d42b4-ebc7-41db-b7ac-b14b4de8eda3\") " pod="openshift-monitoring/metrics-server-57f4c8ddfc-l4w4v"
Sep 08 04:01:57.992854 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:57.992828    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7sqg\" (UniqueName: \"kubernetes.io/projected/b54d42b4-ebc7-41db-b7ac-b14b4de8eda3-kube-api-access-r7sqg\") pod \"metrics-server-57f4c8ddfc-l4w4v\" (UID: \"b54d42b4-ebc7-41db-b7ac-b14b4de8eda3\") " pod="openshift-monitoring/metrics-server-57f4c8ddfc-l4w4v"
Sep 08 04:01:58.016065 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:58.016013    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-5c9t9"]
Sep 08 04:01:58.019338 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:58.019311    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-5c9t9"
Sep 08 04:01:58.023273 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:58.023253    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-7h2nq\""
Sep 08 04:01:58.023425 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:58.023395    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 08 04:01:58.032962 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:58.032915    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-5c9t9"]
Sep 08 04:01:58.075852 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:58.075823    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-57f4c8ddfc-l4w4v"
Sep 08 04:01:58.169860 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:58.169824    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md5d4\" (UniqueName: \"kubernetes.io/projected/63e757a6-ea2d-4e05-9c42-9055591bd2dd-kube-api-access-md5d4\") pod \"monitoring-plugin-85bbbbbf4-5c9t9\" (UID: \"63e757a6-ea2d-4e05-9c42-9055591bd2dd\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-5c9t9"
Sep 08 04:01:58.170019 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:58.169908    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63e757a6-ea2d-4e05-9c42-9055591bd2dd-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-5c9t9\" (UID: \"63e757a6-ea2d-4e05-9c42-9055591bd2dd\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-5c9t9"
Sep 08 04:01:58.270962 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:58.270873    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md5d4\" (UniqueName: \"kubernetes.io/projected/63e757a6-ea2d-4e05-9c42-9055591bd2dd-kube-api-access-md5d4\") pod \"monitoring-plugin-85bbbbbf4-5c9t9\" (UID: \"63e757a6-ea2d-4e05-9c42-9055591bd2dd\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-5c9t9"
Sep 08 04:01:58.270962 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:58.270928    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63e757a6-ea2d-4e05-9c42-9055591bd2dd-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-5c9t9\" (UID: \"63e757a6-ea2d-4e05-9c42-9055591bd2dd\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-5c9t9"
Sep 08 04:01:58.271168 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:58.271083    2573 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 08 04:01:58.271168 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:01:58.271155    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63e757a6-ea2d-4e05-9c42-9055591bd2dd-monitoring-plugin-cert podName:63e757a6-ea2d-4e05-9c42-9055591bd2dd nodeName:}" failed. No retries permitted until 2026-09-08 04:01:58.771134353 +0000 UTC m=+78.556425581 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/63e757a6-ea2d-4e05-9c42-9055591bd2dd-monitoring-plugin-cert") pod "monitoring-plugin-85bbbbbf4-5c9t9" (UID: "63e757a6-ea2d-4e05-9c42-9055591bd2dd") : secret "monitoring-plugin-cert" not found
Sep 08 04:01:58.280863 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:58.280835    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-md5d4\" (UniqueName: \"kubernetes.io/projected/63e757a6-ea2d-4e05-9c42-9055591bd2dd-kube-api-access-md5d4\") pod \"monitoring-plugin-85bbbbbf4-5c9t9\" (UID: \"63e757a6-ea2d-4e05-9c42-9055591bd2dd\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-5c9t9"
Sep 08 04:01:58.776304 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:58.776262    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63e757a6-ea2d-4e05-9c42-9055591bd2dd-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-5c9t9\" (UID: \"63e757a6-ea2d-4e05-9c42-9055591bd2dd\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-5c9t9"
Sep 08 04:01:58.779317 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:58.779288    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63e757a6-ea2d-4e05-9c42-9055591bd2dd-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-5c9t9\" (UID: \"63e757a6-ea2d-4e05-9c42-9055591bd2dd\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-5c9t9"
Sep 08 04:01:58.932326 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:58.932254    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-5c9t9"
Sep 08 04:01:59.421543 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.421502    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-5c9t9"]
Sep 08 04:01:59.422195 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.422172    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-57f4c8ddfc-l4w4v"]
Sep 08 04:01:59.434268 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:01:59.434238    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63e757a6_ea2d_4e05_9c42_9055591bd2dd.slice/crio-13833b980c72bf703e26789d6f29c1c43cacbc0f15ca2a2c2ae7e631908a98eb WatchSource:0}: Error finding container 13833b980c72bf703e26789d6f29c1c43cacbc0f15ca2a2c2ae7e631908a98eb: Status 404 returned error can't find the container with id 13833b980c72bf703e26789d6f29c1c43cacbc0f15ca2a2c2ae7e631908a98eb
Sep 08 04:01:59.532674 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.532633    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 04:01:59.538516 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.538493    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.542977 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.542950    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-b8wb5\""
Sep 08 04:01:59.543074 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.543006    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4dl42po057989\""
Sep 08 04:01:59.543140 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.543008    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 08 04:01:59.543223 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.543194    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 08 04:01:59.543291 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.543236    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 08 04:01:59.543341 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.543199    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 08 04:01:59.544074 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.543789    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 08 04:01:59.544074 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.543842    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 08 04:01:59.544074 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.544071    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 08 04:01:59.544769 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.544729    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 08 04:01:59.544860 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.544787    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 08 04:01:59.545047 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.545026    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 08 04:01:59.545329 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.545081    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 08 04:01:59.546776 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.546716    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 08 04:01:59.547665 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.547646    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 08 04:01:59.549747 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.549729    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 08 04:01:59.566872 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.566849    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 04:01:59.686720 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.686634    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-web-config\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.686720 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.686681    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/447c33de-22cf-4226-9566-2a6878f51d16-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.686720 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.686708    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/447c33de-22cf-4226-9566-2a6878f51d16-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.686921 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.686741    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqn2f\" (UniqueName: \"kubernetes.io/projected/447c33de-22cf-4226-9566-2a6878f51d16-kube-api-access-lqn2f\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.686921 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.686761    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-config\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.686921 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.686778    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/447c33de-22cf-4226-9566-2a6878f51d16-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.686921 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.686801    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/447c33de-22cf-4226-9566-2a6878f51d16-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.686921 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.686816    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.686921 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.686843    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.686921 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.686860    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.686921 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.686887    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/447c33de-22cf-4226-9566-2a6878f51d16-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.686921 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.686914    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/447c33de-22cf-4226-9566-2a6878f51d16-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.687220 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.686936    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.687220 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.686969    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.687220 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.686996    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/447c33de-22cf-4226-9566-2a6878f51d16-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.687220 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.687010    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.687220 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.687029    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.687220 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.687045    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/447c33de-22cf-4226-9566-2a6878f51d16-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.687220 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.687070    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/447c33de-22cf-4226-9566-2a6878f51d16-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.687220 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.687092    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/447c33de-22cf-4226-9566-2a6878f51d16-config-out\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.787963 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.787926    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/447c33de-22cf-4226-9566-2a6878f51d16-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.788154 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.787979    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/447c33de-22cf-4226-9566-2a6878f51d16-config-out\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.788154 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.788008    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-web-config\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.788154 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.788046    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/447c33de-22cf-4226-9566-2a6878f51d16-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.788154 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.788072    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/447c33de-22cf-4226-9566-2a6878f51d16-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.788154 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.788107    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqn2f\" (UniqueName: \"kubernetes.io/projected/447c33de-22cf-4226-9566-2a6878f51d16-kube-api-access-lqn2f\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.788154 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.788131    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-config\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.788452 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.788157    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/447c33de-22cf-4226-9566-2a6878f51d16-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.788452 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.788191    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/447c33de-22cf-4226-9566-2a6878f51d16-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.788452 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.788216    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.792316 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.789010    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/447c33de-22cf-4226-9566-2a6878f51d16-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.792316 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.789062    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/447c33de-22cf-4226-9566-2a6878f51d16-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.792316 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.791391    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/447c33de-22cf-4226-9566-2a6878f51d16-config-out\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.792316 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.791658    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-config\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.792316 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.792026    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/447c33de-22cf-4226-9566-2a6878f51d16-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.792316 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.792195    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.792316 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.792237    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.792316 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.792242    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/447c33de-22cf-4226-9566-2a6878f51d16-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.792316 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.792265    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/447c33de-22cf-4226-9566-2a6878f51d16-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.792316 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.792304    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/447c33de-22cf-4226-9566-2a6878f51d16-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.792905 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.792346    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.792905 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.792387    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.792905 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.792410    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/447c33de-22cf-4226-9566-2a6878f51d16-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.792905 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.792434    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.792905 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.792464    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.792905 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.792490    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/447c33de-22cf-4226-9566-2a6878f51d16-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.792905 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.792545    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/447c33de-22cf-4226-9566-2a6878f51d16-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.792905 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.792815    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/447c33de-22cf-4226-9566-2a6878f51d16-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.793457 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.793215    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-web-config\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.793457 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.793216    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/447c33de-22cf-4226-9566-2a6878f51d16-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.794936 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.793877    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/447c33de-22cf-4226-9566-2a6878f51d16-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.794936 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.794541    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/447c33de-22cf-4226-9566-2a6878f51d16-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.796457 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.796432    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.796943 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.796922    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.797063 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.797042    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.797164 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.797141    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.797537 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.797509    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.797639 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.797549    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.798705 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.798682    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.799620 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.799600    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqn2f\" (UniqueName: \"kubernetes.io/projected/447c33de-22cf-4226-9566-2a6878f51d16-kube-api-access-lqn2f\") pod \"prometheus-k8s-0\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:01:59.865169 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:01:59.864912    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:02:00.089412 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:00.089327    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-57f4c8ddfc-l4w4v" event={"ID":"b54d42b4-ebc7-41db-b7ac-b14b4de8eda3","Type":"ContainerStarted","Data":"4d529b304782046e20bab043dad8f9b9de7ed154d8d06548d828b08c5571469c"}
Sep 08 04:02:00.097957 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:00.097706    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"497a5276-8391-430f-94b0-0ca6e03b84b8","Type":"ContainerStarted","Data":"aaf822885935f4a71b51808d63ed0285a50afd20b779f47f4138d4e9bf83a95c"}
Sep 08 04:02:00.097957 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:00.097787    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"497a5276-8391-430f-94b0-0ca6e03b84b8","Type":"ContainerStarted","Data":"58d5b4ca5f5c89398938534d935448fc808a543052f189b6480d2e8739f6ac22"}
Sep 08 04:02:00.097957 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:00.097832    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"497a5276-8391-430f-94b0-0ca6e03b84b8","Type":"ContainerStarted","Data":"6a0a91cfe95380a86771e9fb319cba324e2fd6226422127a5636088b7eee0087"}
Sep 08 04:02:00.097957 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:00.097872    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"497a5276-8391-430f-94b0-0ca6e03b84b8","Type":"ContainerStarted","Data":"030f4fe542ea8a6dd76bf02f3689c8b6e348c3d202952b4989de8ff91fe9d724"}
Sep 08 04:02:00.097957 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:00.097911    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"497a5276-8391-430f-94b0-0ca6e03b84b8","Type":"ContainerStarted","Data":"6930f558892d6fbdc4fd9bfbea5968a8559e4bc82d0d929abf42e1d2c264e85c"}
Sep 08 04:02:00.103949 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:00.103782    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c8fb8d787-rf72p" event={"ID":"80c88ae8-b14a-44bc-b932-f9a52d521c2a","Type":"ContainerStarted","Data":"837340ef5e13ee25a0eff1f3daf93604eb25222a8f474b03932249d349cd08c6"}
Sep 08 04:02:00.103949 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:00.103851    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c8fb8d787-rf72p" event={"ID":"80c88ae8-b14a-44bc-b932-f9a52d521c2a","Type":"ContainerStarted","Data":"b98cc8611d8c4c2ad9ac54b6e832684c37b713ae5a919dce1cbaa48a15f7b1c9"}
Sep 08 04:02:00.103949 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:00.103892    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c8fb8d787-rf72p" event={"ID":"80c88ae8-b14a-44bc-b932-f9a52d521c2a","Type":"ContainerStarted","Data":"afdb10cf9eb6a7ccbbe9b5e4453b2c29c7ba861410c101eb0b39925d3088a44e"}
Sep 08 04:02:00.105940 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:00.105912    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-5c9t9" event={"ID":"63e757a6-ea2d-4e05-9c42-9055591bd2dd","Type":"ContainerStarted","Data":"13833b980c72bf703e26789d6f29c1c43cacbc0f15ca2a2c2ae7e631908a98eb"}
Sep 08 04:02:00.185542 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:00.185505    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 04:02:00.318850 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:02:00.318810    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod447c33de_22cf_4226_9566_2a6878f51d16.slice/crio-5b3390f47488d275fb4e0e024599377ccece6f649bc8127357c95acc468598cb WatchSource:0}: Error finding container 5b3390f47488d275fb4e0e024599377ccece6f649bc8127357c95acc468598cb: Status 404 returned error can't find the container with id 5b3390f47488d275fb4e0e024599377ccece6f649bc8127357c95acc468598cb
Sep 08 04:02:01.113629 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:01.113593    2573 generic.go:356] "Generic (PLEG): container finished" podID="447c33de-22cf-4226-9566-2a6878f51d16" containerID="381d90d2931edada829559c971d450287573bcae5984fe92e30a805c2b2b2ee3" exitCode=0
Sep 08 04:02:01.114076 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:01.113739    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"447c33de-22cf-4226-9566-2a6878f51d16","Type":"ContainerDied","Data":"381d90d2931edada829559c971d450287573bcae5984fe92e30a805c2b2b2ee3"}
Sep 08 04:02:01.114076 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:01.113816    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"447c33de-22cf-4226-9566-2a6878f51d16","Type":"ContainerStarted","Data":"5b3390f47488d275fb4e0e024599377ccece6f649bc8127357c95acc468598cb"}
Sep 08 04:02:01.117704 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:01.117674    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c8fb8d787-rf72p" event={"ID":"80c88ae8-b14a-44bc-b932-f9a52d521c2a","Type":"ContainerStarted","Data":"e6fd5946d0953afe7b5b427bba8f067b03ca4246b42a99564091b41572d61a9c"}
Sep 08 04:02:01.117813 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:01.117755    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c8fb8d787-rf72p" event={"ID":"80c88ae8-b14a-44bc-b932-f9a52d521c2a","Type":"ContainerStarted","Data":"91e67f1c0fdcf2e45af14433d5f68448dbdfea9d589d85bd2335f96983851440"}
Sep 08 04:02:09.159050 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:09.159015    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"497a5276-8391-430f-94b0-0ca6e03b84b8","Type":"ContainerStarted","Data":"587bd20d715ba7daf5d2932f142220b44530ea1e87f6ed50b88bcced1fda5dc7"}
Sep 08 04:02:09.163204 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:09.163178    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c8fb8d787-rf72p" event={"ID":"80c88ae8-b14a-44bc-b932-f9a52d521c2a","Type":"ContainerStarted","Data":"57a4449d8a57d3a6e9ce2dadc37e77a515a54bb1c655d16c18e22344b64e587f"}
Sep 08 04:02:09.164305 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:09.164130    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-c8fb8d787-rf72p"
Sep 08 04:02:09.167208 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:09.166718    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-5c9t9" event={"ID":"63e757a6-ea2d-4e05-9c42-9055591bd2dd","Type":"ContainerStarted","Data":"0fe6185d3abb3fd04b5a035c1b3d8801061cbd0cd7efe6363864b03d7a1f451b"}
Sep 08 04:02:09.167208 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:09.167154    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-5c9t9"
Sep 08 04:02:09.171515 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:09.171490    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-57f4c8ddfc-l4w4v" event={"ID":"b54d42b4-ebc7-41db-b7ac-b14b4de8eda3","Type":"ContainerStarted","Data":"230b7fcab63a81d0d42fed10c3d4a72c547abaf14aece072885acc16eef62174"}
Sep 08 04:02:09.175169 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:09.174882    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-c8fb8d787-rf72p"
Sep 08 04:02:09.175169 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:09.174940    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-5c9t9"
Sep 08 04:02:09.180161 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:09.178624    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-p9x5z" event={"ID":"32b9b5a6-6468-4313-9b58-3c4daca3ab41","Type":"ContainerStarted","Data":"c9d336159932affa3066d3a04db1b99f56aabb7b7632a86f1d104aa99f0b3627"}
Sep 08 04:02:09.180161 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:09.179327    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-p9x5z"
Sep 08 04:02:09.180685 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:09.180375    2573 patch_prober.go:28] interesting pod/downloads-85d98c998f-p9x5z container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.11:8080/\": dial tcp 10.134.0.11:8080: connect: connection refused" start-of-body=
Sep 08 04:02:09.180685 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:09.180438    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-85d98c998f-p9x5z" podUID="32b9b5a6-6468-4313-9b58-3c4daca3ab41" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.11:8080/\": dial tcp 10.134.0.11:8080: connect: connection refused"
Sep 08 04:02:09.192621 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:09.192519    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.072057909 podStartE2EDuration="15.192505093s" totalImagesPullingTime="13.102938716s" totalInitContainerRuntime="17.508468ms" isStatefulPod=false podCreationTimestamp="2026-09-08 04:01:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:02:09.189771463 +0000 UTC m=+88.975062710" watchObservedRunningTime="2026-09-08 04:02:09.192505093 +0000 UTC m=+88.977796330"
Sep 08 04:02:09.218158 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:09.216252    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-c8fb8d787-rf72p" podStartSLOduration=10.204658628 podStartE2EDuration="14.216227577s" totalImagesPullingTime="4.011568949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:01:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:02:09.215861614 +0000 UTC m=+89.001152851" watchObservedRunningTime="2026-09-08 04:02:09.216227577 +0000 UTC m=+89.001518813"
Sep 08 04:02:09.253840 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:09.253778    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-p9x5z" podStartSLOduration=1.09279037 podStartE2EDuration="21.253758567s" totalImagesPullingTime="20.160968197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:01:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:02:09.252673969 +0000 UTC m=+89.037965208" watchObservedRunningTime="2026-09-08 04:02:09.253758567 +0000 UTC m=+89.039049804"
Sep 08 04:02:09.254147 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:09.254109    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-5c9t9" podStartSLOduration=2.811900235 podStartE2EDuration="12.254083023s" totalImagesPullingTime="9.442182788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:01:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:02:09.234820691 +0000 UTC m=+89.020111927" watchObservedRunningTime="2026-09-08 04:02:09.254083023 +0000 UTC m=+89.039374260"
Sep 08 04:02:09.272053 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:09.271994    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-57f4c8ddfc-l4w4v" podStartSLOduration=2.829476775 podStartE2EDuration="12.271979953s" totalImagesPullingTime="9.442503178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:01:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:02:09.271211515 +0000 UTC m=+89.056502751" watchObservedRunningTime="2026-09-08 04:02:09.271979953 +0000 UTC m=+89.057271187"
Sep 08 04:02:10.197903 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:10.197778    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-p9x5z"
Sep 08 04:02:13.212154 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:13.212117    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"447c33de-22cf-4226-9566-2a6878f51d16","Type":"ContainerStarted","Data":"048729d9e524459037f7dd89d11d0f7d7e84f40c577cdf78bd746bc75346fdbc"}
Sep 08 04:02:13.212535 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:13.212198    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"447c33de-22cf-4226-9566-2a6878f51d16","Type":"ContainerStarted","Data":"fcf62280cac569ac31f33a78f9778a1cb70b82041644f5e836b2bdcd05613752"}
Sep 08 04:02:13.212535 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:13.212241    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"447c33de-22cf-4226-9566-2a6878f51d16","Type":"ContainerStarted","Data":"60a41658dfedf6f89d6bb08935f637b03fef584c609a183729c5ec2bf4cc2697"}
Sep 08 04:02:13.212535 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:13.212281    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"447c33de-22cf-4226-9566-2a6878f51d16","Type":"ContainerStarted","Data":"8b4ad7c959675f7a649b2fb8993050dd840366b7690f48b59951a48e3a348d04"}
Sep 08 04:02:14.221084 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:14.221043    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"447c33de-22cf-4226-9566-2a6878f51d16","Type":"ContainerStarted","Data":"34b9e30f7232f3953ecd6a035d123ebee682dd3494fcb15b5f46dcd455638f6c"}
Sep 08 04:02:14.221495 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:14.221134    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"447c33de-22cf-4226-9566-2a6878f51d16","Type":"ContainerStarted","Data":"174b47be83c7a38b94951f9bdd45182d0888744db02ee1f31e8876a26ea02090"}
Sep 08 04:02:14.252606 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:14.252515    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.693117694 podStartE2EDuration="15.252492919s" totalImagesPullingTime="11.526390839s" totalInitContainerRuntime="32.984386ms" isStatefulPod=false podCreationTimestamp="2026-09-08 04:01:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:02:14.250950496 +0000 UTC m=+94.036241733" watchObservedRunningTime="2026-09-08 04:02:14.252492919 +0000 UTC m=+94.037784155"
Sep 08 04:02:14.865572 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:14.865513    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:02:18.076241 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:18.076201    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-57f4c8ddfc-l4w4v"
Sep 08 04:02:18.076686 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:18.076268    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-57f4c8ddfc-l4w4v"
Sep 08 04:02:21.200198 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:21.200165    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-c9r58_67c20357-ed4c-4e0d-9c10-39a6acf1a312/serve-healthcheck-canary/0.log"
Sep 08 04:02:25.031176 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:25.031141    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-46n66"
Sep 08 04:02:38.082868 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:38.082829    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-57f4c8ddfc-l4w4v"
Sep 08 04:02:38.086657 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:38.086635    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-57f4c8ddfc-l4w4v"
Sep 08 04:02:59.865424 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:59.865390    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:02:59.884816 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:02:59.884785    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:00.420346 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:00.420320    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:13.676276 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:13.676240    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 04:03:13.676752 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:13.676507    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="497a5276-8391-430f-94b0-0ca6e03b84b8" containerName="alertmanager" containerID="cri-o://6930f558892d6fbdc4fd9bfbea5968a8559e4bc82d0d929abf42e1d2c264e85c" gracePeriod=120
Sep 08 04:03:13.676752 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:13.676602    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="497a5276-8391-430f-94b0-0ca6e03b84b8" containerName="kube-rbac-proxy-metric" containerID="cri-o://aaf822885935f4a71b51808d63ed0285a50afd20b779f47f4138d4e9bf83a95c" gracePeriod=120
Sep 08 04:03:13.676752 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:13.676654    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="497a5276-8391-430f-94b0-0ca6e03b84b8" containerName="kube-rbac-proxy-web" containerID="cri-o://6a0a91cfe95380a86771e9fb319cba324e2fd6226422127a5636088b7eee0087" gracePeriod=120
Sep 08 04:03:13.676752 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:13.676678    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="497a5276-8391-430f-94b0-0ca6e03b84b8" containerName="prom-label-proxy" containerID="cri-o://587bd20d715ba7daf5d2932f142220b44530ea1e87f6ed50b88bcced1fda5dc7" gracePeriod=120
Sep 08 04:03:13.676752 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:13.676733    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="497a5276-8391-430f-94b0-0ca6e03b84b8" containerName="config-reloader" containerID="cri-o://030f4fe542ea8a6dd76bf02f3689c8b6e348c3d202952b4989de8ff91fe9d724" gracePeriod=120
Sep 08 04:03:13.676998 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:13.676763    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="497a5276-8391-430f-94b0-0ca6e03b84b8" containerName="kube-rbac-proxy" containerID="cri-o://58d5b4ca5f5c89398938534d935448fc808a543052f189b6480d2e8739f6ac22" gracePeriod=120
Sep 08 04:03:14.461936 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:14.461895    2573 generic.go:356] "Generic (PLEG): container finished" podID="497a5276-8391-430f-94b0-0ca6e03b84b8" containerID="587bd20d715ba7daf5d2932f142220b44530ea1e87f6ed50b88bcced1fda5dc7" exitCode=0
Sep 08 04:03:14.461936 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:14.461919    2573 generic.go:356] "Generic (PLEG): container finished" podID="497a5276-8391-430f-94b0-0ca6e03b84b8" containerID="58d5b4ca5f5c89398938534d935448fc808a543052f189b6480d2e8739f6ac22" exitCode=0
Sep 08 04:03:14.461936 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:14.461925    2573 generic.go:356] "Generic (PLEG): container finished" podID="497a5276-8391-430f-94b0-0ca6e03b84b8" containerID="030f4fe542ea8a6dd76bf02f3689c8b6e348c3d202952b4989de8ff91fe9d724" exitCode=0
Sep 08 04:03:14.461936 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:14.461930    2573 generic.go:356] "Generic (PLEG): container finished" podID="497a5276-8391-430f-94b0-0ca6e03b84b8" containerID="6930f558892d6fbdc4fd9bfbea5968a8559e4bc82d0d929abf42e1d2c264e85c" exitCode=0
Sep 08 04:03:14.462252 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:14.461967    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"497a5276-8391-430f-94b0-0ca6e03b84b8","Type":"ContainerDied","Data":"587bd20d715ba7daf5d2932f142220b44530ea1e87f6ed50b88bcced1fda5dc7"}
Sep 08 04:03:14.462252 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:14.462042    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"497a5276-8391-430f-94b0-0ca6e03b84b8","Type":"ContainerDied","Data":"58d5b4ca5f5c89398938534d935448fc808a543052f189b6480d2e8739f6ac22"}
Sep 08 04:03:14.462252 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:14.462083    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"497a5276-8391-430f-94b0-0ca6e03b84b8","Type":"ContainerDied","Data":"030f4fe542ea8a6dd76bf02f3689c8b6e348c3d202952b4989de8ff91fe9d724"}
Sep 08 04:03:14.462252 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:14.462118    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"497a5276-8391-430f-94b0-0ca6e03b84b8","Type":"ContainerDied","Data":"6930f558892d6fbdc4fd9bfbea5968a8559e4bc82d0d929abf42e1d2c264e85c"}
Sep 08 04:03:15.010695 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.010671    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:15.115768 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.115688    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/497a5276-8391-430f-94b0-0ca6e03b84b8-metrics-client-ca\") pod \"497a5276-8391-430f-94b0-0ca6e03b84b8\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") "
Sep 08 04:03:15.115768 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.115733    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/497a5276-8391-430f-94b0-0ca6e03b84b8-config-out\") pod \"497a5276-8391-430f-94b0-0ca6e03b84b8\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") "
Sep 08 04:03:15.115980 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.115772    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/497a5276-8391-430f-94b0-0ca6e03b84b8-secret-alertmanager-kube-rbac-proxy\") pod \"497a5276-8391-430f-94b0-0ca6e03b84b8\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") "
Sep 08 04:03:15.115980 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.115800    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/497a5276-8391-430f-94b0-0ca6e03b84b8-web-config\") pod \"497a5276-8391-430f-94b0-0ca6e03b84b8\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") "
Sep 08 04:03:15.115980 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.115845    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/497a5276-8391-430f-94b0-0ca6e03b84b8-cluster-tls-config\") pod \"497a5276-8391-430f-94b0-0ca6e03b84b8\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") "
Sep 08 04:03:15.115980 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.115875    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/497a5276-8391-430f-94b0-0ca6e03b84b8-secret-alertmanager-main-tls\") pod \"497a5276-8391-430f-94b0-0ca6e03b84b8\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") "
Sep 08 04:03:15.115980 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.115904    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/497a5276-8391-430f-94b0-0ca6e03b84b8-secret-alertmanager-kube-rbac-proxy-web\") pod \"497a5276-8391-430f-94b0-0ca6e03b84b8\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") "
Sep 08 04:03:15.115980 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.115935    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/497a5276-8391-430f-94b0-0ca6e03b84b8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"497a5276-8391-430f-94b0-0ca6e03b84b8\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") "
Sep 08 04:03:15.115980 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.115966    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/497a5276-8391-430f-94b0-0ca6e03b84b8-config-volume\") pod \"497a5276-8391-430f-94b0-0ca6e03b84b8\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") "
Sep 08 04:03:15.116296 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.115994    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/497a5276-8391-430f-94b0-0ca6e03b84b8-alertmanager-main-db\") pod \"497a5276-8391-430f-94b0-0ca6e03b84b8\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") "
Sep 08 04:03:15.116296 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.116043    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/497a5276-8391-430f-94b0-0ca6e03b84b8-tls-assets\") pod \"497a5276-8391-430f-94b0-0ca6e03b84b8\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") "
Sep 08 04:03:15.116296 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.116078    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/497a5276-8391-430f-94b0-0ca6e03b84b8-alertmanager-trusted-ca-bundle\") pod \"497a5276-8391-430f-94b0-0ca6e03b84b8\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") "
Sep 08 04:03:15.116296 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.116108    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flhr6\" (UniqueName: \"kubernetes.io/projected/497a5276-8391-430f-94b0-0ca6e03b84b8-kube-api-access-flhr6\") pod \"497a5276-8391-430f-94b0-0ca6e03b84b8\" (UID: \"497a5276-8391-430f-94b0-0ca6e03b84b8\") "
Sep 08 04:03:15.116296 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.116098    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/497a5276-8391-430f-94b0-0ca6e03b84b8-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "497a5276-8391-430f-94b0-0ca6e03b84b8" (UID: "497a5276-8391-430f-94b0-0ca6e03b84b8"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 04:03:15.116491 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.116352    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/497a5276-8391-430f-94b0-0ca6e03b84b8-metrics-client-ca\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:03:15.119115 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.118843    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/497a5276-8391-430f-94b0-0ca6e03b84b8-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "497a5276-8391-430f-94b0-0ca6e03b84b8" (UID: "497a5276-8391-430f-94b0-0ca6e03b84b8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:03:15.119236 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.119145    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/497a5276-8391-430f-94b0-0ca6e03b84b8-config-out" (OuterVolumeSpecName: "config-out") pod "497a5276-8391-430f-94b0-0ca6e03b84b8" (UID: "497a5276-8391-430f-94b0-0ca6e03b84b8"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:03:15.119236 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.119154    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/497a5276-8391-430f-94b0-0ca6e03b84b8-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "497a5276-8391-430f-94b0-0ca6e03b84b8" (UID: "497a5276-8391-430f-94b0-0ca6e03b84b8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:03:15.119236 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.119194    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/497a5276-8391-430f-94b0-0ca6e03b84b8-kube-api-access-flhr6" (OuterVolumeSpecName: "kube-api-access-flhr6") pod "497a5276-8391-430f-94b0-0ca6e03b84b8" (UID: "497a5276-8391-430f-94b0-0ca6e03b84b8"). InnerVolumeSpecName "kube-api-access-flhr6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:03:15.119474 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.119457    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/497a5276-8391-430f-94b0-0ca6e03b84b8-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "497a5276-8391-430f-94b0-0ca6e03b84b8" (UID: "497a5276-8391-430f-94b0-0ca6e03b84b8"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:03:15.119533 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.119505    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/497a5276-8391-430f-94b0-0ca6e03b84b8-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "497a5276-8391-430f-94b0-0ca6e03b84b8" (UID: "497a5276-8391-430f-94b0-0ca6e03b84b8"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 04:03:15.119621 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.119543    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/497a5276-8391-430f-94b0-0ca6e03b84b8-config-volume" (OuterVolumeSpecName: "config-volume") pod "497a5276-8391-430f-94b0-0ca6e03b84b8" (UID: "497a5276-8391-430f-94b0-0ca6e03b84b8"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:03:15.119965 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.119929    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/497a5276-8391-430f-94b0-0ca6e03b84b8-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "497a5276-8391-430f-94b0-0ca6e03b84b8" (UID: "497a5276-8391-430f-94b0-0ca6e03b84b8"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:03:15.121033 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.121013    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/497a5276-8391-430f-94b0-0ca6e03b84b8-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "497a5276-8391-430f-94b0-0ca6e03b84b8" (UID: "497a5276-8391-430f-94b0-0ca6e03b84b8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:03:15.121530 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.121505    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/497a5276-8391-430f-94b0-0ca6e03b84b8-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "497a5276-8391-430f-94b0-0ca6e03b84b8" (UID: "497a5276-8391-430f-94b0-0ca6e03b84b8"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:03:15.123135 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.123107    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/497a5276-8391-430f-94b0-0ca6e03b84b8-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "497a5276-8391-430f-94b0-0ca6e03b84b8" (UID: "497a5276-8391-430f-94b0-0ca6e03b84b8"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:03:15.129666 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.129645    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/497a5276-8391-430f-94b0-0ca6e03b84b8-web-config" (OuterVolumeSpecName: "web-config") pod "497a5276-8391-430f-94b0-0ca6e03b84b8" (UID: "497a5276-8391-430f-94b0-0ca6e03b84b8"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:03:15.217730 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.217694    2573 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/497a5276-8391-430f-94b0-0ca6e03b84b8-cluster-tls-config\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:03:15.217730 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.217728    2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/497a5276-8391-430f-94b0-0ca6e03b84b8-secret-alertmanager-main-tls\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:03:15.217730 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.217739    2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/497a5276-8391-430f-94b0-0ca6e03b84b8-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:03:15.217895 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.217749    2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/497a5276-8391-430f-94b0-0ca6e03b84b8-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:03:15.217895 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.217758    2573 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/497a5276-8391-430f-94b0-0ca6e03b84b8-config-volume\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:03:15.217895 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.217766    2573 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/497a5276-8391-430f-94b0-0ca6e03b84b8-alertmanager-main-db\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:03:15.217895 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.217774    2573 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/497a5276-8391-430f-94b0-0ca6e03b84b8-tls-assets\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:03:15.217895 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.217782    2573 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/497a5276-8391-430f-94b0-0ca6e03b84b8-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:03:15.217895 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.217790    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flhr6\" (UniqueName: \"kubernetes.io/projected/497a5276-8391-430f-94b0-0ca6e03b84b8-kube-api-access-flhr6\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:03:15.217895 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.217797    2573 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/497a5276-8391-430f-94b0-0ca6e03b84b8-config-out\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:03:15.217895 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.217805    2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/497a5276-8391-430f-94b0-0ca6e03b84b8-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:03:15.217895 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.217814    2573 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/497a5276-8391-430f-94b0-0ca6e03b84b8-web-config\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:03:15.469523 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.469435    2573 generic.go:356] "Generic (PLEG): container finished" podID="497a5276-8391-430f-94b0-0ca6e03b84b8" containerID="aaf822885935f4a71b51808d63ed0285a50afd20b779f47f4138d4e9bf83a95c" exitCode=0
Sep 08 04:03:15.469523 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.469458    2573 generic.go:356] "Generic (PLEG): container finished" podID="497a5276-8391-430f-94b0-0ca6e03b84b8" containerID="6a0a91cfe95380a86771e9fb319cba324e2fd6226422127a5636088b7eee0087" exitCode=0
Sep 08 04:03:15.469523 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.469511    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"497a5276-8391-430f-94b0-0ca6e03b84b8","Type":"ContainerDied","Data":"aaf822885935f4a71b51808d63ed0285a50afd20b779f47f4138d4e9bf83a95c"}
Sep 08 04:03:15.469808 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.469589    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"497a5276-8391-430f-94b0-0ca6e03b84b8","Type":"ContainerDied","Data":"6a0a91cfe95380a86771e9fb319cba324e2fd6226422127a5636088b7eee0087"}
Sep 08 04:03:15.469808 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.469594    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:15.469808 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.469618    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"497a5276-8391-430f-94b0-0ca6e03b84b8","Type":"ContainerDied","Data":"3c2af11ade4b6c38ef3d787f0125a0490deff895024f41fe16bc8c2a4a953dcf"}
Sep 08 04:03:15.469808 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.469648    2573 scope.go:117] "RemoveContainer" containerID="587bd20d715ba7daf5d2932f142220b44530ea1e87f6ed50b88bcced1fda5dc7"
Sep 08 04:03:15.477977 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.477961    2573 scope.go:117] "RemoveContainer" containerID="aaf822885935f4a71b51808d63ed0285a50afd20b779f47f4138d4e9bf83a95c"
Sep 08 04:03:15.484901 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.484882    2573 scope.go:117] "RemoveContainer" containerID="58d5b4ca5f5c89398938534d935448fc808a543052f189b6480d2e8739f6ac22"
Sep 08 04:03:15.491729 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.491714    2573 scope.go:117] "RemoveContainer" containerID="6a0a91cfe95380a86771e9fb319cba324e2fd6226422127a5636088b7eee0087"
Sep 08 04:03:15.495383 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.495336    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 04:03:15.499063 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.499048    2573 scope.go:117] "RemoveContainer" containerID="030f4fe542ea8a6dd76bf02f3689c8b6e348c3d202952b4989de8ff91fe9d724"
Sep 08 04:03:15.501620 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.501598    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 04:03:15.506188 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.506175    2573 scope.go:117] "RemoveContainer" containerID="6930f558892d6fbdc4fd9bfbea5968a8559e4bc82d0d929abf42e1d2c264e85c"
Sep 08 04:03:15.512900 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.512877    2573 scope.go:117] "RemoveContainer" containerID="9748bbfc248a0c4459c5ef09ac1b5b1ec0cef9748ffad598d18c9ffce33c1c99"
Sep 08 04:03:15.519362 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.519347    2573 scope.go:117] "RemoveContainer" containerID="587bd20d715ba7daf5d2932f142220b44530ea1e87f6ed50b88bcced1fda5dc7"
Sep 08 04:03:15.519636 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:03:15.519615    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"587bd20d715ba7daf5d2932f142220b44530ea1e87f6ed50b88bcced1fda5dc7\": container with ID starting with 587bd20d715ba7daf5d2932f142220b44530ea1e87f6ed50b88bcced1fda5dc7 not found: ID does not exist" containerID="587bd20d715ba7daf5d2932f142220b44530ea1e87f6ed50b88bcced1fda5dc7"
Sep 08 04:03:15.519728 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.519642    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"587bd20d715ba7daf5d2932f142220b44530ea1e87f6ed50b88bcced1fda5dc7"} err="failed to get container status \"587bd20d715ba7daf5d2932f142220b44530ea1e87f6ed50b88bcced1fda5dc7\": rpc error: code = NotFound desc = could not find container \"587bd20d715ba7daf5d2932f142220b44530ea1e87f6ed50b88bcced1fda5dc7\": container with ID starting with 587bd20d715ba7daf5d2932f142220b44530ea1e87f6ed50b88bcced1fda5dc7 not found: ID does not exist"
Sep 08 04:03:15.519728 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.519671    2573 scope.go:117] "RemoveContainer" containerID="aaf822885935f4a71b51808d63ed0285a50afd20b779f47f4138d4e9bf83a95c"
Sep 08 04:03:15.519945 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:03:15.519930    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aaf822885935f4a71b51808d63ed0285a50afd20b779f47f4138d4e9bf83a95c\": container with ID starting with aaf822885935f4a71b51808d63ed0285a50afd20b779f47f4138d4e9bf83a95c not found: ID does not exist" containerID="aaf822885935f4a71b51808d63ed0285a50afd20b779f47f4138d4e9bf83a95c"
Sep 08 04:03:15.519991 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.519950    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aaf822885935f4a71b51808d63ed0285a50afd20b779f47f4138d4e9bf83a95c"} err="failed to get container status \"aaf822885935f4a71b51808d63ed0285a50afd20b779f47f4138d4e9bf83a95c\": rpc error: code = NotFound desc = could not find container \"aaf822885935f4a71b51808d63ed0285a50afd20b779f47f4138d4e9bf83a95c\": container with ID starting with aaf822885935f4a71b51808d63ed0285a50afd20b779f47f4138d4e9bf83a95c not found: ID does not exist"
Sep 08 04:03:15.519991 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.519963    2573 scope.go:117] "RemoveContainer" containerID="58d5b4ca5f5c89398938534d935448fc808a543052f189b6480d2e8739f6ac22"
Sep 08 04:03:15.520170 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:03:15.520158    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58d5b4ca5f5c89398938534d935448fc808a543052f189b6480d2e8739f6ac22\": container with ID starting with 58d5b4ca5f5c89398938534d935448fc808a543052f189b6480d2e8739f6ac22 not found: ID does not exist" containerID="58d5b4ca5f5c89398938534d935448fc808a543052f189b6480d2e8739f6ac22"
Sep 08 04:03:15.520215 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.520172    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58d5b4ca5f5c89398938534d935448fc808a543052f189b6480d2e8739f6ac22"} err="failed to get container status \"58d5b4ca5f5c89398938534d935448fc808a543052f189b6480d2e8739f6ac22\": rpc error: code = NotFound desc = could not find container \"58d5b4ca5f5c89398938534d935448fc808a543052f189b6480d2e8739f6ac22\": container with ID starting with 58d5b4ca5f5c89398938534d935448fc808a543052f189b6480d2e8739f6ac22 not found: ID does not exist"
Sep 08 04:03:15.520215 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.520183    2573 scope.go:117] "RemoveContainer" containerID="6a0a91cfe95380a86771e9fb319cba324e2fd6226422127a5636088b7eee0087"
Sep 08 04:03:15.520394 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:03:15.520375    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a0a91cfe95380a86771e9fb319cba324e2fd6226422127a5636088b7eee0087\": container with ID starting with 6a0a91cfe95380a86771e9fb319cba324e2fd6226422127a5636088b7eee0087 not found: ID does not exist" containerID="6a0a91cfe95380a86771e9fb319cba324e2fd6226422127a5636088b7eee0087"
Sep 08 04:03:15.520440 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.520402    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a0a91cfe95380a86771e9fb319cba324e2fd6226422127a5636088b7eee0087"} err="failed to get container status \"6a0a91cfe95380a86771e9fb319cba324e2fd6226422127a5636088b7eee0087\": rpc error: code = NotFound desc = could not find container \"6a0a91cfe95380a86771e9fb319cba324e2fd6226422127a5636088b7eee0087\": container with ID starting with 6a0a91cfe95380a86771e9fb319cba324e2fd6226422127a5636088b7eee0087 not found: ID does not exist"
Sep 08 04:03:15.520440 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.520417    2573 scope.go:117] "RemoveContainer" containerID="030f4fe542ea8a6dd76bf02f3689c8b6e348c3d202952b4989de8ff91fe9d724"
Sep 08 04:03:15.520700 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:03:15.520685    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"030f4fe542ea8a6dd76bf02f3689c8b6e348c3d202952b4989de8ff91fe9d724\": container with ID starting with 030f4fe542ea8a6dd76bf02f3689c8b6e348c3d202952b4989de8ff91fe9d724 not found: ID does not exist" containerID="030f4fe542ea8a6dd76bf02f3689c8b6e348c3d202952b4989de8ff91fe9d724"
Sep 08 04:03:15.520754 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.520703    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"030f4fe542ea8a6dd76bf02f3689c8b6e348c3d202952b4989de8ff91fe9d724"} err="failed to get container status \"030f4fe542ea8a6dd76bf02f3689c8b6e348c3d202952b4989de8ff91fe9d724\": rpc error: code = NotFound desc = could not find container \"030f4fe542ea8a6dd76bf02f3689c8b6e348c3d202952b4989de8ff91fe9d724\": container with ID starting with 030f4fe542ea8a6dd76bf02f3689c8b6e348c3d202952b4989de8ff91fe9d724 not found: ID does not exist"
Sep 08 04:03:15.520754 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.520723    2573 scope.go:117] "RemoveContainer" containerID="6930f558892d6fbdc4fd9bfbea5968a8559e4bc82d0d929abf42e1d2c264e85c"
Sep 08 04:03:15.520968 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:03:15.520950    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6930f558892d6fbdc4fd9bfbea5968a8559e4bc82d0d929abf42e1d2c264e85c\": container with ID starting with 6930f558892d6fbdc4fd9bfbea5968a8559e4bc82d0d929abf42e1d2c264e85c not found: ID does not exist" containerID="6930f558892d6fbdc4fd9bfbea5968a8559e4bc82d0d929abf42e1d2c264e85c"
Sep 08 04:03:15.521007 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.520972    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6930f558892d6fbdc4fd9bfbea5968a8559e4bc82d0d929abf42e1d2c264e85c"} err="failed to get container status \"6930f558892d6fbdc4fd9bfbea5968a8559e4bc82d0d929abf42e1d2c264e85c\": rpc error: code = NotFound desc = could not find container \"6930f558892d6fbdc4fd9bfbea5968a8559e4bc82d0d929abf42e1d2c264e85c\": container with ID starting with 6930f558892d6fbdc4fd9bfbea5968a8559e4bc82d0d929abf42e1d2c264e85c not found: ID does not exist"
Sep 08 04:03:15.521007 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.520986    2573 scope.go:117] "RemoveContainer" containerID="9748bbfc248a0c4459c5ef09ac1b5b1ec0cef9748ffad598d18c9ffce33c1c99"
Sep 08 04:03:15.521202 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:03:15.521188    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9748bbfc248a0c4459c5ef09ac1b5b1ec0cef9748ffad598d18c9ffce33c1c99\": container with ID starting with 9748bbfc248a0c4459c5ef09ac1b5b1ec0cef9748ffad598d18c9ffce33c1c99 not found: ID does not exist" containerID="9748bbfc248a0c4459c5ef09ac1b5b1ec0cef9748ffad598d18c9ffce33c1c99"
Sep 08 04:03:15.521242 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.521205    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9748bbfc248a0c4459c5ef09ac1b5b1ec0cef9748ffad598d18c9ffce33c1c99"} err="failed to get container status \"9748bbfc248a0c4459c5ef09ac1b5b1ec0cef9748ffad598d18c9ffce33c1c99\": rpc error: code = NotFound desc = could not find container \"9748bbfc248a0c4459c5ef09ac1b5b1ec0cef9748ffad598d18c9ffce33c1c99\": container with ID starting with 9748bbfc248a0c4459c5ef09ac1b5b1ec0cef9748ffad598d18c9ffce33c1c99 not found: ID does not exist"
Sep 08 04:03:15.521242 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.521218    2573 scope.go:117] "RemoveContainer" containerID="587bd20d715ba7daf5d2932f142220b44530ea1e87f6ed50b88bcced1fda5dc7"
Sep 08 04:03:15.521409 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.521394    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"587bd20d715ba7daf5d2932f142220b44530ea1e87f6ed50b88bcced1fda5dc7"} err="failed to get container status \"587bd20d715ba7daf5d2932f142220b44530ea1e87f6ed50b88bcced1fda5dc7\": rpc error: code = NotFound desc = could not find container \"587bd20d715ba7daf5d2932f142220b44530ea1e87f6ed50b88bcced1fda5dc7\": container with ID starting with 587bd20d715ba7daf5d2932f142220b44530ea1e87f6ed50b88bcced1fda5dc7 not found: ID does not exist"
Sep 08 04:03:15.521447 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.521409    2573 scope.go:117] "RemoveContainer" containerID="aaf822885935f4a71b51808d63ed0285a50afd20b779f47f4138d4e9bf83a95c"
Sep 08 04:03:15.521668 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.521652    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aaf822885935f4a71b51808d63ed0285a50afd20b779f47f4138d4e9bf83a95c"} err="failed to get container status \"aaf822885935f4a71b51808d63ed0285a50afd20b779f47f4138d4e9bf83a95c\": rpc error: code = NotFound desc = could not find container \"aaf822885935f4a71b51808d63ed0285a50afd20b779f47f4138d4e9bf83a95c\": container with ID starting with aaf822885935f4a71b51808d63ed0285a50afd20b779f47f4138d4e9bf83a95c not found: ID does not exist"
Sep 08 04:03:15.521715 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.521669    2573 scope.go:117] "RemoveContainer" containerID="58d5b4ca5f5c89398938534d935448fc808a543052f189b6480d2e8739f6ac22"
Sep 08 04:03:15.521871 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.521856    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58d5b4ca5f5c89398938534d935448fc808a543052f189b6480d2e8739f6ac22"} err="failed to get container status \"58d5b4ca5f5c89398938534d935448fc808a543052f189b6480d2e8739f6ac22\": rpc error: code = NotFound desc = could not find container \"58d5b4ca5f5c89398938534d935448fc808a543052f189b6480d2e8739f6ac22\": container with ID starting with 58d5b4ca5f5c89398938534d935448fc808a543052f189b6480d2e8739f6ac22 not found: ID does not exist"
Sep 08 04:03:15.521920 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.521874    2573 scope.go:117] "RemoveContainer" containerID="6a0a91cfe95380a86771e9fb319cba324e2fd6226422127a5636088b7eee0087"
Sep 08 04:03:15.522059 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.522043    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a0a91cfe95380a86771e9fb319cba324e2fd6226422127a5636088b7eee0087"} err="failed to get container status \"6a0a91cfe95380a86771e9fb319cba324e2fd6226422127a5636088b7eee0087\": rpc error: code = NotFound desc = could not find container \"6a0a91cfe95380a86771e9fb319cba324e2fd6226422127a5636088b7eee0087\": container with ID starting with 6a0a91cfe95380a86771e9fb319cba324e2fd6226422127a5636088b7eee0087 not found: ID does not exist"
Sep 08 04:03:15.522104 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.522060    2573 scope.go:117] "RemoveContainer" containerID="030f4fe542ea8a6dd76bf02f3689c8b6e348c3d202952b4989de8ff91fe9d724"
Sep 08 04:03:15.522262 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.522244    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"030f4fe542ea8a6dd76bf02f3689c8b6e348c3d202952b4989de8ff91fe9d724"} err="failed to get container status \"030f4fe542ea8a6dd76bf02f3689c8b6e348c3d202952b4989de8ff91fe9d724\": rpc error: code = NotFound desc = could not find container \"030f4fe542ea8a6dd76bf02f3689c8b6e348c3d202952b4989de8ff91fe9d724\": container with ID starting with 030f4fe542ea8a6dd76bf02f3689c8b6e348c3d202952b4989de8ff91fe9d724 not found: ID does not exist"
Sep 08 04:03:15.522262 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.522260    2573 scope.go:117] "RemoveContainer" containerID="6930f558892d6fbdc4fd9bfbea5968a8559e4bc82d0d929abf42e1d2c264e85c"
Sep 08 04:03:15.522486 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.522468    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6930f558892d6fbdc4fd9bfbea5968a8559e4bc82d0d929abf42e1d2c264e85c"} err="failed to get container status \"6930f558892d6fbdc4fd9bfbea5968a8559e4bc82d0d929abf42e1d2c264e85c\": rpc error: code = NotFound desc = could not find container \"6930f558892d6fbdc4fd9bfbea5968a8559e4bc82d0d929abf42e1d2c264e85c\": container with ID starting with 6930f558892d6fbdc4fd9bfbea5968a8559e4bc82d0d929abf42e1d2c264e85c not found: ID does not exist"
Sep 08 04:03:15.522548 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.522487    2573 scope.go:117] "RemoveContainer" containerID="9748bbfc248a0c4459c5ef09ac1b5b1ec0cef9748ffad598d18c9ffce33c1c99"
Sep 08 04:03:15.522714 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.522698    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9748bbfc248a0c4459c5ef09ac1b5b1ec0cef9748ffad598d18c9ffce33c1c99"} err="failed to get container status \"9748bbfc248a0c4459c5ef09ac1b5b1ec0cef9748ffad598d18c9ffce33c1c99\": rpc error: code = NotFound desc = could not find container \"9748bbfc248a0c4459c5ef09ac1b5b1ec0cef9748ffad598d18c9ffce33c1c99\": container with ID starting with 9748bbfc248a0c4459c5ef09ac1b5b1ec0cef9748ffad598d18c9ffce33c1c99 not found: ID does not exist"
Sep 08 04:03:15.606863 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.606830    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 04:03:15.607132 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.607119    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="497a5276-8391-430f-94b0-0ca6e03b84b8" containerName="init-config-reloader"
Sep 08 04:03:15.607173 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.607134    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="497a5276-8391-430f-94b0-0ca6e03b84b8" containerName="init-config-reloader"
Sep 08 04:03:15.607173 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.607141    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="497a5276-8391-430f-94b0-0ca6e03b84b8" containerName="alertmanager"
Sep 08 04:03:15.607173 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.607147    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="497a5276-8391-430f-94b0-0ca6e03b84b8" containerName="alertmanager"
Sep 08 04:03:15.607173 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.607157    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="497a5276-8391-430f-94b0-0ca6e03b84b8" containerName="config-reloader"
Sep 08 04:03:15.607173 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.607162    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="497a5276-8391-430f-94b0-0ca6e03b84b8" containerName="config-reloader"
Sep 08 04:03:15.607173 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.607167    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="497a5276-8391-430f-94b0-0ca6e03b84b8" containerName="kube-rbac-proxy-web"
Sep 08 04:03:15.607173 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.607172    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="497a5276-8391-430f-94b0-0ca6e03b84b8" containerName="kube-rbac-proxy-web"
Sep 08 04:03:15.607369 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.607183    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="497a5276-8391-430f-94b0-0ca6e03b84b8" containerName="kube-rbac-proxy"
Sep 08 04:03:15.607369 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.607188    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="497a5276-8391-430f-94b0-0ca6e03b84b8" containerName="kube-rbac-proxy"
Sep 08 04:03:15.607369 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.607194    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="497a5276-8391-430f-94b0-0ca6e03b84b8" containerName="kube-rbac-proxy-metric"
Sep 08 04:03:15.607369 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.607200    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="497a5276-8391-430f-94b0-0ca6e03b84b8" containerName="kube-rbac-proxy-metric"
Sep 08 04:03:15.607369 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.607208    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="497a5276-8391-430f-94b0-0ca6e03b84b8" containerName="prom-label-proxy"
Sep 08 04:03:15.607369 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.607213    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="497a5276-8391-430f-94b0-0ca6e03b84b8" containerName="prom-label-proxy"
Sep 08 04:03:15.607369 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.607257    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="497a5276-8391-430f-94b0-0ca6e03b84b8" containerName="kube-rbac-proxy-web"
Sep 08 04:03:15.607369 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.607265    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="497a5276-8391-430f-94b0-0ca6e03b84b8" containerName="alertmanager"
Sep 08 04:03:15.607369 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.607272    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="497a5276-8391-430f-94b0-0ca6e03b84b8" containerName="kube-rbac-proxy-metric"
Sep 08 04:03:15.607369 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.607278    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="497a5276-8391-430f-94b0-0ca6e03b84b8" containerName="config-reloader"
Sep 08 04:03:15.607369 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.607284    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="497a5276-8391-430f-94b0-0ca6e03b84b8" containerName="prom-label-proxy"
Sep 08 04:03:15.607369 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.607289    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="497a5276-8391-430f-94b0-0ca6e03b84b8" containerName="kube-rbac-proxy"
Sep 08 04:03:15.613248 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.612051    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:15.615679 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.615653    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 08 04:03:15.615679 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.615674    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-5db7q\""
Sep 08 04:03:15.615875 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.615689    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 08 04:03:15.615875 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.615728    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 08 04:03:15.615969 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.615895    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 08 04:03:15.616078 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.616054    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 08 04:03:15.616158 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.616134    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 08 04:03:15.616616 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.616596    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 08 04:03:15.616693 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.616677    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 08 04:03:15.622524 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.622501    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 08 04:03:15.630682 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.630659    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 04:03:15.720781 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.720704    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f2e6796f-037a-4d49-9943-e1573a09c0b2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f2e6796f-037a-4d49-9943-e1573a09c0b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:15.720781 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.720744    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f2e6796f-037a-4d49-9943-e1573a09c0b2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f2e6796f-037a-4d49-9943-e1573a09c0b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:15.720781 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.720761    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f2e6796f-037a-4d49-9943-e1573a09c0b2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f2e6796f-037a-4d49-9943-e1573a09c0b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:15.720781 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.720778    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f2e6796f-037a-4d49-9943-e1573a09c0b2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f2e6796f-037a-4d49-9943-e1573a09c0b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:15.721042 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.720865    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f2e6796f-037a-4d49-9943-e1573a09c0b2-config-volume\") pod \"alertmanager-main-0\" (UID: \"f2e6796f-037a-4d49-9943-e1573a09c0b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:15.721042 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.720895    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f2e6796f-037a-4d49-9943-e1573a09c0b2-web-config\") pod \"alertmanager-main-0\" (UID: \"f2e6796f-037a-4d49-9943-e1573a09c0b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:15.721042 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.720920    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f2e6796f-037a-4d49-9943-e1573a09c0b2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f2e6796f-037a-4d49-9943-e1573a09c0b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:15.721042 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.720968    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2e6796f-037a-4d49-9943-e1573a09c0b2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f2e6796f-037a-4d49-9943-e1573a09c0b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:15.721042 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.721005    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f2e6796f-037a-4d49-9943-e1573a09c0b2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f2e6796f-037a-4d49-9943-e1573a09c0b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:15.721042 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.721026    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2e6796f-037a-4d49-9943-e1573a09c0b2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f2e6796f-037a-4d49-9943-e1573a09c0b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:15.721042 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.721040    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7qfd\" (UniqueName: \"kubernetes.io/projected/f2e6796f-037a-4d49-9943-e1573a09c0b2-kube-api-access-v7qfd\") pod \"alertmanager-main-0\" (UID: \"f2e6796f-037a-4d49-9943-e1573a09c0b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:15.721276 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.721057    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f2e6796f-037a-4d49-9943-e1573a09c0b2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f2e6796f-037a-4d49-9943-e1573a09c0b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:15.721276 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.721082    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f2e6796f-037a-4d49-9943-e1573a09c0b2-config-out\") pod \"alertmanager-main-0\" (UID: \"f2e6796f-037a-4d49-9943-e1573a09c0b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:15.822022 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.821992    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f2e6796f-037a-4d49-9943-e1573a09c0b2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f2e6796f-037a-4d49-9943-e1573a09c0b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:15.822135 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.822029    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2e6796f-037a-4d49-9943-e1573a09c0b2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f2e6796f-037a-4d49-9943-e1573a09c0b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:15.822135 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.822053    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7qfd\" (UniqueName: \"kubernetes.io/projected/f2e6796f-037a-4d49-9943-e1573a09c0b2-kube-api-access-v7qfd\") pod \"alertmanager-main-0\" (UID: \"f2e6796f-037a-4d49-9943-e1573a09c0b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:15.822135 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.822078    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f2e6796f-037a-4d49-9943-e1573a09c0b2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f2e6796f-037a-4d49-9943-e1573a09c0b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:15.822135 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.822106    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f2e6796f-037a-4d49-9943-e1573a09c0b2-config-out\") pod \"alertmanager-main-0\" (UID: \"f2e6796f-037a-4d49-9943-e1573a09c0b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:15.822352 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.822170    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f2e6796f-037a-4d49-9943-e1573a09c0b2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f2e6796f-037a-4d49-9943-e1573a09c0b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:15.822352 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.822211    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f2e6796f-037a-4d49-9943-e1573a09c0b2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f2e6796f-037a-4d49-9943-e1573a09c0b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:15.822352 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.822246    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f2e6796f-037a-4d49-9943-e1573a09c0b2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f2e6796f-037a-4d49-9943-e1573a09c0b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:15.822352 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.822273    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f2e6796f-037a-4d49-9943-e1573a09c0b2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f2e6796f-037a-4d49-9943-e1573a09c0b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:15.822352 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.822307    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f2e6796f-037a-4d49-9943-e1573a09c0b2-config-volume\") pod \"alertmanager-main-0\" (UID: \"f2e6796f-037a-4d49-9943-e1573a09c0b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:15.822352 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.822330    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f2e6796f-037a-4d49-9943-e1573a09c0b2-web-config\") pod \"alertmanager-main-0\" (UID: \"f2e6796f-037a-4d49-9943-e1573a09c0b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:15.822663 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.822356    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f2e6796f-037a-4d49-9943-e1573a09c0b2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f2e6796f-037a-4d49-9943-e1573a09c0b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:15.822663 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.822397    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2e6796f-037a-4d49-9943-e1573a09c0b2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f2e6796f-037a-4d49-9943-e1573a09c0b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:15.822663 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.822438    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f2e6796f-037a-4d49-9943-e1573a09c0b2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f2e6796f-037a-4d49-9943-e1573a09c0b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:15.823194 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.823146    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2e6796f-037a-4d49-9943-e1573a09c0b2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f2e6796f-037a-4d49-9943-e1573a09c0b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:15.823430 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.823405    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2e6796f-037a-4d49-9943-e1573a09c0b2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f2e6796f-037a-4d49-9943-e1573a09c0b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:15.825337 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.825207    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f2e6796f-037a-4d49-9943-e1573a09c0b2-config-out\") pod \"alertmanager-main-0\" (UID: \"f2e6796f-037a-4d49-9943-e1573a09c0b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:15.825337 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.825326    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f2e6796f-037a-4d49-9943-e1573a09c0b2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f2e6796f-037a-4d49-9943-e1573a09c0b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:15.825524 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.825501    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f2e6796f-037a-4d49-9943-e1573a09c0b2-config-volume\") pod \"alertmanager-main-0\" (UID: \"f2e6796f-037a-4d49-9943-e1573a09c0b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:15.825677 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.825655    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f2e6796f-037a-4d49-9943-e1573a09c0b2-web-config\") pod \"alertmanager-main-0\" (UID: \"f2e6796f-037a-4d49-9943-e1573a09c0b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:15.825753 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.825689    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f2e6796f-037a-4d49-9943-e1573a09c0b2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f2e6796f-037a-4d49-9943-e1573a09c0b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:15.825828 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.825809    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f2e6796f-037a-4d49-9943-e1573a09c0b2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f2e6796f-037a-4d49-9943-e1573a09c0b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:15.825876 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.825824    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f2e6796f-037a-4d49-9943-e1573a09c0b2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f2e6796f-037a-4d49-9943-e1573a09c0b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:15.826012 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.825988    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f2e6796f-037a-4d49-9943-e1573a09c0b2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f2e6796f-037a-4d49-9943-e1573a09c0b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:15.827765 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.827740    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f2e6796f-037a-4d49-9943-e1573a09c0b2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f2e6796f-037a-4d49-9943-e1573a09c0b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:15.831865 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.831842    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7qfd\" (UniqueName: \"kubernetes.io/projected/f2e6796f-037a-4d49-9943-e1573a09c0b2-kube-api-access-v7qfd\") pod \"alertmanager-main-0\" (UID: \"f2e6796f-037a-4d49-9943-e1573a09c0b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:15.924104 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:15.924075    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 04:03:16.204397 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:16.204371    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 04:03:16.206369 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:03:16.206343    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2e6796f_037a_4d49_9943_e1573a09c0b2.slice/crio-17e1d6c76cb98456c9c4f2510aebfcc55f8e9fb30440cbd4c2f1dd5e89c87299 WatchSource:0}: Error finding container 17e1d6c76cb98456c9c4f2510aebfcc55f8e9fb30440cbd4c2f1dd5e89c87299: Status 404 returned error can't find the container with id 17e1d6c76cb98456c9c4f2510aebfcc55f8e9fb30440cbd4c2f1dd5e89c87299
Sep 08 04:03:16.476967 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:16.476883    2573 generic.go:356] "Generic (PLEG): container finished" podID="f2e6796f-037a-4d49-9943-e1573a09c0b2" containerID="50654bbfefcc3a9d7611718a8dae22b0fcb8592f188e5779995a0b8274cbd449" exitCode=0
Sep 08 04:03:16.476967 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:16.476927    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f2e6796f-037a-4d49-9943-e1573a09c0b2","Type":"ContainerDied","Data":"50654bbfefcc3a9d7611718a8dae22b0fcb8592f188e5779995a0b8274cbd449"}
Sep 08 04:03:16.477155 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:16.476975    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f2e6796f-037a-4d49-9943-e1573a09c0b2","Type":"ContainerStarted","Data":"17e1d6c76cb98456c9c4f2510aebfcc55f8e9fb30440cbd4c2f1dd5e89c87299"}
Sep 08 04:03:16.674890 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:16.674866    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="497a5276-8391-430f-94b0-0ca6e03b84b8" path="/var/lib/kubelet/pods/497a5276-8391-430f-94b0-0ca6e03b84b8/volumes"
Sep 08 04:03:17.484860 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.484825    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f2e6796f-037a-4d49-9943-e1573a09c0b2","Type":"ContainerStarted","Data":"6eafc324154fafad8a6a25cbe24bdbb5ee29b14851d2bda47500cb1f561564e8"}
Sep 08 04:03:17.485284 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.484886    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f2e6796f-037a-4d49-9943-e1573a09c0b2","Type":"ContainerStarted","Data":"05cc002441b3b246d81820e1164246d277b5ac49dd256f66c4a72e0ebca9d141"}
Sep 08 04:03:17.485284 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.484914    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f2e6796f-037a-4d49-9943-e1573a09c0b2","Type":"ContainerStarted","Data":"953fc27fe191d351a809ab382e62268a3761a57bc35b94828b9a124793918ba5"}
Sep 08 04:03:17.485284 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.484940    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f2e6796f-037a-4d49-9943-e1573a09c0b2","Type":"ContainerStarted","Data":"1727cb4cb4509004165aab125be26667ee0f746782e87f05953fb63fe8bee9be"}
Sep 08 04:03:17.485284 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.484962    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f2e6796f-037a-4d49-9943-e1573a09c0b2","Type":"ContainerStarted","Data":"4d07c9229a788d9d054159970e793a71ab2a1dcdfce067030ead638b26b620fa"}
Sep 08 04:03:17.485284 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.484986    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f2e6796f-037a-4d49-9943-e1573a09c0b2","Type":"ContainerStarted","Data":"9f10b5e058c8c1d949f826e4b6d71d0cf05934113ed236dcf22849ec63830acd"}
Sep 08 04:03:17.518206 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.518151    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.498797323 podStartE2EDuration="2.51813373s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.336407ms" isStatefulPod=false podCreationTimestamp="2026-09-08 04:03:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:03:17.515802402 +0000 UTC m=+157.301093643" watchObservedRunningTime="2026-09-08 04:03:17.51813373 +0000 UTC m=+157.303424965"
Sep 08 04:03:17.682224 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.682186    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7f797b7d7b-b7h6c"]
Sep 08 04:03:17.686820 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.686786    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7f797b7d7b-b7h6c"
Sep 08 04:03:17.689643 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.689623    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 08 04:03:17.689831 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.689688    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-4r4x2\""
Sep 08 04:03:17.689955 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.689930    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 08 04:03:17.690965 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.690948    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 08 04:03:17.691118 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.691029    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 08 04:03:17.691628 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.691609    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 08 04:03:17.695790 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.695734    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 08 04:03:17.702615 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.702588    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7f797b7d7b-b7h6c"]
Sep 08 04:03:17.737973 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.737894    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2d102228-2752-42c6-b8c5-73f802d06e4a-federate-client-tls\") pod \"telemeter-client-7f797b7d7b-b7h6c\" (UID: \"2d102228-2752-42c6-b8c5-73f802d06e4a\") " pod="openshift-monitoring/telemeter-client-7f797b7d7b-b7h6c"
Sep 08 04:03:17.737973 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.737935    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d102228-2752-42c6-b8c5-73f802d06e4a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f797b7d7b-b7h6c\" (UID: \"2d102228-2752-42c6-b8c5-73f802d06e4a\") " pod="openshift-monitoring/telemeter-client-7f797b7d7b-b7h6c"
Sep 08 04:03:17.737973 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.737957    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2d102228-2752-42c6-b8c5-73f802d06e4a-secret-telemeter-client\") pod \"telemeter-client-7f797b7d7b-b7h6c\" (UID: \"2d102228-2752-42c6-b8c5-73f802d06e4a\") " pod="openshift-monitoring/telemeter-client-7f797b7d7b-b7h6c"
Sep 08 04:03:17.738175 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.737978    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d102228-2752-42c6-b8c5-73f802d06e4a-metrics-client-ca\") pod \"telemeter-client-7f797b7d7b-b7h6c\" (UID: \"2d102228-2752-42c6-b8c5-73f802d06e4a\") " pod="openshift-monitoring/telemeter-client-7f797b7d7b-b7h6c"
Sep 08 04:03:17.738175 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.738054    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ngz4\" (UniqueName: \"kubernetes.io/projected/2d102228-2752-42c6-b8c5-73f802d06e4a-kube-api-access-9ngz4\") pod \"telemeter-client-7f797b7d7b-b7h6c\" (UID: \"2d102228-2752-42c6-b8c5-73f802d06e4a\") " pod="openshift-monitoring/telemeter-client-7f797b7d7b-b7h6c"
Sep 08 04:03:17.738175 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.738137    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2d102228-2752-42c6-b8c5-73f802d06e4a-telemeter-client-tls\") pod \"telemeter-client-7f797b7d7b-b7h6c\" (UID: \"2d102228-2752-42c6-b8c5-73f802d06e4a\") " pod="openshift-monitoring/telemeter-client-7f797b7d7b-b7h6c"
Sep 08 04:03:17.738175 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.738165    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d102228-2752-42c6-b8c5-73f802d06e4a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f797b7d7b-b7h6c\" (UID: \"2d102228-2752-42c6-b8c5-73f802d06e4a\") " pod="openshift-monitoring/telemeter-client-7f797b7d7b-b7h6c"
Sep 08 04:03:17.738323 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.738188    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d102228-2752-42c6-b8c5-73f802d06e4a-serving-certs-ca-bundle\") pod \"telemeter-client-7f797b7d7b-b7h6c\" (UID: \"2d102228-2752-42c6-b8c5-73f802d06e4a\") " pod="openshift-monitoring/telemeter-client-7f797b7d7b-b7h6c"
Sep 08 04:03:17.839493 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.839456    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2d102228-2752-42c6-b8c5-73f802d06e4a-telemeter-client-tls\") pod \"telemeter-client-7f797b7d7b-b7h6c\" (UID: \"2d102228-2752-42c6-b8c5-73f802d06e4a\") " pod="openshift-monitoring/telemeter-client-7f797b7d7b-b7h6c"
Sep 08 04:03:17.839861 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.839834    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d102228-2752-42c6-b8c5-73f802d06e4a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f797b7d7b-b7h6c\" (UID: \"2d102228-2752-42c6-b8c5-73f802d06e4a\") " pod="openshift-monitoring/telemeter-client-7f797b7d7b-b7h6c"
Sep 08 04:03:17.839948 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.839920    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d102228-2752-42c6-b8c5-73f802d06e4a-serving-certs-ca-bundle\") pod \"telemeter-client-7f797b7d7b-b7h6c\" (UID: \"2d102228-2752-42c6-b8c5-73f802d06e4a\") " pod="openshift-monitoring/telemeter-client-7f797b7d7b-b7h6c"
Sep 08 04:03:17.840019 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.839992    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2d102228-2752-42c6-b8c5-73f802d06e4a-federate-client-tls\") pod \"telemeter-client-7f797b7d7b-b7h6c\" (UID: \"2d102228-2752-42c6-b8c5-73f802d06e4a\") " pod="openshift-monitoring/telemeter-client-7f797b7d7b-b7h6c"
Sep 08 04:03:17.840068 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.840032    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d102228-2752-42c6-b8c5-73f802d06e4a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f797b7d7b-b7h6c\" (UID: \"2d102228-2752-42c6-b8c5-73f802d06e4a\") " pod="openshift-monitoring/telemeter-client-7f797b7d7b-b7h6c"
Sep 08 04:03:17.840115 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.840075    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2d102228-2752-42c6-b8c5-73f802d06e4a-secret-telemeter-client\") pod \"telemeter-client-7f797b7d7b-b7h6c\" (UID: \"2d102228-2752-42c6-b8c5-73f802d06e4a\") " pod="openshift-monitoring/telemeter-client-7f797b7d7b-b7h6c"
Sep 08 04:03:17.840115 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.840104    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d102228-2752-42c6-b8c5-73f802d06e4a-metrics-client-ca\") pod \"telemeter-client-7f797b7d7b-b7h6c\" (UID: \"2d102228-2752-42c6-b8c5-73f802d06e4a\") " pod="openshift-monitoring/telemeter-client-7f797b7d7b-b7h6c"
Sep 08 04:03:17.840210 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.840143    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ngz4\" (UniqueName: \"kubernetes.io/projected/2d102228-2752-42c6-b8c5-73f802d06e4a-kube-api-access-9ngz4\") pod \"telemeter-client-7f797b7d7b-b7h6c\" (UID: \"2d102228-2752-42c6-b8c5-73f802d06e4a\") " pod="openshift-monitoring/telemeter-client-7f797b7d7b-b7h6c"
Sep 08 04:03:17.841624 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.841526    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d102228-2752-42c6-b8c5-73f802d06e4a-serving-certs-ca-bundle\") pod \"telemeter-client-7f797b7d7b-b7h6c\" (UID: \"2d102228-2752-42c6-b8c5-73f802d06e4a\") " pod="openshift-monitoring/telemeter-client-7f797b7d7b-b7h6c"
Sep 08 04:03:17.841624 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.841583    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d102228-2752-42c6-b8c5-73f802d06e4a-metrics-client-ca\") pod \"telemeter-client-7f797b7d7b-b7h6c\" (UID: \"2d102228-2752-42c6-b8c5-73f802d06e4a\") " pod="openshift-monitoring/telemeter-client-7f797b7d7b-b7h6c"
Sep 08 04:03:17.842385 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.842361    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d102228-2752-42c6-b8c5-73f802d06e4a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f797b7d7b-b7h6c\" (UID: \"2d102228-2752-42c6-b8c5-73f802d06e4a\") " pod="openshift-monitoring/telemeter-client-7f797b7d7b-b7h6c"
Sep 08 04:03:17.843850 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.843829    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2d102228-2752-42c6-b8c5-73f802d06e4a-federate-client-tls\") pod \"telemeter-client-7f797b7d7b-b7h6c\" (UID: \"2d102228-2752-42c6-b8c5-73f802d06e4a\") " pod="openshift-monitoring/telemeter-client-7f797b7d7b-b7h6c"
Sep 08 04:03:17.843937 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.843892    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2d102228-2752-42c6-b8c5-73f802d06e4a-telemeter-client-tls\") pod \"telemeter-client-7f797b7d7b-b7h6c\" (UID: \"2d102228-2752-42c6-b8c5-73f802d06e4a\") " pod="openshift-monitoring/telemeter-client-7f797b7d7b-b7h6c"
Sep 08 04:03:17.844072 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.844050    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2d102228-2752-42c6-b8c5-73f802d06e4a-secret-telemeter-client\") pod \"telemeter-client-7f797b7d7b-b7h6c\" (UID: \"2d102228-2752-42c6-b8c5-73f802d06e4a\") " pod="openshift-monitoring/telemeter-client-7f797b7d7b-b7h6c"
Sep 08 04:03:17.844183 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.844163    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d102228-2752-42c6-b8c5-73f802d06e4a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f797b7d7b-b7h6c\" (UID: \"2d102228-2752-42c6-b8c5-73f802d06e4a\") " pod="openshift-monitoring/telemeter-client-7f797b7d7b-b7h6c"
Sep 08 04:03:17.849871 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.849851    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ngz4\" (UniqueName: \"kubernetes.io/projected/2d102228-2752-42c6-b8c5-73f802d06e4a-kube-api-access-9ngz4\") pod \"telemeter-client-7f797b7d7b-b7h6c\" (UID: \"2d102228-2752-42c6-b8c5-73f802d06e4a\") " pod="openshift-monitoring/telemeter-client-7f797b7d7b-b7h6c"
Sep 08 04:03:17.992080 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.992003    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 04:03:17.992386 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.992324    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="447c33de-22cf-4226-9566-2a6878f51d16" containerName="prometheus" containerID="cri-o://8b4ad7c959675f7a649b2fb8993050dd840366b7690f48b59951a48e3a348d04" gracePeriod=600
Sep 08 04:03:17.992547 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.992523    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="447c33de-22cf-4226-9566-2a6878f51d16" containerName="kube-rbac-proxy-web" containerID="cri-o://048729d9e524459037f7dd89d11d0f7d7e84f40c577cdf78bd746bc75346fdbc" gracePeriod=600
Sep 08 04:03:17.992812 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.992510    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="447c33de-22cf-4226-9566-2a6878f51d16" containerName="kube-rbac-proxy" containerID="cri-o://174b47be83c7a38b94951f9bdd45182d0888744db02ee1f31e8876a26ea02090" gracePeriod=600
Sep 08 04:03:17.992968 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.992602    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="447c33de-22cf-4226-9566-2a6878f51d16" containerName="kube-rbac-proxy-thanos" containerID="cri-o://34b9e30f7232f3953ecd6a035d123ebee682dd3494fcb15b5f46dcd455638f6c" gracePeriod=600
Sep 08 04:03:17.993100 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.992648    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="447c33de-22cf-4226-9566-2a6878f51d16" containerName="config-reloader" containerID="cri-o://60a41658dfedf6f89d6bb08935f637b03fef584c609a183729c5ec2bf4cc2697" gracePeriod=600
Sep 08 04:03:17.993738 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.992668    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="447c33de-22cf-4226-9566-2a6878f51d16" containerName="thanos-sidecar" containerID="cri-o://fcf62280cac569ac31f33a78f9778a1cb70b82041644f5e836b2bdcd05613752" gracePeriod=600
Sep 08 04:03:17.999782 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:17.999456    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7f797b7d7b-b7h6c"
Sep 08 04:03:18.237249 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.237219    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.307240 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.305533    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7f797b7d7b-b7h6c"]
Sep 08 04:03:18.309095 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:03:18.309051    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d102228_2752_42c6_b8c5_73f802d06e4a.slice/crio-283275fe38d3d6ff755096567c63103e6fce4fe166404f1dbe57c04b7f32097b WatchSource:0}: Error finding container 283275fe38d3d6ff755096567c63103e6fce4fe166404f1dbe57c04b7f32097b: Status 404 returned error can't find the container with id 283275fe38d3d6ff755096567c63103e6fce4fe166404f1dbe57c04b7f32097b
Sep 08 04:03:18.344575 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.344538    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/447c33de-22cf-4226-9566-2a6878f51d16-configmap-metrics-client-ca\") pod \"447c33de-22cf-4226-9566-2a6878f51d16\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") "
Sep 08 04:03:18.344699 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.344582    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/447c33de-22cf-4226-9566-2a6878f51d16-prometheus-k8s-rulefiles-1\") pod \"447c33de-22cf-4226-9566-2a6878f51d16\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") "
Sep 08 04:03:18.344699 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.344616    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"447c33de-22cf-4226-9566-2a6878f51d16\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") "
Sep 08 04:03:18.344699 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.344632    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-secret-metrics-client-certs\") pod \"447c33de-22cf-4226-9566-2a6878f51d16\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") "
Sep 08 04:03:18.344699 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.344655    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-secret-grpc-tls\") pod \"447c33de-22cf-4226-9566-2a6878f51d16\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") "
Sep 08 04:03:18.344699 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.344685    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/447c33de-22cf-4226-9566-2a6878f51d16-config-out\") pod \"447c33de-22cf-4226-9566-2a6878f51d16\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") "
Sep 08 04:03:18.344935 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.344794    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/447c33de-22cf-4226-9566-2a6878f51d16-configmap-kubelet-serving-ca-bundle\") pod \"447c33de-22cf-4226-9566-2a6878f51d16\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") "
Sep 08 04:03:18.344935 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.344837    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-thanos-prometheus-http-client-file\") pod \"447c33de-22cf-4226-9566-2a6878f51d16\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") "
Sep 08 04:03:18.344935 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.344860    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-secret-prometheus-k8s-tls\") pod \"447c33de-22cf-4226-9566-2a6878f51d16\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") "
Sep 08 04:03:18.344935 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.344896    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/447c33de-22cf-4226-9566-2a6878f51d16-prometheus-k8s-rulefiles-0\") pod \"447c33de-22cf-4226-9566-2a6878f51d16\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") "
Sep 08 04:03:18.344935 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.344923    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/447c33de-22cf-4226-9566-2a6878f51d16-prometheus-trusted-ca-bundle\") pod \"447c33de-22cf-4226-9566-2a6878f51d16\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") "
Sep 08 04:03:18.345170 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.344950    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqn2f\" (UniqueName: \"kubernetes.io/projected/447c33de-22cf-4226-9566-2a6878f51d16-kube-api-access-lqn2f\") pod \"447c33de-22cf-4226-9566-2a6878f51d16\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") "
Sep 08 04:03:18.345170 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.344949    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/447c33de-22cf-4226-9566-2a6878f51d16-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "447c33de-22cf-4226-9566-2a6878f51d16" (UID: "447c33de-22cf-4226-9566-2a6878f51d16"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 04:03:18.345170 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.344976    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/447c33de-22cf-4226-9566-2a6878f51d16-prometheus-k8s-db\") pod \"447c33de-22cf-4226-9566-2a6878f51d16\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") "
Sep 08 04:03:18.345170 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.344976    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/447c33de-22cf-4226-9566-2a6878f51d16-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "447c33de-22cf-4226-9566-2a6878f51d16" (UID: "447c33de-22cf-4226-9566-2a6878f51d16"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 04:03:18.345170 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.345002    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/447c33de-22cf-4226-9566-2a6878f51d16-configmap-serving-certs-ca-bundle\") pod \"447c33de-22cf-4226-9566-2a6878f51d16\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") "
Sep 08 04:03:18.345170 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.345044    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/447c33de-22cf-4226-9566-2a6878f51d16-prometheus-k8s-rulefiles-2\") pod \"447c33de-22cf-4226-9566-2a6878f51d16\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") "
Sep 08 04:03:18.345170 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.345068    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"447c33de-22cf-4226-9566-2a6878f51d16\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") "
Sep 08 04:03:18.345170 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.345100    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-web-config\") pod \"447c33de-22cf-4226-9566-2a6878f51d16\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") "
Sep 08 04:03:18.345539 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.345187    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-secret-kube-rbac-proxy\") pod \"447c33de-22cf-4226-9566-2a6878f51d16\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") "
Sep 08 04:03:18.345539 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.345224    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-config\") pod \"447c33de-22cf-4226-9566-2a6878f51d16\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") "
Sep 08 04:03:18.345539 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.345267    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/447c33de-22cf-4226-9566-2a6878f51d16-tls-assets\") pod \"447c33de-22cf-4226-9566-2a6878f51d16\" (UID: \"447c33de-22cf-4226-9566-2a6878f51d16\") "
Sep 08 04:03:18.345539 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.345289    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/447c33de-22cf-4226-9566-2a6878f51d16-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "447c33de-22cf-4226-9566-2a6878f51d16" (UID: "447c33de-22cf-4226-9566-2a6878f51d16"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 04:03:18.345923 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.345792    2573 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/447c33de-22cf-4226-9566-2a6878f51d16-configmap-metrics-client-ca\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:03:18.345923 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.345813    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/447c33de-22cf-4226-9566-2a6878f51d16-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:03:18.345923 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.345830    2573 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/447c33de-22cf-4226-9566-2a6878f51d16-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:03:18.345923 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.345900    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/447c33de-22cf-4226-9566-2a6878f51d16-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "447c33de-22cf-4226-9566-2a6878f51d16" (UID: "447c33de-22cf-4226-9566-2a6878f51d16"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 04:03:18.346944 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.346914    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/447c33de-22cf-4226-9566-2a6878f51d16-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "447c33de-22cf-4226-9566-2a6878f51d16" (UID: "447c33de-22cf-4226-9566-2a6878f51d16"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 04:03:18.348111 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.347868    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "447c33de-22cf-4226-9566-2a6878f51d16" (UID: "447c33de-22cf-4226-9566-2a6878f51d16"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:03:18.348111 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.347962    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "447c33de-22cf-4226-9566-2a6878f51d16" (UID: "447c33de-22cf-4226-9566-2a6878f51d16"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:03:18.348447 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.348417    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/447c33de-22cf-4226-9566-2a6878f51d16-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "447c33de-22cf-4226-9566-2a6878f51d16" (UID: "447c33de-22cf-4226-9566-2a6878f51d16"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 04:03:18.348447 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.348433    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/447c33de-22cf-4226-9566-2a6878f51d16-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "447c33de-22cf-4226-9566-2a6878f51d16" (UID: "447c33de-22cf-4226-9566-2a6878f51d16"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 04:03:18.348743 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.348715    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/447c33de-22cf-4226-9566-2a6878f51d16-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "447c33de-22cf-4226-9566-2a6878f51d16" (UID: "447c33de-22cf-4226-9566-2a6878f51d16"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:03:18.348829 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.348792    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "447c33de-22cf-4226-9566-2a6878f51d16" (UID: "447c33de-22cf-4226-9566-2a6878f51d16"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:03:18.349177 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.349145    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "447c33de-22cf-4226-9566-2a6878f51d16" (UID: "447c33de-22cf-4226-9566-2a6878f51d16"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:03:18.349177 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.349152    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/447c33de-22cf-4226-9566-2a6878f51d16-config-out" (OuterVolumeSpecName: "config-out") pod "447c33de-22cf-4226-9566-2a6878f51d16" (UID: "447c33de-22cf-4226-9566-2a6878f51d16"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:03:18.349599 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.349467    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "447c33de-22cf-4226-9566-2a6878f51d16" (UID: "447c33de-22cf-4226-9566-2a6878f51d16"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:03:18.349599 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.349487    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "447c33de-22cf-4226-9566-2a6878f51d16" (UID: "447c33de-22cf-4226-9566-2a6878f51d16"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:03:18.349907 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.349747    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/447c33de-22cf-4226-9566-2a6878f51d16-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "447c33de-22cf-4226-9566-2a6878f51d16" (UID: "447c33de-22cf-4226-9566-2a6878f51d16"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:03:18.349967 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.349931    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/447c33de-22cf-4226-9566-2a6878f51d16-kube-api-access-lqn2f" (OuterVolumeSpecName: "kube-api-access-lqn2f") pod "447c33de-22cf-4226-9566-2a6878f51d16" (UID: "447c33de-22cf-4226-9566-2a6878f51d16"). InnerVolumeSpecName "kube-api-access-lqn2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:03:18.350788 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.350766    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-config" (OuterVolumeSpecName: "config") pod "447c33de-22cf-4226-9566-2a6878f51d16" (UID: "447c33de-22cf-4226-9566-2a6878f51d16"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:03:18.351177 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.351158    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "447c33de-22cf-4226-9566-2a6878f51d16" (UID: "447c33de-22cf-4226-9566-2a6878f51d16"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:03:18.360395 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.360377    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-web-config" (OuterVolumeSpecName: "web-config") pod "447c33de-22cf-4226-9566-2a6878f51d16" (UID: "447c33de-22cf-4226-9566-2a6878f51d16"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:03:18.446371 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.446336    2573 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-web-config\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:03:18.446371 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.446369    2573 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-secret-kube-rbac-proxy\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:03:18.446371 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.446378    2573 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-config\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:03:18.446525 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.446386    2573 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/447c33de-22cf-4226-9566-2a6878f51d16-tls-assets\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:03:18.446525 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.446396    2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:03:18.446525 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.446404    2573 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-secret-metrics-client-certs\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:03:18.446525 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.446413    2573 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-secret-grpc-tls\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:03:18.446525 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.446421    2573 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/447c33de-22cf-4226-9566-2a6878f51d16-config-out\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:03:18.446525 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.446428    2573 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-thanos-prometheus-http-client-file\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:03:18.446525 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.446437    2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-secret-prometheus-k8s-tls\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:03:18.446525 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.446448    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/447c33de-22cf-4226-9566-2a6878f51d16-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:03:18.446525 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.446457    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/447c33de-22cf-4226-9566-2a6878f51d16-prometheus-trusted-ca-bundle\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:03:18.446525 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.446465    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqn2f\" (UniqueName: \"kubernetes.io/projected/447c33de-22cf-4226-9566-2a6878f51d16-kube-api-access-lqn2f\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:03:18.446525 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.446473    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/447c33de-22cf-4226-9566-2a6878f51d16-prometheus-k8s-db\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:03:18.446525 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.446481    2573 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/447c33de-22cf-4226-9566-2a6878f51d16-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:03:18.446525 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.446489    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/447c33de-22cf-4226-9566-2a6878f51d16-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:03:18.446525 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.446497    2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/447c33de-22cf-4226-9566-2a6878f51d16-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:03:18.491983 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.491956    2573 generic.go:356] "Generic (PLEG): container finished" podID="447c33de-22cf-4226-9566-2a6878f51d16" containerID="34b9e30f7232f3953ecd6a035d123ebee682dd3494fcb15b5f46dcd455638f6c" exitCode=0
Sep 08 04:03:18.491983 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.491976    2573 generic.go:356] "Generic (PLEG): container finished" podID="447c33de-22cf-4226-9566-2a6878f51d16" containerID="174b47be83c7a38b94951f9bdd45182d0888744db02ee1f31e8876a26ea02090" exitCode=0
Sep 08 04:03:18.491983 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.491982    2573 generic.go:356] "Generic (PLEG): container finished" podID="447c33de-22cf-4226-9566-2a6878f51d16" containerID="048729d9e524459037f7dd89d11d0f7d7e84f40c577cdf78bd746bc75346fdbc" exitCode=0
Sep 08 04:03:18.492372 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.491989    2573 generic.go:356] "Generic (PLEG): container finished" podID="447c33de-22cf-4226-9566-2a6878f51d16" containerID="fcf62280cac569ac31f33a78f9778a1cb70b82041644f5e836b2bdcd05613752" exitCode=0
Sep 08 04:03:18.492372 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.491994    2573 generic.go:356] "Generic (PLEG): container finished" podID="447c33de-22cf-4226-9566-2a6878f51d16" containerID="60a41658dfedf6f89d6bb08935f637b03fef584c609a183729c5ec2bf4cc2697" exitCode=0
Sep 08 04:03:18.492372 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.491999    2573 generic.go:356] "Generic (PLEG): container finished" podID="447c33de-22cf-4226-9566-2a6878f51d16" containerID="8b4ad7c959675f7a649b2fb8993050dd840366b7690f48b59951a48e3a348d04" exitCode=0
Sep 08 04:03:18.492372 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.492032    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.492372 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.492032    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"447c33de-22cf-4226-9566-2a6878f51d16","Type":"ContainerDied","Data":"34b9e30f7232f3953ecd6a035d123ebee682dd3494fcb15b5f46dcd455638f6c"}
Sep 08 04:03:18.492372 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.492102    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"447c33de-22cf-4226-9566-2a6878f51d16","Type":"ContainerDied","Data":"174b47be83c7a38b94951f9bdd45182d0888744db02ee1f31e8876a26ea02090"}
Sep 08 04:03:18.492372 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.492131    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"447c33de-22cf-4226-9566-2a6878f51d16","Type":"ContainerDied","Data":"048729d9e524459037f7dd89d11d0f7d7e84f40c577cdf78bd746bc75346fdbc"}
Sep 08 04:03:18.492372 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.492165    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"447c33de-22cf-4226-9566-2a6878f51d16","Type":"ContainerDied","Data":"fcf62280cac569ac31f33a78f9778a1cb70b82041644f5e836b2bdcd05613752"}
Sep 08 04:03:18.492372 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.492168    2573 scope.go:117] "RemoveContainer" containerID="34b9e30f7232f3953ecd6a035d123ebee682dd3494fcb15b5f46dcd455638f6c"
Sep 08 04:03:18.492372 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.492196    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"447c33de-22cf-4226-9566-2a6878f51d16","Type":"ContainerDied","Data":"60a41658dfedf6f89d6bb08935f637b03fef584c609a183729c5ec2bf4cc2697"}
Sep 08 04:03:18.492372 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.492291    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"447c33de-22cf-4226-9566-2a6878f51d16","Type":"ContainerDied","Data":"8b4ad7c959675f7a649b2fb8993050dd840366b7690f48b59951a48e3a348d04"}
Sep 08 04:03:18.492372 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.492338    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"447c33de-22cf-4226-9566-2a6878f51d16","Type":"ContainerDied","Data":"5b3390f47488d275fb4e0e024599377ccece6f649bc8127357c95acc468598cb"}
Sep 08 04:03:18.493389 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.493368    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f797b7d7b-b7h6c" event={"ID":"2d102228-2752-42c6-b8c5-73f802d06e4a","Type":"ContainerStarted","Data":"283275fe38d3d6ff755096567c63103e6fce4fe166404f1dbe57c04b7f32097b"}
Sep 08 04:03:18.500284 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.500266    2573 scope.go:117] "RemoveContainer" containerID="174b47be83c7a38b94951f9bdd45182d0888744db02ee1f31e8876a26ea02090"
Sep 08 04:03:18.507724 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.507708    2573 scope.go:117] "RemoveContainer" containerID="048729d9e524459037f7dd89d11d0f7d7e84f40c577cdf78bd746bc75346fdbc"
Sep 08 04:03:18.514435 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.514420    2573 scope.go:117] "RemoveContainer" containerID="fcf62280cac569ac31f33a78f9778a1cb70b82041644f5e836b2bdcd05613752"
Sep 08 04:03:18.519172 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.519152    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 04:03:18.521694 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.521674    2573 scope.go:117] "RemoveContainer" containerID="60a41658dfedf6f89d6bb08935f637b03fef584c609a183729c5ec2bf4cc2697"
Sep 08 04:03:18.524148 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.524130    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 04:03:18.529005 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.528991    2573 scope.go:117] "RemoveContainer" containerID="8b4ad7c959675f7a649b2fb8993050dd840366b7690f48b59951a48e3a348d04"
Sep 08 04:03:18.536075 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.536055    2573 scope.go:117] "RemoveContainer" containerID="381d90d2931edada829559c971d450287573bcae5984fe92e30a805c2b2b2ee3"
Sep 08 04:03:18.542459 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.542440    2573 scope.go:117] "RemoveContainer" containerID="34b9e30f7232f3953ecd6a035d123ebee682dd3494fcb15b5f46dcd455638f6c"
Sep 08 04:03:18.542774 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:03:18.542749    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34b9e30f7232f3953ecd6a035d123ebee682dd3494fcb15b5f46dcd455638f6c\": container with ID starting with 34b9e30f7232f3953ecd6a035d123ebee682dd3494fcb15b5f46dcd455638f6c not found: ID does not exist" containerID="34b9e30f7232f3953ecd6a035d123ebee682dd3494fcb15b5f46dcd455638f6c"
Sep 08 04:03:18.542828 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.542776    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34b9e30f7232f3953ecd6a035d123ebee682dd3494fcb15b5f46dcd455638f6c"} err="failed to get container status \"34b9e30f7232f3953ecd6a035d123ebee682dd3494fcb15b5f46dcd455638f6c\": rpc error: code = NotFound desc = could not find container \"34b9e30f7232f3953ecd6a035d123ebee682dd3494fcb15b5f46dcd455638f6c\": container with ID starting with 34b9e30f7232f3953ecd6a035d123ebee682dd3494fcb15b5f46dcd455638f6c not found: ID does not exist"
Sep 08 04:03:18.542828 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.542793    2573 scope.go:117] "RemoveContainer" containerID="174b47be83c7a38b94951f9bdd45182d0888744db02ee1f31e8876a26ea02090"
Sep 08 04:03:18.543049 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:03:18.543033    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"174b47be83c7a38b94951f9bdd45182d0888744db02ee1f31e8876a26ea02090\": container with ID starting with 174b47be83c7a38b94951f9bdd45182d0888744db02ee1f31e8876a26ea02090 not found: ID does not exist" containerID="174b47be83c7a38b94951f9bdd45182d0888744db02ee1f31e8876a26ea02090"
Sep 08 04:03:18.543088 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.543053    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"174b47be83c7a38b94951f9bdd45182d0888744db02ee1f31e8876a26ea02090"} err="failed to get container status \"174b47be83c7a38b94951f9bdd45182d0888744db02ee1f31e8876a26ea02090\": rpc error: code = NotFound desc = could not find container \"174b47be83c7a38b94951f9bdd45182d0888744db02ee1f31e8876a26ea02090\": container with ID starting with 174b47be83c7a38b94951f9bdd45182d0888744db02ee1f31e8876a26ea02090 not found: ID does not exist"
Sep 08 04:03:18.543088 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.543066    2573 scope.go:117] "RemoveContainer" containerID="048729d9e524459037f7dd89d11d0f7d7e84f40c577cdf78bd746bc75346fdbc"
Sep 08 04:03:18.543272 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:03:18.543255    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"048729d9e524459037f7dd89d11d0f7d7e84f40c577cdf78bd746bc75346fdbc\": container with ID starting with 048729d9e524459037f7dd89d11d0f7d7e84f40c577cdf78bd746bc75346fdbc not found: ID does not exist" containerID="048729d9e524459037f7dd89d11d0f7d7e84f40c577cdf78bd746bc75346fdbc"
Sep 08 04:03:18.543313 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.543280    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"048729d9e524459037f7dd89d11d0f7d7e84f40c577cdf78bd746bc75346fdbc"} err="failed to get container status \"048729d9e524459037f7dd89d11d0f7d7e84f40c577cdf78bd746bc75346fdbc\": rpc error: code = NotFound desc = could not find container \"048729d9e524459037f7dd89d11d0f7d7e84f40c577cdf78bd746bc75346fdbc\": container with ID starting with 048729d9e524459037f7dd89d11d0f7d7e84f40c577cdf78bd746bc75346fdbc not found: ID does not exist"
Sep 08 04:03:18.543313 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.543297    2573 scope.go:117] "RemoveContainer" containerID="fcf62280cac569ac31f33a78f9778a1cb70b82041644f5e836b2bdcd05613752"
Sep 08 04:03:18.543510 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:03:18.543495    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcf62280cac569ac31f33a78f9778a1cb70b82041644f5e836b2bdcd05613752\": container with ID starting with fcf62280cac569ac31f33a78f9778a1cb70b82041644f5e836b2bdcd05613752 not found: ID does not exist" containerID="fcf62280cac569ac31f33a78f9778a1cb70b82041644f5e836b2bdcd05613752"
Sep 08 04:03:18.543546 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.543513    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcf62280cac569ac31f33a78f9778a1cb70b82041644f5e836b2bdcd05613752"} err="failed to get container status \"fcf62280cac569ac31f33a78f9778a1cb70b82041644f5e836b2bdcd05613752\": rpc error: code = NotFound desc = could not find container \"fcf62280cac569ac31f33a78f9778a1cb70b82041644f5e836b2bdcd05613752\": container with ID starting with fcf62280cac569ac31f33a78f9778a1cb70b82041644f5e836b2bdcd05613752 not found: ID does not exist"
Sep 08 04:03:18.543546 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.543524    2573 scope.go:117] "RemoveContainer" containerID="60a41658dfedf6f89d6bb08935f637b03fef584c609a183729c5ec2bf4cc2697"
Sep 08 04:03:18.543757 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:03:18.543742    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60a41658dfedf6f89d6bb08935f637b03fef584c609a183729c5ec2bf4cc2697\": container with ID starting with 60a41658dfedf6f89d6bb08935f637b03fef584c609a183729c5ec2bf4cc2697 not found: ID does not exist" containerID="60a41658dfedf6f89d6bb08935f637b03fef584c609a183729c5ec2bf4cc2697"
Sep 08 04:03:18.543812 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.543760    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60a41658dfedf6f89d6bb08935f637b03fef584c609a183729c5ec2bf4cc2697"} err="failed to get container status \"60a41658dfedf6f89d6bb08935f637b03fef584c609a183729c5ec2bf4cc2697\": rpc error: code = NotFound desc = could not find container \"60a41658dfedf6f89d6bb08935f637b03fef584c609a183729c5ec2bf4cc2697\": container with ID starting with 60a41658dfedf6f89d6bb08935f637b03fef584c609a183729c5ec2bf4cc2697 not found: ID does not exist"
Sep 08 04:03:18.543812 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.543771    2573 scope.go:117] "RemoveContainer" containerID="8b4ad7c959675f7a649b2fb8993050dd840366b7690f48b59951a48e3a348d04"
Sep 08 04:03:18.544015 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:03:18.543996    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b4ad7c959675f7a649b2fb8993050dd840366b7690f48b59951a48e3a348d04\": container with ID starting with 8b4ad7c959675f7a649b2fb8993050dd840366b7690f48b59951a48e3a348d04 not found: ID does not exist" containerID="8b4ad7c959675f7a649b2fb8993050dd840366b7690f48b59951a48e3a348d04"
Sep 08 04:03:18.544051 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.544020    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b4ad7c959675f7a649b2fb8993050dd840366b7690f48b59951a48e3a348d04"} err="failed to get container status \"8b4ad7c959675f7a649b2fb8993050dd840366b7690f48b59951a48e3a348d04\": rpc error: code = NotFound desc = could not find container \"8b4ad7c959675f7a649b2fb8993050dd840366b7690f48b59951a48e3a348d04\": container with ID starting with 8b4ad7c959675f7a649b2fb8993050dd840366b7690f48b59951a48e3a348d04 not found: ID does not exist"
Sep 08 04:03:18.544051 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.544034    2573 scope.go:117] "RemoveContainer" containerID="381d90d2931edada829559c971d450287573bcae5984fe92e30a805c2b2b2ee3"
Sep 08 04:03:18.544257 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:03:18.544243    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"381d90d2931edada829559c971d450287573bcae5984fe92e30a805c2b2b2ee3\": container with ID starting with 381d90d2931edada829559c971d450287573bcae5984fe92e30a805c2b2b2ee3 not found: ID does not exist" containerID="381d90d2931edada829559c971d450287573bcae5984fe92e30a805c2b2b2ee3"
Sep 08 04:03:18.544292 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.544261    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"381d90d2931edada829559c971d450287573bcae5984fe92e30a805c2b2b2ee3"} err="failed to get container status \"381d90d2931edada829559c971d450287573bcae5984fe92e30a805c2b2b2ee3\": rpc error: code = NotFound desc = could not find container \"381d90d2931edada829559c971d450287573bcae5984fe92e30a805c2b2b2ee3\": container with ID starting with 381d90d2931edada829559c971d450287573bcae5984fe92e30a805c2b2b2ee3 not found: ID does not exist"
Sep 08 04:03:18.544292 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.544273    2573 scope.go:117] "RemoveContainer" containerID="34b9e30f7232f3953ecd6a035d123ebee682dd3494fcb15b5f46dcd455638f6c"
Sep 08 04:03:18.544510 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.544493    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34b9e30f7232f3953ecd6a035d123ebee682dd3494fcb15b5f46dcd455638f6c"} err="failed to get container status \"34b9e30f7232f3953ecd6a035d123ebee682dd3494fcb15b5f46dcd455638f6c\": rpc error: code = NotFound desc = could not find container \"34b9e30f7232f3953ecd6a035d123ebee682dd3494fcb15b5f46dcd455638f6c\": container with ID starting with 34b9e30f7232f3953ecd6a035d123ebee682dd3494fcb15b5f46dcd455638f6c not found: ID does not exist"
Sep 08 04:03:18.544636 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.544511    2573 scope.go:117] "RemoveContainer" containerID="174b47be83c7a38b94951f9bdd45182d0888744db02ee1f31e8876a26ea02090"
Sep 08 04:03:18.544804 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.544787    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"174b47be83c7a38b94951f9bdd45182d0888744db02ee1f31e8876a26ea02090"} err="failed to get container status \"174b47be83c7a38b94951f9bdd45182d0888744db02ee1f31e8876a26ea02090\": rpc error: code = NotFound desc = could not find container \"174b47be83c7a38b94951f9bdd45182d0888744db02ee1f31e8876a26ea02090\": container with ID starting with 174b47be83c7a38b94951f9bdd45182d0888744db02ee1f31e8876a26ea02090 not found: ID does not exist"
Sep 08 04:03:18.544844 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.544806    2573 scope.go:117] "RemoveContainer" containerID="048729d9e524459037f7dd89d11d0f7d7e84f40c577cdf78bd746bc75346fdbc"
Sep 08 04:03:18.545019 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.545000    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"048729d9e524459037f7dd89d11d0f7d7e84f40c577cdf78bd746bc75346fdbc"} err="failed to get container status \"048729d9e524459037f7dd89d11d0f7d7e84f40c577cdf78bd746bc75346fdbc\": rpc error: code = NotFound desc = could not find container \"048729d9e524459037f7dd89d11d0f7d7e84f40c577cdf78bd746bc75346fdbc\": container with ID starting with 048729d9e524459037f7dd89d11d0f7d7e84f40c577cdf78bd746bc75346fdbc not found: ID does not exist"
Sep 08 04:03:18.545019 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.545019    2573 scope.go:117] "RemoveContainer" containerID="fcf62280cac569ac31f33a78f9778a1cb70b82041644f5e836b2bdcd05613752"
Sep 08 04:03:18.545243 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.545227    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcf62280cac569ac31f33a78f9778a1cb70b82041644f5e836b2bdcd05613752"} err="failed to get container status \"fcf62280cac569ac31f33a78f9778a1cb70b82041644f5e836b2bdcd05613752\": rpc error: code = NotFound desc = could not find container \"fcf62280cac569ac31f33a78f9778a1cb70b82041644f5e836b2bdcd05613752\": container with ID starting with fcf62280cac569ac31f33a78f9778a1cb70b82041644f5e836b2bdcd05613752 not found: ID does not exist"
Sep 08 04:03:18.545286 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.545243    2573 scope.go:117] "RemoveContainer" containerID="60a41658dfedf6f89d6bb08935f637b03fef584c609a183729c5ec2bf4cc2697"
Sep 08 04:03:18.545469 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.545453    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60a41658dfedf6f89d6bb08935f637b03fef584c609a183729c5ec2bf4cc2697"} err="failed to get container status \"60a41658dfedf6f89d6bb08935f637b03fef584c609a183729c5ec2bf4cc2697\": rpc error: code = NotFound desc = could not find container \"60a41658dfedf6f89d6bb08935f637b03fef584c609a183729c5ec2bf4cc2697\": container with ID starting with 60a41658dfedf6f89d6bb08935f637b03fef584c609a183729c5ec2bf4cc2697 not found: ID does not exist"
Sep 08 04:03:18.545515 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.545470    2573 scope.go:117] "RemoveContainer" containerID="8b4ad7c959675f7a649b2fb8993050dd840366b7690f48b59951a48e3a348d04"
Sep 08 04:03:18.545680 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.545664    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b4ad7c959675f7a649b2fb8993050dd840366b7690f48b59951a48e3a348d04"} err="failed to get container status \"8b4ad7c959675f7a649b2fb8993050dd840366b7690f48b59951a48e3a348d04\": rpc error: code = NotFound desc = could not find container \"8b4ad7c959675f7a649b2fb8993050dd840366b7690f48b59951a48e3a348d04\": container with ID starting with 8b4ad7c959675f7a649b2fb8993050dd840366b7690f48b59951a48e3a348d04 not found: ID does not exist"
Sep 08 04:03:18.545720 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.545680    2573 scope.go:117] "RemoveContainer" containerID="381d90d2931edada829559c971d450287573bcae5984fe92e30a805c2b2b2ee3"
Sep 08 04:03:18.545890 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.545875    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"381d90d2931edada829559c971d450287573bcae5984fe92e30a805c2b2b2ee3"} err="failed to get container status \"381d90d2931edada829559c971d450287573bcae5984fe92e30a805c2b2b2ee3\": rpc error: code = NotFound desc = could not find container \"381d90d2931edada829559c971d450287573bcae5984fe92e30a805c2b2b2ee3\": container with ID starting with 381d90d2931edada829559c971d450287573bcae5984fe92e30a805c2b2b2ee3 not found: ID does not exist"
Sep 08 04:03:18.545946 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.545890    2573 scope.go:117] "RemoveContainer" containerID="34b9e30f7232f3953ecd6a035d123ebee682dd3494fcb15b5f46dcd455638f6c"
Sep 08 04:03:18.546071 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.546056    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34b9e30f7232f3953ecd6a035d123ebee682dd3494fcb15b5f46dcd455638f6c"} err="failed to get container status \"34b9e30f7232f3953ecd6a035d123ebee682dd3494fcb15b5f46dcd455638f6c\": rpc error: code = NotFound desc = could not find container \"34b9e30f7232f3953ecd6a035d123ebee682dd3494fcb15b5f46dcd455638f6c\": container with ID starting with 34b9e30f7232f3953ecd6a035d123ebee682dd3494fcb15b5f46dcd455638f6c not found: ID does not exist"
Sep 08 04:03:18.546117 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.546071    2573 scope.go:117] "RemoveContainer" containerID="174b47be83c7a38b94951f9bdd45182d0888744db02ee1f31e8876a26ea02090"
Sep 08 04:03:18.546251 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.546234    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"174b47be83c7a38b94951f9bdd45182d0888744db02ee1f31e8876a26ea02090"} err="failed to get container status \"174b47be83c7a38b94951f9bdd45182d0888744db02ee1f31e8876a26ea02090\": rpc error: code = NotFound desc = could not find container \"174b47be83c7a38b94951f9bdd45182d0888744db02ee1f31e8876a26ea02090\": container with ID starting with 174b47be83c7a38b94951f9bdd45182d0888744db02ee1f31e8876a26ea02090 not found: ID does not exist"
Sep 08 04:03:18.546292 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.546251    2573 scope.go:117] "RemoveContainer" containerID="048729d9e524459037f7dd89d11d0f7d7e84f40c577cdf78bd746bc75346fdbc"
Sep 08 04:03:18.546452 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.546438    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"048729d9e524459037f7dd89d11d0f7d7e84f40c577cdf78bd746bc75346fdbc"} err="failed to get container status \"048729d9e524459037f7dd89d11d0f7d7e84f40c577cdf78bd746bc75346fdbc\": rpc error: code = NotFound desc = could not find container \"048729d9e524459037f7dd89d11d0f7d7e84f40c577cdf78bd746bc75346fdbc\": container with ID starting with 048729d9e524459037f7dd89d11d0f7d7e84f40c577cdf78bd746bc75346fdbc not found: ID does not exist"
Sep 08 04:03:18.546494 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.546451    2573 scope.go:117] "RemoveContainer" containerID="fcf62280cac569ac31f33a78f9778a1cb70b82041644f5e836b2bdcd05613752"
Sep 08 04:03:18.546652 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.546634    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcf62280cac569ac31f33a78f9778a1cb70b82041644f5e836b2bdcd05613752"} err="failed to get container status \"fcf62280cac569ac31f33a78f9778a1cb70b82041644f5e836b2bdcd05613752\": rpc error: code = NotFound desc = could not find container \"fcf62280cac569ac31f33a78f9778a1cb70b82041644f5e836b2bdcd05613752\": container with ID starting with fcf62280cac569ac31f33a78f9778a1cb70b82041644f5e836b2bdcd05613752 not found: ID does not exist"
Sep 08 04:03:18.546652 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.546651    2573 scope.go:117] "RemoveContainer" containerID="60a41658dfedf6f89d6bb08935f637b03fef584c609a183729c5ec2bf4cc2697"
Sep 08 04:03:18.547086 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.546892    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60a41658dfedf6f89d6bb08935f637b03fef584c609a183729c5ec2bf4cc2697"} err="failed to get container status \"60a41658dfedf6f89d6bb08935f637b03fef584c609a183729c5ec2bf4cc2697\": rpc error: code = NotFound desc = could not find container \"60a41658dfedf6f89d6bb08935f637b03fef584c609a183729c5ec2bf4cc2697\": container with ID starting with 60a41658dfedf6f89d6bb08935f637b03fef584c609a183729c5ec2bf4cc2697 not found: ID does not exist"
Sep 08 04:03:18.547086 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.546912    2573 scope.go:117] "RemoveContainer" containerID="8b4ad7c959675f7a649b2fb8993050dd840366b7690f48b59951a48e3a348d04"
Sep 08 04:03:18.547442 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.547422    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b4ad7c959675f7a649b2fb8993050dd840366b7690f48b59951a48e3a348d04"} err="failed to get container status \"8b4ad7c959675f7a649b2fb8993050dd840366b7690f48b59951a48e3a348d04\": rpc error: code = NotFound desc = could not find container \"8b4ad7c959675f7a649b2fb8993050dd840366b7690f48b59951a48e3a348d04\": container with ID starting with 8b4ad7c959675f7a649b2fb8993050dd840366b7690f48b59951a48e3a348d04 not found: ID does not exist"
Sep 08 04:03:18.547442 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.547442    2573 scope.go:117] "RemoveContainer" containerID="381d90d2931edada829559c971d450287573bcae5984fe92e30a805c2b2b2ee3"
Sep 08 04:03:18.547763 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.547736    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"381d90d2931edada829559c971d450287573bcae5984fe92e30a805c2b2b2ee3"} err="failed to get container status \"381d90d2931edada829559c971d450287573bcae5984fe92e30a805c2b2b2ee3\": rpc error: code = NotFound desc = could not find container \"381d90d2931edada829559c971d450287573bcae5984fe92e30a805c2b2b2ee3\": container with ID starting with 381d90d2931edada829559c971d450287573bcae5984fe92e30a805c2b2b2ee3 not found: ID does not exist"
Sep 08 04:03:18.547763 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.547762    2573 scope.go:117] "RemoveContainer" containerID="34b9e30f7232f3953ecd6a035d123ebee682dd3494fcb15b5f46dcd455638f6c"
Sep 08 04:03:18.548063 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.548029    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34b9e30f7232f3953ecd6a035d123ebee682dd3494fcb15b5f46dcd455638f6c"} err="failed to get container status \"34b9e30f7232f3953ecd6a035d123ebee682dd3494fcb15b5f46dcd455638f6c\": rpc error: code = NotFound desc = could not find container \"34b9e30f7232f3953ecd6a035d123ebee682dd3494fcb15b5f46dcd455638f6c\": container with ID starting with 34b9e30f7232f3953ecd6a035d123ebee682dd3494fcb15b5f46dcd455638f6c not found: ID does not exist"
Sep 08 04:03:18.548138 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.548064    2573 scope.go:117] "RemoveContainer" containerID="174b47be83c7a38b94951f9bdd45182d0888744db02ee1f31e8876a26ea02090"
Sep 08 04:03:18.548366 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.548337    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"174b47be83c7a38b94951f9bdd45182d0888744db02ee1f31e8876a26ea02090"} err="failed to get container status \"174b47be83c7a38b94951f9bdd45182d0888744db02ee1f31e8876a26ea02090\": rpc error: code = NotFound desc = could not find container \"174b47be83c7a38b94951f9bdd45182d0888744db02ee1f31e8876a26ea02090\": container with ID starting with 174b47be83c7a38b94951f9bdd45182d0888744db02ee1f31e8876a26ea02090 not found: ID does not exist"
Sep 08 04:03:18.548366 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.548366    2573 scope.go:117] "RemoveContainer" containerID="048729d9e524459037f7dd89d11d0f7d7e84f40c577cdf78bd746bc75346fdbc"
Sep 08 04:03:18.548677 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.548656    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"048729d9e524459037f7dd89d11d0f7d7e84f40c577cdf78bd746bc75346fdbc"} err="failed to get container status \"048729d9e524459037f7dd89d11d0f7d7e84f40c577cdf78bd746bc75346fdbc\": rpc error: code = NotFound desc = could not find container \"048729d9e524459037f7dd89d11d0f7d7e84f40c577cdf78bd746bc75346fdbc\": container with ID starting with 048729d9e524459037f7dd89d11d0f7d7e84f40c577cdf78bd746bc75346fdbc not found: ID does not exist"
Sep 08 04:03:18.548753 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.548679    2573 scope.go:117] "RemoveContainer" containerID="fcf62280cac569ac31f33a78f9778a1cb70b82041644f5e836b2bdcd05613752"
Sep 08 04:03:18.548909 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.548894    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcf62280cac569ac31f33a78f9778a1cb70b82041644f5e836b2bdcd05613752"} err="failed to get container status \"fcf62280cac569ac31f33a78f9778a1cb70b82041644f5e836b2bdcd05613752\": rpc error: code = NotFound desc = could not find container \"fcf62280cac569ac31f33a78f9778a1cb70b82041644f5e836b2bdcd05613752\": container with ID starting with fcf62280cac569ac31f33a78f9778a1cb70b82041644f5e836b2bdcd05613752 not found: ID does not exist"
Sep 08 04:03:18.548965 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.548910    2573 scope.go:117] "RemoveContainer" containerID="60a41658dfedf6f89d6bb08935f637b03fef584c609a183729c5ec2bf4cc2697"
Sep 08 04:03:18.549127 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.549111    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60a41658dfedf6f89d6bb08935f637b03fef584c609a183729c5ec2bf4cc2697"} err="failed to get container status \"60a41658dfedf6f89d6bb08935f637b03fef584c609a183729c5ec2bf4cc2697\": rpc error: code = NotFound desc = could not find container \"60a41658dfedf6f89d6bb08935f637b03fef584c609a183729c5ec2bf4cc2697\": container with ID starting with 60a41658dfedf6f89d6bb08935f637b03fef584c609a183729c5ec2bf4cc2697 not found: ID does not exist"
Sep 08 04:03:18.549127 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.549127    2573 scope.go:117] "RemoveContainer" containerID="8b4ad7c959675f7a649b2fb8993050dd840366b7690f48b59951a48e3a348d04"
Sep 08 04:03:18.549365 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.549346    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b4ad7c959675f7a649b2fb8993050dd840366b7690f48b59951a48e3a348d04"} err="failed to get container status \"8b4ad7c959675f7a649b2fb8993050dd840366b7690f48b59951a48e3a348d04\": rpc error: code = NotFound desc = could not find container \"8b4ad7c959675f7a649b2fb8993050dd840366b7690f48b59951a48e3a348d04\": container with ID starting with 8b4ad7c959675f7a649b2fb8993050dd840366b7690f48b59951a48e3a348d04 not found: ID does not exist"
Sep 08 04:03:18.549431 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.549370    2573 scope.go:117] "RemoveContainer" containerID="381d90d2931edada829559c971d450287573bcae5984fe92e30a805c2b2b2ee3"
Sep 08 04:03:18.549615 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.549598    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"381d90d2931edada829559c971d450287573bcae5984fe92e30a805c2b2b2ee3"} err="failed to get container status \"381d90d2931edada829559c971d450287573bcae5984fe92e30a805c2b2b2ee3\": rpc error: code = NotFound desc = could not find container \"381d90d2931edada829559c971d450287573bcae5984fe92e30a805c2b2b2ee3\": container with ID starting with 381d90d2931edada829559c971d450287573bcae5984fe92e30a805c2b2b2ee3 not found: ID does not exist"
Sep 08 04:03:18.549664 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.549616    2573 scope.go:117] "RemoveContainer" containerID="34b9e30f7232f3953ecd6a035d123ebee682dd3494fcb15b5f46dcd455638f6c"
Sep 08 04:03:18.549848 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.549819    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34b9e30f7232f3953ecd6a035d123ebee682dd3494fcb15b5f46dcd455638f6c"} err="failed to get container status \"34b9e30f7232f3953ecd6a035d123ebee682dd3494fcb15b5f46dcd455638f6c\": rpc error: code = NotFound desc = could not find container \"34b9e30f7232f3953ecd6a035d123ebee682dd3494fcb15b5f46dcd455638f6c\": container with ID starting with 34b9e30f7232f3953ecd6a035d123ebee682dd3494fcb15b5f46dcd455638f6c not found: ID does not exist"
Sep 08 04:03:18.549848 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.549839    2573 scope.go:117] "RemoveContainer" containerID="174b47be83c7a38b94951f9bdd45182d0888744db02ee1f31e8876a26ea02090"
Sep 08 04:03:18.550078 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.550060    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"174b47be83c7a38b94951f9bdd45182d0888744db02ee1f31e8876a26ea02090"} err="failed to get container status \"174b47be83c7a38b94951f9bdd45182d0888744db02ee1f31e8876a26ea02090\": rpc error: code = NotFound desc = could not find container \"174b47be83c7a38b94951f9bdd45182d0888744db02ee1f31e8876a26ea02090\": container with ID starting with 174b47be83c7a38b94951f9bdd45182d0888744db02ee1f31e8876a26ea02090 not found: ID does not exist"
Sep 08 04:03:18.550078 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.550077    2573 scope.go:117] "RemoveContainer" containerID="048729d9e524459037f7dd89d11d0f7d7e84f40c577cdf78bd746bc75346fdbc"
Sep 08 04:03:18.550287 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.550271    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"048729d9e524459037f7dd89d11d0f7d7e84f40c577cdf78bd746bc75346fdbc"} err="failed to get container status \"048729d9e524459037f7dd89d11d0f7d7e84f40c577cdf78bd746bc75346fdbc\": rpc error: code = NotFound desc = could not find container \"048729d9e524459037f7dd89d11d0f7d7e84f40c577cdf78bd746bc75346fdbc\": container with ID starting with 048729d9e524459037f7dd89d11d0f7d7e84f40c577cdf78bd746bc75346fdbc not found: ID does not exist"
Sep 08 04:03:18.550330 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.550286    2573 scope.go:117] "RemoveContainer" containerID="fcf62280cac569ac31f33a78f9778a1cb70b82041644f5e836b2bdcd05613752"
Sep 08 04:03:18.550514 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.550498    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcf62280cac569ac31f33a78f9778a1cb70b82041644f5e836b2bdcd05613752"} err="failed to get container status \"fcf62280cac569ac31f33a78f9778a1cb70b82041644f5e836b2bdcd05613752\": rpc error: code = NotFound desc = could not find container \"fcf62280cac569ac31f33a78f9778a1cb70b82041644f5e836b2bdcd05613752\": container with ID starting with fcf62280cac569ac31f33a78f9778a1cb70b82041644f5e836b2bdcd05613752 not found: ID does not exist"
Sep 08 04:03:18.550570 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.550515    2573 scope.go:117] "RemoveContainer" containerID="60a41658dfedf6f89d6bb08935f637b03fef584c609a183729c5ec2bf4cc2697"
Sep 08 04:03:18.550755 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.550739    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60a41658dfedf6f89d6bb08935f637b03fef584c609a183729c5ec2bf4cc2697"} err="failed to get container status \"60a41658dfedf6f89d6bb08935f637b03fef584c609a183729c5ec2bf4cc2697\": rpc error: code = NotFound desc = could not find container \"60a41658dfedf6f89d6bb08935f637b03fef584c609a183729c5ec2bf4cc2697\": container with ID starting with 60a41658dfedf6f89d6bb08935f637b03fef584c609a183729c5ec2bf4cc2697 not found: ID does not exist"
Sep 08 04:03:18.550791 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.550756    2573 scope.go:117] "RemoveContainer" containerID="8b4ad7c959675f7a649b2fb8993050dd840366b7690f48b59951a48e3a348d04"
Sep 08 04:03:18.550949 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.550934    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b4ad7c959675f7a649b2fb8993050dd840366b7690f48b59951a48e3a348d04"} err="failed to get container status \"8b4ad7c959675f7a649b2fb8993050dd840366b7690f48b59951a48e3a348d04\": rpc error: code = NotFound desc = could not find container \"8b4ad7c959675f7a649b2fb8993050dd840366b7690f48b59951a48e3a348d04\": container with ID starting with 8b4ad7c959675f7a649b2fb8993050dd840366b7690f48b59951a48e3a348d04 not found: ID does not exist"
Sep 08 04:03:18.550993 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.550949    2573 scope.go:117] "RemoveContainer" containerID="381d90d2931edada829559c971d450287573bcae5984fe92e30a805c2b2b2ee3"
Sep 08 04:03:18.551181 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.551155    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"381d90d2931edada829559c971d450287573bcae5984fe92e30a805c2b2b2ee3"} err="failed to get container status \"381d90d2931edada829559c971d450287573bcae5984fe92e30a805c2b2b2ee3\": rpc error: code = NotFound desc = could not find container \"381d90d2931edada829559c971d450287573bcae5984fe92e30a805c2b2b2ee3\": container with ID starting with 381d90d2931edada829559c971d450287573bcae5984fe92e30a805c2b2b2ee3 not found: ID does not exist"
Sep 08 04:03:18.551244 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.551183    2573 scope.go:117] "RemoveContainer" containerID="34b9e30f7232f3953ecd6a035d123ebee682dd3494fcb15b5f46dcd455638f6c"
Sep 08 04:03:18.551414 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.551398    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34b9e30f7232f3953ecd6a035d123ebee682dd3494fcb15b5f46dcd455638f6c"} err="failed to get container status \"34b9e30f7232f3953ecd6a035d123ebee682dd3494fcb15b5f46dcd455638f6c\": rpc error: code = NotFound desc = could not find container \"34b9e30f7232f3953ecd6a035d123ebee682dd3494fcb15b5f46dcd455638f6c\": container with ID starting with 34b9e30f7232f3953ecd6a035d123ebee682dd3494fcb15b5f46dcd455638f6c not found: ID does not exist"
Sep 08 04:03:18.551458 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.551414    2573 scope.go:117] "RemoveContainer" containerID="174b47be83c7a38b94951f9bdd45182d0888744db02ee1f31e8876a26ea02090"
Sep 08 04:03:18.551629 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.551612    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"174b47be83c7a38b94951f9bdd45182d0888744db02ee1f31e8876a26ea02090"} err="failed to get container status \"174b47be83c7a38b94951f9bdd45182d0888744db02ee1f31e8876a26ea02090\": rpc error: code = NotFound desc = could not find container \"174b47be83c7a38b94951f9bdd45182d0888744db02ee1f31e8876a26ea02090\": container with ID starting with 174b47be83c7a38b94951f9bdd45182d0888744db02ee1f31e8876a26ea02090 not found: ID does not exist"
Sep 08 04:03:18.551721 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.551631    2573 scope.go:117] "RemoveContainer" containerID="048729d9e524459037f7dd89d11d0f7d7e84f40c577cdf78bd746bc75346fdbc"
Sep 08 04:03:18.551860 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.551843    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"048729d9e524459037f7dd89d11d0f7d7e84f40c577cdf78bd746bc75346fdbc"} err="failed to get container status \"048729d9e524459037f7dd89d11d0f7d7e84f40c577cdf78bd746bc75346fdbc\": rpc error: code = NotFound desc = could not find container \"048729d9e524459037f7dd89d11d0f7d7e84f40c577cdf78bd746bc75346fdbc\": container with ID starting with 048729d9e524459037f7dd89d11d0f7d7e84f40c577cdf78bd746bc75346fdbc not found: ID does not exist"
Sep 08 04:03:18.551905 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.551861    2573 scope.go:117] "RemoveContainer" containerID="fcf62280cac569ac31f33a78f9778a1cb70b82041644f5e836b2bdcd05613752"
Sep 08 04:03:18.552060 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.552045    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcf62280cac569ac31f33a78f9778a1cb70b82041644f5e836b2bdcd05613752"} err="failed to get container status \"fcf62280cac569ac31f33a78f9778a1cb70b82041644f5e836b2bdcd05613752\": rpc error: code = NotFound desc = could not find container \"fcf62280cac569ac31f33a78f9778a1cb70b82041644f5e836b2bdcd05613752\": container with ID starting with fcf62280cac569ac31f33a78f9778a1cb70b82041644f5e836b2bdcd05613752 not found: ID does not exist"
Sep 08 04:03:18.552098 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.552060    2573 scope.go:117] "RemoveContainer" containerID="60a41658dfedf6f89d6bb08935f637b03fef584c609a183729c5ec2bf4cc2697"
Sep 08 04:03:18.552270 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.552253    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60a41658dfedf6f89d6bb08935f637b03fef584c609a183729c5ec2bf4cc2697"} err="failed to get container status \"60a41658dfedf6f89d6bb08935f637b03fef584c609a183729c5ec2bf4cc2697\": rpc error: code = NotFound desc = could not find container \"60a41658dfedf6f89d6bb08935f637b03fef584c609a183729c5ec2bf4cc2697\": container with ID starting with 60a41658dfedf6f89d6bb08935f637b03fef584c609a183729c5ec2bf4cc2697 not found: ID does not exist"
Sep 08 04:03:18.552328 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.552272    2573 scope.go:117] "RemoveContainer" containerID="8b4ad7c959675f7a649b2fb8993050dd840366b7690f48b59951a48e3a348d04"
Sep 08 04:03:18.552485 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.552470    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b4ad7c959675f7a649b2fb8993050dd840366b7690f48b59951a48e3a348d04"} err="failed to get container status \"8b4ad7c959675f7a649b2fb8993050dd840366b7690f48b59951a48e3a348d04\": rpc error: code = NotFound desc = could not find container \"8b4ad7c959675f7a649b2fb8993050dd840366b7690f48b59951a48e3a348d04\": container with ID starting with 8b4ad7c959675f7a649b2fb8993050dd840366b7690f48b59951a48e3a348d04 not found: ID does not exist"
Sep 08 04:03:18.552529 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.552486    2573 scope.go:117] "RemoveContainer" containerID="381d90d2931edada829559c971d450287573bcae5984fe92e30a805c2b2b2ee3"
Sep 08 04:03:18.552746 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.552730    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"381d90d2931edada829559c971d450287573bcae5984fe92e30a805c2b2b2ee3"} err="failed to get container status \"381d90d2931edada829559c971d450287573bcae5984fe92e30a805c2b2b2ee3\": rpc error: code = NotFound desc = could not find container \"381d90d2931edada829559c971d450287573bcae5984fe92e30a805c2b2b2ee3\": container with ID starting with 381d90d2931edada829559c971d450287573bcae5984fe92e30a805c2b2b2ee3 not found: ID does not exist"
Sep 08 04:03:18.559233 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.559188    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 04:03:18.559482 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.559471    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="447c33de-22cf-4226-9566-2a6878f51d16" containerName="config-reloader"
Sep 08 04:03:18.559522 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.559484    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="447c33de-22cf-4226-9566-2a6878f51d16" containerName="config-reloader"
Sep 08 04:03:18.559522 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.559491    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="447c33de-22cf-4226-9566-2a6878f51d16" containerName="thanos-sidecar"
Sep 08 04:03:18.559522 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.559496    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="447c33de-22cf-4226-9566-2a6878f51d16" containerName="thanos-sidecar"
Sep 08 04:03:18.559522 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.559507    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="447c33de-22cf-4226-9566-2a6878f51d16" containerName="kube-rbac-proxy"
Sep 08 04:03:18.559522 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.559512    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="447c33de-22cf-4226-9566-2a6878f51d16" containerName="kube-rbac-proxy"
Sep 08 04:03:18.559522 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.559520    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="447c33de-22cf-4226-9566-2a6878f51d16" containerName="prometheus"
Sep 08 04:03:18.559726 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.559525    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="447c33de-22cf-4226-9566-2a6878f51d16" containerName="prometheus"
Sep 08 04:03:18.559726 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.559533    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="447c33de-22cf-4226-9566-2a6878f51d16" containerName="init-config-reloader"
Sep 08 04:03:18.559726 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.559538    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="447c33de-22cf-4226-9566-2a6878f51d16" containerName="init-config-reloader"
Sep 08 04:03:18.559726 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.559549    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="447c33de-22cf-4226-9566-2a6878f51d16" containerName="kube-rbac-proxy-thanos"
Sep 08 04:03:18.559726 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.559572    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="447c33de-22cf-4226-9566-2a6878f51d16" containerName="kube-rbac-proxy-thanos"
Sep 08 04:03:18.559726 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.559583    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="447c33de-22cf-4226-9566-2a6878f51d16" containerName="kube-rbac-proxy-web"
Sep 08 04:03:18.559726 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.559588    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="447c33de-22cf-4226-9566-2a6878f51d16" containerName="kube-rbac-proxy-web"
Sep 08 04:03:18.559726 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.559633    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="447c33de-22cf-4226-9566-2a6878f51d16" containerName="kube-rbac-proxy-web"
Sep 08 04:03:18.559726 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.559643    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="447c33de-22cf-4226-9566-2a6878f51d16" containerName="kube-rbac-proxy"
Sep 08 04:03:18.559726 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.559649    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="447c33de-22cf-4226-9566-2a6878f51d16" containerName="thanos-sidecar"
Sep 08 04:03:18.559726 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.559654    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="447c33de-22cf-4226-9566-2a6878f51d16" containerName="prometheus"
Sep 08 04:03:18.559726 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.559659    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="447c33de-22cf-4226-9566-2a6878f51d16" containerName="config-reloader"
Sep 08 04:03:18.559726 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.559664    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="447c33de-22cf-4226-9566-2a6878f51d16" containerName="kube-rbac-proxy-thanos"
Sep 08 04:03:18.563199 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.563181    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.565766 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.565750    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 08 04:03:18.565766 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.565753    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 08 04:03:18.565915 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.565845    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 08 04:03:18.566013 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.565994    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 08 04:03:18.566013 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.566008    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 08 04:03:18.566207 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.566189    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4dl42po057989\""
Sep 08 04:03:18.566434 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.566403    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 08 04:03:18.566434 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.566423    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 08 04:03:18.566588 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.566466    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 08 04:03:18.566588 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.566487    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 08 04:03:18.566588 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.566408    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 08 04:03:18.569125 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.569028    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 08 04:03:18.569125 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.569058    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-b8wb5\""
Sep 08 04:03:18.569385 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.569308    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 08 04:03:18.574082 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.574058    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 08 04:03:18.575026 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.575005    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 08 04:03:18.581850 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.581831    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 04:03:18.648423 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.648393    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.648530 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.648433    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.648530 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.648452    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.648651 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.648523    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.648651 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.648597    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-config\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.648651 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.648620    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.648651 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.648638    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-web-config\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.648789 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.648675    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.648789 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.648702    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.648789 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.648716    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.648789 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.648733    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.648789 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.648755    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t6qb\" (UniqueName: \"kubernetes.io/projected/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-kube-api-access-2t6qb\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.648968 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.648812    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.648968 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.648842    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-config-out\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.648968 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.648864    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.648968 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.648882    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.648968 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.648928    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.648968 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.648950    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.648968 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.648964    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.649173 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.648989    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.673779 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.673753    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="447c33de-22cf-4226-9566-2a6878f51d16" path="/var/lib/kubelet/pods/447c33de-22cf-4226-9566-2a6878f51d16/volumes"
Sep 08 04:03:18.750129 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.750102    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.750242 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.750132    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.750242 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.750155    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.750321 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.750281    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-config\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.750321 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.750312    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.750411 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.750332    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-web-config\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.750495 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.750471    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.750710 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.750680    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.750807 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.750719    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.750807 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.750745    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.750807 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.750766    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t6qb\" (UniqueName: \"kubernetes.io/projected/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-kube-api-access-2t6qb\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.750807 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.750799    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.751174 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.750827    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-config-out\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.751174 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.750853    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.751174 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.750881    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.751174 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.750918    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.751174 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.750955    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.751174 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.750980    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.751174 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.751005    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.751174 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.751037    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.751861 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.751836    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.753373 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.753345    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.753476 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.753454    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.753535 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.753495    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.753711 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.753683    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.753824 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.753798    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.753917 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.753901    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-web-config\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.754160 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.754077    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-config\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.754160 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.754125    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.754731 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.754546    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.754731 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.754597    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.754731 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.754640    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.754731 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.754682    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.755027 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.754823    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.755027 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.754966    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.756468 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.756447    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.756726 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.756708    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.756923 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.756901    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.756958 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.756912    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-config-out\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.767992 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.767973    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t6qb\" (UniqueName: \"kubernetes.io/projected/a13eb3d2-522e-4c8d-af6d-fc137330cf5d-kube-api-access-2t6qb\") pod \"prometheus-k8s-0\" (UID: \"a13eb3d2-522e-4c8d-af6d-fc137330cf5d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:18.874814 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:18.874786    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:03:19.167018 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:19.166922    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 04:03:19.174392 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:03:19.174362    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda13eb3d2_522e_4c8d_af6d_fc137330cf5d.slice/crio-abe7f78f27fab0396e87a1aecd62721f7126da2bee2169aa5ab52311e92cfc35 WatchSource:0}: Error finding container abe7f78f27fab0396e87a1aecd62721f7126da2bee2169aa5ab52311e92cfc35: Status 404 returned error can't find the container with id abe7f78f27fab0396e87a1aecd62721f7126da2bee2169aa5ab52311e92cfc35
Sep 08 04:03:19.499714 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:19.499685    2573 generic.go:356] "Generic (PLEG): container finished" podID="a13eb3d2-522e-4c8d-af6d-fc137330cf5d" containerID="5b42afc1cfc4273471d4b71b242d0ecd8cab809913c16f1154f4b52b21858e14" exitCode=0
Sep 08 04:03:19.500140 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:19.499764    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a13eb3d2-522e-4c8d-af6d-fc137330cf5d","Type":"ContainerDied","Data":"5b42afc1cfc4273471d4b71b242d0ecd8cab809913c16f1154f4b52b21858e14"}
Sep 08 04:03:19.500140 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:19.499866    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a13eb3d2-522e-4c8d-af6d-fc137330cf5d","Type":"ContainerStarted","Data":"abe7f78f27fab0396e87a1aecd62721f7126da2bee2169aa5ab52311e92cfc35"}
Sep 08 04:03:20.508792 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:20.508752    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a13eb3d2-522e-4c8d-af6d-fc137330cf5d","Type":"ContainerStarted","Data":"f34678de8c55c451d29af9fe0bb4ca8894df320c67aae70ba8f07f0465ba39ad"}
Sep 08 04:03:20.509206 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:20.508869    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a13eb3d2-522e-4c8d-af6d-fc137330cf5d","Type":"ContainerStarted","Data":"119ebe2fcc760d4091a334adc07c053b6b8818d26eefb97c4671d687f1e2581b"}
Sep 08 04:03:20.509206 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:20.508914    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a13eb3d2-522e-4c8d-af6d-fc137330cf5d","Type":"ContainerStarted","Data":"5d2d362126e693958932961541cae3f7894da6ac695f83c628b0e525061e9bf9"}
Sep 08 04:03:20.509206 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:20.508959    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a13eb3d2-522e-4c8d-af6d-fc137330cf5d","Type":"ContainerStarted","Data":"b6aa5b8621a136a0f8075725865c96c9374c8a705f35819fa10e576f4a5881ca"}
Sep 08 04:03:20.509206 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:20.508997    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a13eb3d2-522e-4c8d-af6d-fc137330cf5d","Type":"ContainerStarted","Data":"0efab6dc0277be4b1c2920e21f5afdbcf9b54240ccf06e5ea8bce606bbd72a1c"}
Sep 08 04:03:20.509206 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:20.509034    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a13eb3d2-522e-4c8d-af6d-fc137330cf5d","Type":"ContainerStarted","Data":"9ae4e006ad400fd33a8318a96beb4b07dd901627d7d1841ac96187e5e05ed9f2"}
Sep 08 04:03:20.511032 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:20.511007    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f797b7d7b-b7h6c" event={"ID":"2d102228-2752-42c6-b8c5-73f802d06e4a","Type":"ContainerStarted","Data":"11f85e6ba8766b3e3081e4995618e5db5bff5d07a23a22125b225ebb1ce1a4d0"}
Sep 08 04:03:20.511140 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:20.511052    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f797b7d7b-b7h6c" event={"ID":"2d102228-2752-42c6-b8c5-73f802d06e4a","Type":"ContainerStarted","Data":"d9e77269d7b6759e0d8dd3b5564c3147f7f0d944da15764baa18f48fd4b3843f"}
Sep 08 04:03:20.511140 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:20.511072    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f797b7d7b-b7h6c" event={"ID":"2d102228-2752-42c6-b8c5-73f802d06e4a","Type":"ContainerStarted","Data":"d7edc26c7bc4b90a869698c7532a9003000095ac5b92e99dfb72adb4d8cb2328"}
Sep 08 04:03:20.545840 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:20.545786    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.522824267 podStartE2EDuration="2.545766915s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.942648ms" isStatefulPod=false podCreationTimestamp="2026-09-08 04:03:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:03:20.543376775 +0000 UTC m=+160.328668012" watchObservedRunningTime="2026-09-08 04:03:20.545766915 +0000 UTC m=+160.331058152"
Sep 08 04:03:20.570725 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:20.570684    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7f797b7d7b-b7h6c" podStartSLOduration=1.946591362 podStartE2EDuration="3.57066897s" totalImagesPullingTime="1.624077608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:03:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:03:20.567865018 +0000 UTC m=+160.353156277" watchObservedRunningTime="2026-09-08 04:03:20.57066897 +0000 UTC m=+160.355960206"
Sep 08 04:03:23.875180 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:03:23.875150    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:04:18.875595 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:04:18.875541    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:04:18.890093 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:04:18.890066    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:04:19.755469 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:04:19.755444    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 04:05:40.560881 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:05:40.560853    2573 kubelet.go:1648] "Image garbage collection succeeded"
Sep 08 04:06:03.809697 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:03.809664    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-dcq8m"]
Sep 08 04:06:03.812705 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:03.812690    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-dcq8m"
Sep 08 04:06:03.814967 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:03.814932    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 08 04:06:03.815093 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:03.814978    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 08 04:06:03.815739 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:03.815725    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-v5rgg\""
Sep 08 04:06:03.821855 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:03.821835    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-dcq8m"]
Sep 08 04:06:03.860667 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:03.860636    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sm4x\" (UniqueName: \"kubernetes.io/projected/2390e542-0492-478f-b361-c381906cbfcd-kube-api-access-2sm4x\") pod \"cert-manager-webhook-6486ffd997-dcq8m\" (UID: \"2390e542-0492-478f-b361-c381906cbfcd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dcq8m"
Sep 08 04:06:03.860782 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:03.860698    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2390e542-0492-478f-b361-c381906cbfcd-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-dcq8m\" (UID: \"2390e542-0492-478f-b361-c381906cbfcd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dcq8m"
Sep 08 04:06:03.962040 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:03.962012    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2390e542-0492-478f-b361-c381906cbfcd-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-dcq8m\" (UID: \"2390e542-0492-478f-b361-c381906cbfcd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dcq8m"
Sep 08 04:06:03.962160 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:03.962080    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sm4x\" (UniqueName: \"kubernetes.io/projected/2390e542-0492-478f-b361-c381906cbfcd-kube-api-access-2sm4x\") pod \"cert-manager-webhook-6486ffd997-dcq8m\" (UID: \"2390e542-0492-478f-b361-c381906cbfcd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dcq8m"
Sep 08 04:06:03.970437 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:03.970411    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sm4x\" (UniqueName: \"kubernetes.io/projected/2390e542-0492-478f-b361-c381906cbfcd-kube-api-access-2sm4x\") pod \"cert-manager-webhook-6486ffd997-dcq8m\" (UID: \"2390e542-0492-478f-b361-c381906cbfcd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dcq8m"
Sep 08 04:06:03.970873 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:03.970857    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2390e542-0492-478f-b361-c381906cbfcd-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-dcq8m\" (UID: \"2390e542-0492-478f-b361-c381906cbfcd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dcq8m"
Sep 08 04:06:04.135078 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:04.134968    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-dcq8m"
Sep 08 04:06:04.407687 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:04.407664    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-dcq8m"]
Sep 08 04:06:04.410308 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:06:04.410274    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2390e542_0492_478f_b361_c381906cbfcd.slice/crio-8af2322cc1e4238f28d823daee782ae317f29d3dc69266299929dfc07ba83d0e WatchSource:0}: Error finding container 8af2322cc1e4238f28d823daee782ae317f29d3dc69266299929dfc07ba83d0e: Status 404 returned error can't find the container with id 8af2322cc1e4238f28d823daee782ae317f29d3dc69266299929dfc07ba83d0e
Sep 08 04:06:04.412191 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:04.412174    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 04:06:05.159768 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:05.159727    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-dcq8m" event={"ID":"2390e542-0492-478f-b361-c381906cbfcd","Type":"ContainerStarted","Data":"8af2322cc1e4238f28d823daee782ae317f29d3dc69266299929dfc07ba83d0e"}
Sep 08 04:06:06.195882 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:06.195732    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5zv2l"]
Sep 08 04:06:06.205154 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:06.205125    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5zv2l"
Sep 08 04:06:06.205703 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:06.205676    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5zv2l"]
Sep 08 04:06:06.209179 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:06.208054    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-zglv9\""
Sep 08 04:06:06.289664 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:06.289612    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cc3c7caa-f37b-4cba-9d2d-004a55a76525-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5zv2l\" (UID: \"cc3c7caa-f37b-4cba-9d2d-004a55a76525\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5zv2l"
Sep 08 04:06:06.289857 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:06.289746    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzckl\" (UniqueName: \"kubernetes.io/projected/cc3c7caa-f37b-4cba-9d2d-004a55a76525-kube-api-access-qzckl\") pod \"cert-manager-cainjector-559cdd8c87-5zv2l\" (UID: \"cc3c7caa-f37b-4cba-9d2d-004a55a76525\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5zv2l"
Sep 08 04:06:06.390340 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:06.390304    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cc3c7caa-f37b-4cba-9d2d-004a55a76525-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5zv2l\" (UID: \"cc3c7caa-f37b-4cba-9d2d-004a55a76525\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5zv2l"
Sep 08 04:06:06.390512 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:06.390371    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzckl\" (UniqueName: \"kubernetes.io/projected/cc3c7caa-f37b-4cba-9d2d-004a55a76525-kube-api-access-qzckl\") pod \"cert-manager-cainjector-559cdd8c87-5zv2l\" (UID: \"cc3c7caa-f37b-4cba-9d2d-004a55a76525\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5zv2l"
Sep 08 04:06:06.399284 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:06.399255    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cc3c7caa-f37b-4cba-9d2d-004a55a76525-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5zv2l\" (UID: \"cc3c7caa-f37b-4cba-9d2d-004a55a76525\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5zv2l"
Sep 08 04:06:06.399493 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:06.399472    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzckl\" (UniqueName: \"kubernetes.io/projected/cc3c7caa-f37b-4cba-9d2d-004a55a76525-kube-api-access-qzckl\") pod \"cert-manager-cainjector-559cdd8c87-5zv2l\" (UID: \"cc3c7caa-f37b-4cba-9d2d-004a55a76525\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5zv2l"
Sep 08 04:06:06.523664 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:06.523624    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5zv2l"
Sep 08 04:06:07.735313 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:07.735233    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5zv2l"]
Sep 08 04:06:07.739228 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:06:07.739201    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc3c7caa_f37b_4cba_9d2d_004a55a76525.slice/crio-77e8f1688aa533ad07e43126d8b8dfa30932aaea9059d5db48a0ccdebd8ef03d WatchSource:0}: Error finding container 77e8f1688aa533ad07e43126d8b8dfa30932aaea9059d5db48a0ccdebd8ef03d: Status 404 returned error can't find the container with id 77e8f1688aa533ad07e43126d8b8dfa30932aaea9059d5db48a0ccdebd8ef03d
Sep 08 04:06:08.175992 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:08.175948    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-dcq8m" event={"ID":"2390e542-0492-478f-b361-c381906cbfcd","Type":"ContainerStarted","Data":"eafe0f53f91139934e39b83fe158da33c9b177c51e64dc3615609dd3243c44d8"}
Sep 08 04:06:08.176179 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:08.176029    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-dcq8m"
Sep 08 04:06:08.177488 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:08.177464    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5zv2l" event={"ID":"cc3c7caa-f37b-4cba-9d2d-004a55a76525","Type":"ContainerStarted","Data":"dd74aab03e73b2927c264ba880659d29533525df1134b649ffd78c20bc558c2c"}
Sep 08 04:06:08.177621 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:08.177494    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5zv2l" event={"ID":"cc3c7caa-f37b-4cba-9d2d-004a55a76525","Type":"ContainerStarted","Data":"77e8f1688aa533ad07e43126d8b8dfa30932aaea9059d5db48a0ccdebd8ef03d"}
Sep 08 04:06:08.192346 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:08.192296    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-dcq8m" podStartSLOduration=2.074971726 podStartE2EDuration="5.192282171s" totalImagesPullingTime="3.117310445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:06:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:06:08.191280535 +0000 UTC m=+327.976571770" watchObservedRunningTime="2026-09-08 04:06:08.192282171 +0000 UTC m=+327.977573408"
Sep 08 04:06:08.205519 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:08.205470    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5zv2l" podStartSLOduration=2.205457739 podStartE2EDuration="2.205457739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:06:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:06:08.204381175 +0000 UTC m=+327.989672411" watchObservedRunningTime="2026-09-08 04:06:08.205457739 +0000 UTC m=+327.990748975"
Sep 08 04:06:14.183866 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:14.183838    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-dcq8m"
Sep 08 04:06:24.020387 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:24.020359    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-xjw89"]
Sep 08 04:06:24.023770 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:24.023752    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-xjw89"
Sep 08 04:06:24.026142 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:24.026123    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-6tqh5\""
Sep 08 04:06:24.035053 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:24.035034    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-xjw89"]
Sep 08 04:06:24.139925 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:24.139900    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3dc25ff9-5a86-4370-82ea-ffac1d26176a-bound-sa-token\") pod \"cert-manager-55b4d954d5-xjw89\" (UID: \"3dc25ff9-5a86-4370-82ea-ffac1d26176a\") " pod="cert-manager/cert-manager-55b4d954d5-xjw89"
Sep 08 04:06:24.140034 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:24.139960    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r88b\" (UniqueName: \"kubernetes.io/projected/3dc25ff9-5a86-4370-82ea-ffac1d26176a-kube-api-access-2r88b\") pod \"cert-manager-55b4d954d5-xjw89\" (UID: \"3dc25ff9-5a86-4370-82ea-ffac1d26176a\") " pod="cert-manager/cert-manager-55b4d954d5-xjw89"
Sep 08 04:06:24.240910 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:24.240876    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r88b\" (UniqueName: \"kubernetes.io/projected/3dc25ff9-5a86-4370-82ea-ffac1d26176a-kube-api-access-2r88b\") pod \"cert-manager-55b4d954d5-xjw89\" (UID: \"3dc25ff9-5a86-4370-82ea-ffac1d26176a\") " pod="cert-manager/cert-manager-55b4d954d5-xjw89"
Sep 08 04:06:24.241043 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:24.240981    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3dc25ff9-5a86-4370-82ea-ffac1d26176a-bound-sa-token\") pod \"cert-manager-55b4d954d5-xjw89\" (UID: \"3dc25ff9-5a86-4370-82ea-ffac1d26176a\") " pod="cert-manager/cert-manager-55b4d954d5-xjw89"
Sep 08 04:06:24.248626 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:24.248605    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3dc25ff9-5a86-4370-82ea-ffac1d26176a-bound-sa-token\") pod \"cert-manager-55b4d954d5-xjw89\" (UID: \"3dc25ff9-5a86-4370-82ea-ffac1d26176a\") " pod="cert-manager/cert-manager-55b4d954d5-xjw89"
Sep 08 04:06:24.248726 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:24.248707    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r88b\" (UniqueName: \"kubernetes.io/projected/3dc25ff9-5a86-4370-82ea-ffac1d26176a-kube-api-access-2r88b\") pod \"cert-manager-55b4d954d5-xjw89\" (UID: \"3dc25ff9-5a86-4370-82ea-ffac1d26176a\") " pod="cert-manager/cert-manager-55b4d954d5-xjw89"
Sep 08 04:06:24.332356 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:24.332292    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-xjw89"
Sep 08 04:06:24.602336 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:24.602088    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-xjw89"]
Sep 08 04:06:24.604821 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:06:24.604789    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3dc25ff9_5a86_4370_82ea_ffac1d26176a.slice/crio-ac8890f36520a365395a8e5d9073f115926abe9abc89d93cb4bd72e848e0e88d WatchSource:0}: Error finding container ac8890f36520a365395a8e5d9073f115926abe9abc89d93cb4bd72e848e0e88d: Status 404 returned error can't find the container with id ac8890f36520a365395a8e5d9073f115926abe9abc89d93cb4bd72e848e0e88d
Sep 08 04:06:25.252898 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:25.252862    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-xjw89" event={"ID":"3dc25ff9-5a86-4370-82ea-ffac1d26176a","Type":"ContainerStarted","Data":"b14b15791665c6aecbc4f7acdb37494574eee709d71a6fba04db281991132660"}
Sep 08 04:06:25.253257 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:25.252912    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-xjw89" event={"ID":"3dc25ff9-5a86-4370-82ea-ffac1d26176a","Type":"ContainerStarted","Data":"ac8890f36520a365395a8e5d9073f115926abe9abc89d93cb4bd72e848e0e88d"}
Sep 08 04:06:25.269004 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:25.268962    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-xjw89" podStartSLOduration=1.2689477120000001 podStartE2EDuration="1.268947712s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:06:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:06:25.267525287 +0000 UTC m=+345.052816524" watchObservedRunningTime="2026-09-08 04:06:25.268947712 +0000 UTC m=+345.054238948"
Sep 08 04:06:37.006916 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:37.006840    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d5d59f488-s2rhc"]
Sep 08 04:06:37.010290 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:37.010261    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d5d59f488-s2rhc"
Sep 08 04:06:37.012770 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:37.012749    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 08 04:06:37.012770 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:37.012757    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 08 04:06:37.013012 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:37.012997    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jkdxt\""
Sep 08 04:06:37.013012 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:37.013007    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 08 04:06:37.013103 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:37.013001    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 08 04:06:37.031687 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:37.031664    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d5d59f488-s2rhc"]
Sep 08 04:06:37.145887 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:37.145849    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b4032b07-b8e9-44b4-860a-e910bd6b0e40-manifests\") pod \"opendatahub-operator-controller-manager-5d5d59f488-s2rhc\" (UID: \"b4032b07-b8e9-44b4-860a-e910bd6b0e40\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5d59f488-s2rhc"
Sep 08 04:06:37.146061 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:37.145900    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrvgv\" (UniqueName: \"kubernetes.io/projected/b4032b07-b8e9-44b4-860a-e910bd6b0e40-kube-api-access-zrvgv\") pod \"opendatahub-operator-controller-manager-5d5d59f488-s2rhc\" (UID: \"b4032b07-b8e9-44b4-860a-e910bd6b0e40\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5d59f488-s2rhc"
Sep 08 04:06:37.146061 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:37.145948    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4032b07-b8e9-44b4-860a-e910bd6b0e40-tmp\") pod \"opendatahub-operator-controller-manager-5d5d59f488-s2rhc\" (UID: \"b4032b07-b8e9-44b4-860a-e910bd6b0e40\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5d59f488-s2rhc"
Sep 08 04:06:37.146061 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:37.146003    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b4032b07-b8e9-44b4-860a-e910bd6b0e40-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d5d59f488-s2rhc\" (UID: \"b4032b07-b8e9-44b4-860a-e910bd6b0e40\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5d59f488-s2rhc"
Sep 08 04:06:37.146061 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:37.146038    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4032b07-b8e9-44b4-860a-e910bd6b0e40-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d5d59f488-s2rhc\" (UID: \"b4032b07-b8e9-44b4-860a-e910bd6b0e40\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5d59f488-s2rhc"
Sep 08 04:06:37.247452 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:37.247421    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4032b07-b8e9-44b4-860a-e910bd6b0e40-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d5d59f488-s2rhc\" (UID: \"b4032b07-b8e9-44b4-860a-e910bd6b0e40\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5d59f488-s2rhc"
Sep 08 04:06:37.247713 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:37.247470    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b4032b07-b8e9-44b4-860a-e910bd6b0e40-manifests\") pod \"opendatahub-operator-controller-manager-5d5d59f488-s2rhc\" (UID: \"b4032b07-b8e9-44b4-860a-e910bd6b0e40\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5d59f488-s2rhc"
Sep 08 04:06:37.247713 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:37.247595    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrvgv\" (UniqueName: \"kubernetes.io/projected/b4032b07-b8e9-44b4-860a-e910bd6b0e40-kube-api-access-zrvgv\") pod \"opendatahub-operator-controller-manager-5d5d59f488-s2rhc\" (UID: \"b4032b07-b8e9-44b4-860a-e910bd6b0e40\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5d59f488-s2rhc"
Sep 08 04:06:37.247713 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:37.247630    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4032b07-b8e9-44b4-860a-e910bd6b0e40-tmp\") pod \"opendatahub-operator-controller-manager-5d5d59f488-s2rhc\" (UID: \"b4032b07-b8e9-44b4-860a-e910bd6b0e40\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5d59f488-s2rhc"
Sep 08 04:06:37.247713 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:37.247696    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b4032b07-b8e9-44b4-860a-e910bd6b0e40-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d5d59f488-s2rhc\" (UID: \"b4032b07-b8e9-44b4-860a-e910bd6b0e40\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5d59f488-s2rhc"
Sep 08 04:06:37.247907 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:37.247888    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b4032b07-b8e9-44b4-860a-e910bd6b0e40-manifests\") pod \"opendatahub-operator-controller-manager-5d5d59f488-s2rhc\" (UID: \"b4032b07-b8e9-44b4-860a-e910bd6b0e40\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5d59f488-s2rhc"
Sep 08 04:06:37.250001 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:37.249972    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4032b07-b8e9-44b4-860a-e910bd6b0e40-tmp\") pod \"opendatahub-operator-controller-manager-5d5d59f488-s2rhc\" (UID: \"b4032b07-b8e9-44b4-860a-e910bd6b0e40\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5d59f488-s2rhc"
Sep 08 04:06:37.250130 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:37.250098    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b4032b07-b8e9-44b4-860a-e910bd6b0e40-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d5d59f488-s2rhc\" (UID: \"b4032b07-b8e9-44b4-860a-e910bd6b0e40\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5d59f488-s2rhc"
Sep 08 04:06:37.250294 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:37.250274    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4032b07-b8e9-44b4-860a-e910bd6b0e40-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d5d59f488-s2rhc\" (UID: \"b4032b07-b8e9-44b4-860a-e910bd6b0e40\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5d59f488-s2rhc"
Sep 08 04:06:37.255740 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:37.255717    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrvgv\" (UniqueName: \"kubernetes.io/projected/b4032b07-b8e9-44b4-860a-e910bd6b0e40-kube-api-access-zrvgv\") pod \"opendatahub-operator-controller-manager-5d5d59f488-s2rhc\" (UID: \"b4032b07-b8e9-44b4-860a-e910bd6b0e40\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5d59f488-s2rhc"
Sep 08 04:06:37.320454 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:37.320381    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d5d59f488-s2rhc"
Sep 08 04:06:37.597212 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:37.597139    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d5d59f488-s2rhc"]
Sep 08 04:06:37.600522 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:06:37.600500    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4032b07_b8e9_44b4_860a_e910bd6b0e40.slice/crio-4d43b64a4dde0ab6b6ce7966eca681f87dfd7d2324552be48a823a2bdb66d4ca WatchSource:0}: Error finding container 4d43b64a4dde0ab6b6ce7966eca681f87dfd7d2324552be48a823a2bdb66d4ca: Status 404 returned error can't find the container with id 4d43b64a4dde0ab6b6ce7966eca681f87dfd7d2324552be48a823a2bdb66d4ca
Sep 08 04:06:38.309351 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:38.309319    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d5d59f488-s2rhc" event={"ID":"b4032b07-b8e9-44b4-860a-e910bd6b0e40","Type":"ContainerStarted","Data":"4d43b64a4dde0ab6b6ce7966eca681f87dfd7d2324552be48a823a2bdb66d4ca"}
Sep 08 04:06:41.325273 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:41.325232    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d5d59f488-s2rhc" event={"ID":"b4032b07-b8e9-44b4-860a-e910bd6b0e40","Type":"ContainerStarted","Data":"ac0414210249bc8019917808a175aa40a51bdad8dc8f5fd76547274fe66806a6"}
Sep 08 04:06:42.331441 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:42.331412    2573 generic.go:356] "Generic (PLEG): container finished" podID="b4032b07-b8e9-44b4-860a-e910bd6b0e40" containerID="ac0414210249bc8019917808a175aa40a51bdad8dc8f5fd76547274fe66806a6" exitCode=0
Sep 08 04:06:42.331814 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:42.331498    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d5d59f488-s2rhc" event={"ID":"b4032b07-b8e9-44b4-860a-e910bd6b0e40","Type":"ContainerDied","Data":"ac0414210249bc8019917808a175aa40a51bdad8dc8f5fd76547274fe66806a6"}
Sep 08 04:06:43.337627 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:43.337584    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d5d59f488-s2rhc" event={"ID":"b4032b07-b8e9-44b4-860a-e910bd6b0e40","Type":"ContainerStarted","Data":"e6b827304acb6353f5af3e2bd2a15997d4fe76d63b45f2603e0036b85ffd0c20"}
Sep 08 04:06:43.338005 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:43.337706    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5d5d59f488-s2rhc"
Sep 08 04:06:43.358738 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:43.358672    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5d5d59f488-s2rhc" podStartSLOduration=3.01188028 podStartE2EDuration="7.358657953s" totalImagesPullingTime="3.295959791s" totalInitContainerRuntime="1.050817882s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:06:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:06:43.356969755 +0000 UTC m=+363.142260992" watchObservedRunningTime="2026-09-08 04:06:43.358657953 +0000 UTC m=+363.143949188"
Sep 08 04:06:54.343386 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:54.343358    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5d5d59f488-s2rhc"
Sep 08 04:06:56.718716 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:56.718688    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5859ff6677-dkk9d"]
Sep 08 04:06:56.727334 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:56.727311    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5859ff6677-dkk9d"
Sep 08 04:06:56.730754 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:56.730732    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 08 04:06:56.730866 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:56.730767    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 08 04:06:56.730998 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:56.730982    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-z6qkw\""
Sep 08 04:06:56.731522 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:56.731495    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 08 04:06:56.731864 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:56.731844    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 08 04:06:56.740541 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:56.740518    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5859ff6677-dkk9d"]
Sep 08 04:06:56.807270 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:56.807237    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb2ca6b2-6b27-451d-b4ec-32f62387e95e-tls-certs\") pod \"kube-auth-proxy-5859ff6677-dkk9d\" (UID: \"eb2ca6b2-6b27-451d-b4ec-32f62387e95e\") " pod="openshift-ingress/kube-auth-proxy-5859ff6677-dkk9d"
Sep 08 04:06:56.807394 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:56.807312    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b25xf\" (UniqueName: \"kubernetes.io/projected/eb2ca6b2-6b27-451d-b4ec-32f62387e95e-kube-api-access-b25xf\") pod \"kube-auth-proxy-5859ff6677-dkk9d\" (UID: \"eb2ca6b2-6b27-451d-b4ec-32f62387e95e\") " pod="openshift-ingress/kube-auth-proxy-5859ff6677-dkk9d"
Sep 08 04:06:56.807394 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:56.807389    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb2ca6b2-6b27-451d-b4ec-32f62387e95e-tmp\") pod \"kube-auth-proxy-5859ff6677-dkk9d\" (UID: \"eb2ca6b2-6b27-451d-b4ec-32f62387e95e\") " pod="openshift-ingress/kube-auth-proxy-5859ff6677-dkk9d"
Sep 08 04:06:56.908426 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:56.908395    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb2ca6b2-6b27-451d-b4ec-32f62387e95e-tmp\") pod \"kube-auth-proxy-5859ff6677-dkk9d\" (UID: \"eb2ca6b2-6b27-451d-b4ec-32f62387e95e\") " pod="openshift-ingress/kube-auth-proxy-5859ff6677-dkk9d"
Sep 08 04:06:56.908593 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:56.908438    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb2ca6b2-6b27-451d-b4ec-32f62387e95e-tls-certs\") pod \"kube-auth-proxy-5859ff6677-dkk9d\" (UID: \"eb2ca6b2-6b27-451d-b4ec-32f62387e95e\") " pod="openshift-ingress/kube-auth-proxy-5859ff6677-dkk9d"
Sep 08 04:06:56.908593 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:56.908472    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b25xf\" (UniqueName: \"kubernetes.io/projected/eb2ca6b2-6b27-451d-b4ec-32f62387e95e-kube-api-access-b25xf\") pod \"kube-auth-proxy-5859ff6677-dkk9d\" (UID: \"eb2ca6b2-6b27-451d-b4ec-32f62387e95e\") " pod="openshift-ingress/kube-auth-proxy-5859ff6677-dkk9d"
Sep 08 04:06:56.908593 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:06:56.908573    2573 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 08 04:06:56.908759 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:06:56.908635    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb2ca6b2-6b27-451d-b4ec-32f62387e95e-tls-certs podName:eb2ca6b2-6b27-451d-b4ec-32f62387e95e nodeName:}" failed. No retries permitted until 2026-09-08 04:06:57.408619158 +0000 UTC m=+377.193910373 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/eb2ca6b2-6b27-451d-b4ec-32f62387e95e-tls-certs") pod "kube-auth-proxy-5859ff6677-dkk9d" (UID: "eb2ca6b2-6b27-451d-b4ec-32f62387e95e") : secret "kube-auth-proxy-tls" not found
Sep 08 04:06:56.910800 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:56.910780    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb2ca6b2-6b27-451d-b4ec-32f62387e95e-tmp\") pod \"kube-auth-proxy-5859ff6677-dkk9d\" (UID: \"eb2ca6b2-6b27-451d-b4ec-32f62387e95e\") " pod="openshift-ingress/kube-auth-proxy-5859ff6677-dkk9d"
Sep 08 04:06:56.923273 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:56.923253    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b25xf\" (UniqueName: \"kubernetes.io/projected/eb2ca6b2-6b27-451d-b4ec-32f62387e95e-kube-api-access-b25xf\") pod \"kube-auth-proxy-5859ff6677-dkk9d\" (UID: \"eb2ca6b2-6b27-451d-b4ec-32f62387e95e\") " pod="openshift-ingress/kube-auth-proxy-5859ff6677-dkk9d"
Sep 08 04:06:57.413737 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:57.413702    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb2ca6b2-6b27-451d-b4ec-32f62387e95e-tls-certs\") pod \"kube-auth-proxy-5859ff6677-dkk9d\" (UID: \"eb2ca6b2-6b27-451d-b4ec-32f62387e95e\") " pod="openshift-ingress/kube-auth-proxy-5859ff6677-dkk9d"
Sep 08 04:06:57.416155 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:57.416137    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb2ca6b2-6b27-451d-b4ec-32f62387e95e-tls-certs\") pod \"kube-auth-proxy-5859ff6677-dkk9d\" (UID: \"eb2ca6b2-6b27-451d-b4ec-32f62387e95e\") " pod="openshift-ingress/kube-auth-proxy-5859ff6677-dkk9d"
Sep 08 04:06:57.642680 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:57.642649    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5859ff6677-dkk9d"
Sep 08 04:06:57.918636 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:57.918611    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5859ff6677-dkk9d"]
Sep 08 04:06:57.920674 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:06:57.920646    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb2ca6b2_6b27_451d_b4ec_32f62387e95e.slice/crio-d0725afc26a8b9c10ac8545a2b0bc10646a25902ea3009e37280dced3853f9a8 WatchSource:0}: Error finding container d0725afc26a8b9c10ac8545a2b0bc10646a25902ea3009e37280dced3853f9a8: Status 404 returned error can't find the container with id d0725afc26a8b9c10ac8545a2b0bc10646a25902ea3009e37280dced3853f9a8
Sep 08 04:06:58.204478 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:58.204444    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kc7dq"]
Sep 08 04:06:58.209058 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:58.209042    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kc7dq"
Sep 08 04:06:58.211738 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:58.211715    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 08 04:06:58.211849 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:58.211748    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 08 04:06:58.211849 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:58.211819    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-n5zmn\""
Sep 08 04:06:58.212093 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:58.212081    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 08 04:06:58.212311 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:58.212298    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 08 04:06:58.218710 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:58.218689    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kc7dq"]
Sep 08 04:06:58.322629 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:58.322601    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf4th\" (UniqueName: \"kubernetes.io/projected/895ba627-4543-4b52-a021-20804bcfeba8-kube-api-access-gf4th\") pod \"istiod-openshift-gateway-7b7995d5cd-kc7dq\" (UID: \"895ba627-4543-4b52-a021-20804bcfeba8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kc7dq"
Sep 08 04:06:58.322789 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:58.322653    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/895ba627-4543-4b52-a021-20804bcfeba8-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-kc7dq\" (UID: \"895ba627-4543-4b52-a021-20804bcfeba8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kc7dq"
Sep 08 04:06:58.322789 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:58.322683    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/895ba627-4543-4b52-a021-20804bcfeba8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-kc7dq\" (UID: \"895ba627-4543-4b52-a021-20804bcfeba8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kc7dq"
Sep 08 04:06:58.322789 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:58.322754    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/895ba627-4543-4b52-a021-20804bcfeba8-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-kc7dq\" (UID: \"895ba627-4543-4b52-a021-20804bcfeba8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kc7dq"
Sep 08 04:06:58.322929 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:58.322798    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/895ba627-4543-4b52-a021-20804bcfeba8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-kc7dq\" (UID: \"895ba627-4543-4b52-a021-20804bcfeba8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kc7dq"
Sep 08 04:06:58.322929 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:58.322819    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/895ba627-4543-4b52-a021-20804bcfeba8-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-kc7dq\" (UID: \"895ba627-4543-4b52-a021-20804bcfeba8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kc7dq"
Sep 08 04:06:58.322929 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:58.322877    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/895ba627-4543-4b52-a021-20804bcfeba8-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-kc7dq\" (UID: \"895ba627-4543-4b52-a021-20804bcfeba8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kc7dq"
Sep 08 04:06:58.407338 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:58.407308    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5859ff6677-dkk9d" event={"ID":"eb2ca6b2-6b27-451d-b4ec-32f62387e95e","Type":"ContainerStarted","Data":"d0725afc26a8b9c10ac8545a2b0bc10646a25902ea3009e37280dced3853f9a8"}
Sep 08 04:06:58.423756 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:58.423733    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/895ba627-4543-4b52-a021-20804bcfeba8-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-kc7dq\" (UID: \"895ba627-4543-4b52-a021-20804bcfeba8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kc7dq"
Sep 08 04:06:58.423848 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:58.423797    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf4th\" (UniqueName: \"kubernetes.io/projected/895ba627-4543-4b52-a021-20804bcfeba8-kube-api-access-gf4th\") pod \"istiod-openshift-gateway-7b7995d5cd-kc7dq\" (UID: \"895ba627-4543-4b52-a021-20804bcfeba8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kc7dq"
Sep 08 04:06:58.423848 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:58.423840    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/895ba627-4543-4b52-a021-20804bcfeba8-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-kc7dq\" (UID: \"895ba627-4543-4b52-a021-20804bcfeba8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kc7dq"
Sep 08 04:06:58.423947 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:58.423863    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/895ba627-4543-4b52-a021-20804bcfeba8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-kc7dq\" (UID: \"895ba627-4543-4b52-a021-20804bcfeba8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kc7dq"
Sep 08 04:06:58.424084 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:58.424063    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/895ba627-4543-4b52-a021-20804bcfeba8-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-kc7dq\" (UID: \"895ba627-4543-4b52-a021-20804bcfeba8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kc7dq"
Sep 08 04:06:58.424265 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:58.424239    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/895ba627-4543-4b52-a021-20804bcfeba8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-kc7dq\" (UID: \"895ba627-4543-4b52-a021-20804bcfeba8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kc7dq"
Sep 08 04:06:58.424389 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:58.424282    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/895ba627-4543-4b52-a021-20804bcfeba8-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-kc7dq\" (UID: \"895ba627-4543-4b52-a021-20804bcfeba8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kc7dq"
Sep 08 04:06:58.424449 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:58.424431    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/895ba627-4543-4b52-a021-20804bcfeba8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-kc7dq\" (UID: \"895ba627-4543-4b52-a021-20804bcfeba8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kc7dq"
Sep 08 04:06:58.426374 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:58.426347    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/895ba627-4543-4b52-a021-20804bcfeba8-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-kc7dq\" (UID: \"895ba627-4543-4b52-a021-20804bcfeba8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kc7dq"
Sep 08 04:06:58.426606 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:58.426589    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/895ba627-4543-4b52-a021-20804bcfeba8-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-kc7dq\" (UID: \"895ba627-4543-4b52-a021-20804bcfeba8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kc7dq"
Sep 08 04:06:58.426678 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:58.426647    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/895ba627-4543-4b52-a021-20804bcfeba8-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-kc7dq\" (UID: \"895ba627-4543-4b52-a021-20804bcfeba8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kc7dq"
Sep 08 04:06:58.426854 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:58.426836    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/895ba627-4543-4b52-a021-20804bcfeba8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-kc7dq\" (UID: \"895ba627-4543-4b52-a021-20804bcfeba8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kc7dq"
Sep 08 04:06:58.432458 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:58.432437    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf4th\" (UniqueName: \"kubernetes.io/projected/895ba627-4543-4b52-a021-20804bcfeba8-kube-api-access-gf4th\") pod \"istiod-openshift-gateway-7b7995d5cd-kc7dq\" (UID: \"895ba627-4543-4b52-a021-20804bcfeba8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kc7dq"
Sep 08 04:06:58.432609 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:58.432591    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/895ba627-4543-4b52-a021-20804bcfeba8-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-kc7dq\" (UID: \"895ba627-4543-4b52-a021-20804bcfeba8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kc7dq"
Sep 08 04:06:58.519964 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:58.519943    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kc7dq"
Sep 08 04:06:58.796510 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:58.796283    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kc7dq"]
Sep 08 04:06:58.799150 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:06:58.799118    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod895ba627_4543_4b52_a021_20804bcfeba8.slice/crio-4acb64ea7629b4f214cb35562a57184be687a7a2fe414d89183490c9ffaaf2a7 WatchSource:0}: Error finding container 4acb64ea7629b4f214cb35562a57184be687a7a2fe414d89183490c9ffaaf2a7: Status 404 returned error can't find the container with id 4acb64ea7629b4f214cb35562a57184be687a7a2fe414d89183490c9ffaaf2a7
Sep 08 04:06:59.414000 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:06:59.413968    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kc7dq" event={"ID":"895ba627-4543-4b52-a021-20804bcfeba8","Type":"ContainerStarted","Data":"4acb64ea7629b4f214cb35562a57184be687a7a2fe414d89183490c9ffaaf2a7"}
Sep 08 04:07:01.995535 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:01.995497    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:07:01.995832 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:01.995624    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:07:02.433225 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:02.433188    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5859ff6677-dkk9d" event={"ID":"eb2ca6b2-6b27-451d-b4ec-32f62387e95e","Type":"ContainerStarted","Data":"4abfcf5eaa291b2a40480b88a4b2ed946593db219e1de8dabc291fbebff3e3bd"}
Sep 08 04:07:02.434995 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:02.434970    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kc7dq" event={"ID":"895ba627-4543-4b52-a021-20804bcfeba8","Type":"ContainerStarted","Data":"0d20868a08c7f42a5099ecb326eeac3c795e6834d471ccb42502da4eeb2dd577"}
Sep 08 04:07:02.435138 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:02.435062    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kc7dq"
Sep 08 04:07:02.456566 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:02.456510    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5859ff6677-dkk9d" podStartSLOduration=2.4300029260000002 podStartE2EDuration="6.456497471s" totalImagesPullingTime="4.026494545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:06:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:07:02.456376558 +0000 UTC m=+382.241667794" watchObservedRunningTime="2026-09-08 04:07:02.456497471 +0000 UTC m=+382.241788706"
Sep 08 04:07:02.483777 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:02.483721    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kc7dq" podStartSLOduration=1.290613697 podStartE2EDuration="4.483700979s" totalImagesPullingTime="3.193087282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:06:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:07:02.481415037 +0000 UTC m=+382.266706268" watchObservedRunningTime="2026-09-08 04:07:02.483700979 +0000 UTC m=+382.268992216"
Sep 08 04:07:03.441534 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:03.441505    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kc7dq"
Sep 08 04:07:17.773540 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:17.773500    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-87k45"]
Sep 08 04:07:17.787086 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:17.787058    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-87k45"
Sep 08 04:07:17.794152 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:17.794132    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 08 04:07:17.794379 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:17.794326    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-f7zbk\""
Sep 08 04:07:17.800464 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:17.800430    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-28n8h"]
Sep 08 04:07:17.803323 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:17.803306    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-28n8h"
Sep 08 04:07:17.807318 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:17.807273    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 08 04:07:17.811367 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:17.811246    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-87k45"]
Sep 08 04:07:17.812083 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:17.812063    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-kkggm\""
Sep 08 04:07:17.831163 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:17.831134    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-28n8h"]
Sep 08 04:07:17.893875 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:17.893838    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/601d1e25-b86c-48af-8ccf-c559677d0ead-cert\") pod \"kserve-controller-manager-d6f4b65b8-87k45\" (UID: \"601d1e25-b86c-48af-8ccf-c559677d0ead\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-87k45"
Sep 08 04:07:17.894063 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:17.893891    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61de5c9f-f9dd-49be-ad8e-82cf48b61939-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-28n8h\" (UID: \"61de5c9f-f9dd-49be-ad8e-82cf48b61939\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-28n8h"
Sep 08 04:07:17.894063 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:17.893940    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kxfn\" (UniqueName: \"kubernetes.io/projected/61de5c9f-f9dd-49be-ad8e-82cf48b61939-kube-api-access-8kxfn\") pod \"llmisvc-controller-manager-777c6bd7d5-28n8h\" (UID: \"61de5c9f-f9dd-49be-ad8e-82cf48b61939\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-28n8h"
Sep 08 04:07:17.894063 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:17.893998    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv2bz\" (UniqueName: \"kubernetes.io/projected/601d1e25-b86c-48af-8ccf-c559677d0ead-kube-api-access-gv2bz\") pod \"kserve-controller-manager-d6f4b65b8-87k45\" (UID: \"601d1e25-b86c-48af-8ccf-c559677d0ead\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-87k45"
Sep 08 04:07:17.995425 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:17.995388    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/601d1e25-b86c-48af-8ccf-c559677d0ead-cert\") pod \"kserve-controller-manager-d6f4b65b8-87k45\" (UID: \"601d1e25-b86c-48af-8ccf-c559677d0ead\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-87k45"
Sep 08 04:07:17.995425 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:17.995425    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61de5c9f-f9dd-49be-ad8e-82cf48b61939-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-28n8h\" (UID: \"61de5c9f-f9dd-49be-ad8e-82cf48b61939\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-28n8h"
Sep 08 04:07:17.995701 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:17.995445    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kxfn\" (UniqueName: \"kubernetes.io/projected/61de5c9f-f9dd-49be-ad8e-82cf48b61939-kube-api-access-8kxfn\") pod \"llmisvc-controller-manager-777c6bd7d5-28n8h\" (UID: \"61de5c9f-f9dd-49be-ad8e-82cf48b61939\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-28n8h"
Sep 08 04:07:17.995701 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:17.995474    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv2bz\" (UniqueName: \"kubernetes.io/projected/601d1e25-b86c-48af-8ccf-c559677d0ead-kube-api-access-gv2bz\") pod \"kserve-controller-manager-d6f4b65b8-87k45\" (UID: \"601d1e25-b86c-48af-8ccf-c559677d0ead\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-87k45"
Sep 08 04:07:17.995701 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:07:17.995549    2573 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 08 04:07:17.995701 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:07:17.995644    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/601d1e25-b86c-48af-8ccf-c559677d0ead-cert podName:601d1e25-b86c-48af-8ccf-c559677d0ead nodeName:}" failed. No retries permitted until 2026-09-08 04:07:18.495629112 +0000 UTC m=+398.280920325 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/601d1e25-b86c-48af-8ccf-c559677d0ead-cert") pod "kserve-controller-manager-d6f4b65b8-87k45" (UID: "601d1e25-b86c-48af-8ccf-c559677d0ead") : secret "kserve-webhook-server-cert" not found
Sep 08 04:07:17.995701 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:07:17.995549    2573 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 08 04:07:17.995918 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:07:17.995713    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61de5c9f-f9dd-49be-ad8e-82cf48b61939-cert podName:61de5c9f-f9dd-49be-ad8e-82cf48b61939 nodeName:}" failed. No retries permitted until 2026-09-08 04:07:18.495699318 +0000 UTC m=+398.280990532 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/61de5c9f-f9dd-49be-ad8e-82cf48b61939-cert") pod "llmisvc-controller-manager-777c6bd7d5-28n8h" (UID: "61de5c9f-f9dd-49be-ad8e-82cf48b61939") : secret "llmisvc-webhook-server-cert" not found
Sep 08 04:07:18.015954 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:18.015927    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv2bz\" (UniqueName: \"kubernetes.io/projected/601d1e25-b86c-48af-8ccf-c559677d0ead-kube-api-access-gv2bz\") pod \"kserve-controller-manager-d6f4b65b8-87k45\" (UID: \"601d1e25-b86c-48af-8ccf-c559677d0ead\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-87k45"
Sep 08 04:07:18.018513 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:18.018492    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kxfn\" (UniqueName: \"kubernetes.io/projected/61de5c9f-f9dd-49be-ad8e-82cf48b61939-kube-api-access-8kxfn\") pod \"llmisvc-controller-manager-777c6bd7d5-28n8h\" (UID: \"61de5c9f-f9dd-49be-ad8e-82cf48b61939\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-28n8h"
Sep 08 04:07:18.500480 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:18.500453    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/601d1e25-b86c-48af-8ccf-c559677d0ead-cert\") pod \"kserve-controller-manager-d6f4b65b8-87k45\" (UID: \"601d1e25-b86c-48af-8ccf-c559677d0ead\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-87k45"
Sep 08 04:07:18.500480 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:18.500488    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61de5c9f-f9dd-49be-ad8e-82cf48b61939-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-28n8h\" (UID: \"61de5c9f-f9dd-49be-ad8e-82cf48b61939\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-28n8h"
Sep 08 04:07:18.502954 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:18.502929    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/601d1e25-b86c-48af-8ccf-c559677d0ead-cert\") pod \"kserve-controller-manager-d6f4b65b8-87k45\" (UID: \"601d1e25-b86c-48af-8ccf-c559677d0ead\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-87k45"
Sep 08 04:07:18.503051 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:18.503016    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61de5c9f-f9dd-49be-ad8e-82cf48b61939-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-28n8h\" (UID: \"61de5c9f-f9dd-49be-ad8e-82cf48b61939\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-28n8h"
Sep 08 04:07:18.697437 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:18.697412    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-87k45"
Sep 08 04:07:18.715646 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:18.715622    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-28n8h"
Sep 08 04:07:18.974814 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:18.974789    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-87k45"]
Sep 08 04:07:18.976919 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:07:18.976895    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod601d1e25_b86c_48af_8ccf_c559677d0ead.slice/crio-2af8bfcc448555fa685291aa3ed2f98b5f9c37f245d1241103e029b8026ce02c WatchSource:0}: Error finding container 2af8bfcc448555fa685291aa3ed2f98b5f9c37f245d1241103e029b8026ce02c: Status 404 returned error can't find the container with id 2af8bfcc448555fa685291aa3ed2f98b5f9c37f245d1241103e029b8026ce02c
Sep 08 04:07:19.000059 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:19.000037    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-28n8h"]
Sep 08 04:07:19.001186 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:07:19.001166    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod61de5c9f_f9dd_49be_ad8e_82cf48b61939.slice/crio-3fd18311d531374671997fd5a7b1da31400915eb0d4d7b782a98f1f7c40266c9 WatchSource:0}: Error finding container 3fd18311d531374671997fd5a7b1da31400915eb0d4d7b782a98f1f7c40266c9: Status 404 returned error can't find the container with id 3fd18311d531374671997fd5a7b1da31400915eb0d4d7b782a98f1f7c40266c9
Sep 08 04:07:19.314061 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:19.313983    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kc7dq"]
Sep 08 04:07:19.314211 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:19.314179    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kc7dq" podUID="895ba627-4543-4b52-a021-20804bcfeba8" containerName="discovery" containerID="cri-o://0d20868a08c7f42a5099ecb326eeac3c795e6834d471ccb42502da4eeb2dd577" gracePeriod=30
Sep 08 04:07:19.517097 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:19.517060    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-87k45" event={"ID":"601d1e25-b86c-48af-8ccf-c559677d0ead","Type":"ContainerStarted","Data":"2af8bfcc448555fa685291aa3ed2f98b5f9c37f245d1241103e029b8026ce02c"}
Sep 08 04:07:19.518326 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:19.518301    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-28n8h" event={"ID":"61de5c9f-f9dd-49be-ad8e-82cf48b61939","Type":"ContainerStarted","Data":"3fd18311d531374671997fd5a7b1da31400915eb0d4d7b782a98f1f7c40266c9"}
Sep 08 04:07:19.519999 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:19.519976    2573 generic.go:356] "Generic (PLEG): container finished" podID="895ba627-4543-4b52-a021-20804bcfeba8" containerID="0d20868a08c7f42a5099ecb326eeac3c795e6834d471ccb42502da4eeb2dd577" exitCode=0
Sep 08 04:07:19.520100 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:19.520055    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kc7dq" event={"ID":"895ba627-4543-4b52-a021-20804bcfeba8","Type":"ContainerDied","Data":"0d20868a08c7f42a5099ecb326eeac3c795e6834d471ccb42502da4eeb2dd577"}
Sep 08 04:07:19.559865 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:19.559843    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kc7dq"
Sep 08 04:07:19.710423 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:19.710352    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gf4th\" (UniqueName: \"kubernetes.io/projected/895ba627-4543-4b52-a021-20804bcfeba8-kube-api-access-gf4th\") pod \"895ba627-4543-4b52-a021-20804bcfeba8\" (UID: \"895ba627-4543-4b52-a021-20804bcfeba8\") "
Sep 08 04:07:19.710606 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:19.710462    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/895ba627-4543-4b52-a021-20804bcfeba8-istio-token\") pod \"895ba627-4543-4b52-a021-20804bcfeba8\" (UID: \"895ba627-4543-4b52-a021-20804bcfeba8\") "
Sep 08 04:07:19.710606 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:19.710495    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/895ba627-4543-4b52-a021-20804bcfeba8-istio-kubeconfig\") pod \"895ba627-4543-4b52-a021-20804bcfeba8\" (UID: \"895ba627-4543-4b52-a021-20804bcfeba8\") "
Sep 08 04:07:19.710606 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:19.710522    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/895ba627-4543-4b52-a021-20804bcfeba8-local-certs\") pod \"895ba627-4543-4b52-a021-20804bcfeba8\" (UID: \"895ba627-4543-4b52-a021-20804bcfeba8\") "
Sep 08 04:07:19.711087 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:19.711060    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/895ba627-4543-4b52-a021-20804bcfeba8-istio-csr-ca-configmap\") pod \"895ba627-4543-4b52-a021-20804bcfeba8\" (UID: \"895ba627-4543-4b52-a021-20804bcfeba8\") "
Sep 08 04:07:19.711192 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:19.711126    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/895ba627-4543-4b52-a021-20804bcfeba8-istio-csr-dns-cert\") pod \"895ba627-4543-4b52-a021-20804bcfeba8\" (UID: \"895ba627-4543-4b52-a021-20804bcfeba8\") "
Sep 08 04:07:19.711192 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:19.711169    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/895ba627-4543-4b52-a021-20804bcfeba8-cacerts\") pod \"895ba627-4543-4b52-a021-20804bcfeba8\" (UID: \"895ba627-4543-4b52-a021-20804bcfeba8\") "
Sep 08 04:07:19.712223 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:19.712191    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/895ba627-4543-4b52-a021-20804bcfeba8-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "895ba627-4543-4b52-a021-20804bcfeba8" (UID: "895ba627-4543-4b52-a021-20804bcfeba8"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 04:07:19.712399 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:19.712379    2573 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/895ba627-4543-4b52-a021-20804bcfeba8-istio-csr-ca-configmap\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:07:19.713638 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:19.713611    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/895ba627-4543-4b52-a021-20804bcfeba8-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "895ba627-4543-4b52-a021-20804bcfeba8" (UID: "895ba627-4543-4b52-a021-20804bcfeba8"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:07:19.713918 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:19.713863    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/895ba627-4543-4b52-a021-20804bcfeba8-istio-token" (OuterVolumeSpecName: "istio-token") pod "895ba627-4543-4b52-a021-20804bcfeba8" (UID: "895ba627-4543-4b52-a021-20804bcfeba8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:07:19.714911 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:19.714859    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/895ba627-4543-4b52-a021-20804bcfeba8-local-certs" (OuterVolumeSpecName: "local-certs") pod "895ba627-4543-4b52-a021-20804bcfeba8" (UID: "895ba627-4543-4b52-a021-20804bcfeba8"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:07:19.715007 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:19.714911    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/895ba627-4543-4b52-a021-20804bcfeba8-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "895ba627-4543-4b52-a021-20804bcfeba8" (UID: "895ba627-4543-4b52-a021-20804bcfeba8"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:07:19.715201 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:19.715180    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/895ba627-4543-4b52-a021-20804bcfeba8-kube-api-access-gf4th" (OuterVolumeSpecName: "kube-api-access-gf4th") pod "895ba627-4543-4b52-a021-20804bcfeba8" (UID: "895ba627-4543-4b52-a021-20804bcfeba8"). InnerVolumeSpecName "kube-api-access-gf4th". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:07:19.715787 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:19.715750    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/895ba627-4543-4b52-a021-20804bcfeba8-cacerts" (OuterVolumeSpecName: "cacerts") pod "895ba627-4543-4b52-a021-20804bcfeba8" (UID: "895ba627-4543-4b52-a021-20804bcfeba8"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:07:19.813267 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:19.813230    2573 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/895ba627-4543-4b52-a021-20804bcfeba8-local-certs\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:07:19.813267 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:19.813259    2573 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/895ba627-4543-4b52-a021-20804bcfeba8-istio-csr-dns-cert\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:07:19.813267 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:19.813270    2573 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/895ba627-4543-4b52-a021-20804bcfeba8-cacerts\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:07:19.813517 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:19.813280    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gf4th\" (UniqueName: \"kubernetes.io/projected/895ba627-4543-4b52-a021-20804bcfeba8-kube-api-access-gf4th\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:07:19.813517 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:19.813290    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/895ba627-4543-4b52-a021-20804bcfeba8-istio-token\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:07:19.813517 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:19.813299    2573 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/895ba627-4543-4b52-a021-20804bcfeba8-istio-kubeconfig\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:07:20.527412 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:20.527381    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kc7dq"
Sep 08 04:07:20.527837 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:20.527423    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kc7dq" event={"ID":"895ba627-4543-4b52-a021-20804bcfeba8","Type":"ContainerDied","Data":"4acb64ea7629b4f214cb35562a57184be687a7a2fe414d89183490c9ffaaf2a7"}
Sep 08 04:07:20.527837 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:20.527486    2573 scope.go:117] "RemoveContainer" containerID="0d20868a08c7f42a5099ecb326eeac3c795e6834d471ccb42502da4eeb2dd577"
Sep 08 04:07:20.559167 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:20.559142    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kc7dq"]
Sep 08 04:07:20.573193 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:20.573164    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kc7dq"]
Sep 08 04:07:20.676938 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:20.676899    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="895ba627-4543-4b52-a021-20804bcfeba8" path="/var/lib/kubelet/pods/895ba627-4543-4b52-a021-20804bcfeba8/volumes"
Sep 08 04:07:21.542323 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:21.542280    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-87k45" event={"ID":"601d1e25-b86c-48af-8ccf-c559677d0ead","Type":"ContainerStarted","Data":"b3875587a1d784f946a42cedb81fdd3a13f5ba3232253ed39536345e49cd3c81"}
Sep 08 04:07:21.542831 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:21.542387    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-87k45"
Sep 08 04:07:21.561517 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:21.561462    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-87k45" podStartSLOduration=2.436931908 podStartE2EDuration="4.561444385s" totalImagesPullingTime="2.124512477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:07:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:07:21.55965199 +0000 UTC m=+401.344943243" watchObservedRunningTime="2026-09-08 04:07:21.561444385 +0000 UTC m=+401.346735622"
Sep 08 04:07:22.552228 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:22.552193    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-28n8h" event={"ID":"61de5c9f-f9dd-49be-ad8e-82cf48b61939","Type":"ContainerStarted","Data":"a76ff94a1df400cf76c6ca5d6bb317b809cfbbbdeb1e35d0a649a6406f7d95e3"}
Sep 08 04:07:22.552625 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:22.552497    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-28n8h"
Sep 08 04:07:22.570442 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:22.570393    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-28n8h" podStartSLOduration=2.67242943 podStartE2EDuration="5.570379359s" totalImagesPullingTime="2.897949929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:07:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:07:22.568417025 +0000 UTC m=+402.353708255" watchObservedRunningTime="2026-09-08 04:07:22.570379359 +0000 UTC m=+402.355670595"
Sep 08 04:07:52.557282 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:52.557247    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-87k45"
Sep 08 04:07:53.560279 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:07:53.560251    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-28n8h"
Sep 08 04:08:24.656362 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:24.656328    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-89x5g"]
Sep 08 04:08:24.656785 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:24.656700    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="895ba627-4543-4b52-a021-20804bcfeba8" containerName="discovery"
Sep 08 04:08:24.656785 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:24.656712    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="895ba627-4543-4b52-a021-20804bcfeba8" containerName="discovery"
Sep 08 04:08:24.656785 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:24.656778    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="895ba627-4543-4b52-a021-20804bcfeba8" containerName="discovery"
Sep 08 04:08:24.659815 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:24.659799    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-89x5g"
Sep 08 04:08:24.662332 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:24.662303    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-9plgn\""
Sep 08 04:08:24.662428 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:24.662303    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 08 04:08:24.662584 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:24.662547    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 08 04:08:24.663146 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:24.663132    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 08 04:08:24.675181 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:24.675156    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-89x5g"]
Sep 08 04:08:24.753190 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:24.753162    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jblv\" (UniqueName: \"kubernetes.io/projected/b9221c29-5a63-45d3-ab1a-e1d75b233c7c-kube-api-access-4jblv\") pod \"dns-operator-controller-manager-5985564776-89x5g\" (UID: \"b9221c29-5a63-45d3-ab1a-e1d75b233c7c\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-89x5g"
Sep 08 04:08:24.854195 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:24.854156    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jblv\" (UniqueName: \"kubernetes.io/projected/b9221c29-5a63-45d3-ab1a-e1d75b233c7c-kube-api-access-4jblv\") pod \"dns-operator-controller-manager-5985564776-89x5g\" (UID: \"b9221c29-5a63-45d3-ab1a-e1d75b233c7c\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-89x5g"
Sep 08 04:08:24.864549 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:24.864515    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jblv\" (UniqueName: \"kubernetes.io/projected/b9221c29-5a63-45d3-ab1a-e1d75b233c7c-kube-api-access-4jblv\") pod \"dns-operator-controller-manager-5985564776-89x5g\" (UID: \"b9221c29-5a63-45d3-ab1a-e1d75b233c7c\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-89x5g"
Sep 08 04:08:24.971573 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:24.971488    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-89x5g"
Sep 08 04:08:25.242409 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:25.242384    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-89x5g"]
Sep 08 04:08:25.244444 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:08:25.244414    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9221c29_5a63_45d3_ab1a_e1d75b233c7c.slice/crio-521f5facc912809f17f158f2ed3810d81f817aa263b08f0d1c35f64577d3ad06 WatchSource:0}: Error finding container 521f5facc912809f17f158f2ed3810d81f817aa263b08f0d1c35f64577d3ad06: Status 404 returned error can't find the container with id 521f5facc912809f17f158f2ed3810d81f817aa263b08f0d1c35f64577d3ad06
Sep 08 04:08:25.835809 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:25.835778    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-89x5g" event={"ID":"b9221c29-5a63-45d3-ab1a-e1d75b233c7c","Type":"ContainerStarted","Data":"521f5facc912809f17f158f2ed3810d81f817aa263b08f0d1c35f64577d3ad06"}
Sep 08 04:08:26.764320 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:26.764291    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2cx5k"]
Sep 08 04:08:26.769492 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:26.769471    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2cx5k"
Sep 08 04:08:26.771857 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:26.771836    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-cpgrw\""
Sep 08 04:08:26.778227 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:26.778054    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2cx5k"]
Sep 08 04:08:26.872692 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:26.872652    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84ncm\" (UniqueName: \"kubernetes.io/projected/7c4ef623-897a-4f4f-94dd-d0bd2a9a8cfc-kube-api-access-84ncm\") pod \"limitador-operator-controller-manager-6c549b6d85-2cx5k\" (UID: \"7c4ef623-897a-4f4f-94dd-d0bd2a9a8cfc\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2cx5k"
Sep 08 04:08:26.974143 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:26.974106    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84ncm\" (UniqueName: \"kubernetes.io/projected/7c4ef623-897a-4f4f-94dd-d0bd2a9a8cfc-kube-api-access-84ncm\") pod \"limitador-operator-controller-manager-6c549b6d85-2cx5k\" (UID: \"7c4ef623-897a-4f4f-94dd-d0bd2a9a8cfc\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2cx5k"
Sep 08 04:08:26.982702 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:26.982675    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84ncm\" (UniqueName: \"kubernetes.io/projected/7c4ef623-897a-4f4f-94dd-d0bd2a9a8cfc-kube-api-access-84ncm\") pod \"limitador-operator-controller-manager-6c549b6d85-2cx5k\" (UID: \"7c4ef623-897a-4f4f-94dd-d0bd2a9a8cfc\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2cx5k"
Sep 08 04:08:27.083889 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:27.083806    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2cx5k"
Sep 08 04:08:28.027694 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:28.027666    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2cx5k"]
Sep 08 04:08:28.030116 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:08:28.030091    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c4ef623_897a_4f4f_94dd_d0bd2a9a8cfc.slice/crio-0c84182747d71b00002e045ff438258b349f854dc332eb122df6ea30d5077470 WatchSource:0}: Error finding container 0c84182747d71b00002e045ff438258b349f854dc332eb122df6ea30d5077470: Status 404 returned error can't find the container with id 0c84182747d71b00002e045ff438258b349f854dc332eb122df6ea30d5077470
Sep 08 04:08:28.857986 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:28.857946    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-89x5g" event={"ID":"b9221c29-5a63-45d3-ab1a-e1d75b233c7c","Type":"ContainerStarted","Data":"b0ae6ca946c763585d27056c2ea1969a03825ca0afc1c94381011111807dfe9c"}
Sep 08 04:08:28.858166 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:28.858076    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-89x5g"
Sep 08 04:08:28.859348 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:28.859326    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2cx5k" event={"ID":"7c4ef623-897a-4f4f-94dd-d0bd2a9a8cfc","Type":"ContainerStarted","Data":"0c84182747d71b00002e045ff438258b349f854dc332eb122df6ea30d5077470"}
Sep 08 04:08:28.877076 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:28.877033    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-5985564776-89x5g" podStartSLOduration=2.2977511059999998 podStartE2EDuration="4.877020222s" totalImagesPullingTime="2.579269116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:08:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:08:28.876607296 +0000 UTC m=+468.661898532" watchObservedRunningTime="2026-09-08 04:08:28.877020222 +0000 UTC m=+468.662311458"
Sep 08 04:08:29.867683 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:29.867649    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2cx5k" event={"ID":"7c4ef623-897a-4f4f-94dd-d0bd2a9a8cfc","Type":"ContainerStarted","Data":"c2f525ccef323976973b765451fe9a7f71baafc5d6fe3c9555bf1c811b00c6a3"}
Sep 08 04:08:29.922808 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:29.922758    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2cx5k" podStartSLOduration=2.272433922 podStartE2EDuration="3.922740804s" totalImagesPullingTime="1.650306882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:08:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:08:29.920676604 +0000 UTC m=+469.705967922" watchObservedRunningTime="2026-09-08 04:08:29.922740804 +0000 UTC m=+469.708032039"
Sep 08 04:08:30.873177 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:30.873148    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2cx5k"
Sep 08 04:08:31.243336 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:31.243264    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xsl6g"]
Sep 08 04:08:31.246748 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:31.246733    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xsl6g"
Sep 08 04:08:31.249862 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:31.249842    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-zh6p9\""
Sep 08 04:08:31.260526 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:31.260506    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xsl6g"]
Sep 08 04:08:31.413224 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:31.413195    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbzr2\" (UniqueName: \"kubernetes.io/projected/c62d575d-9d6b-497a-963e-b151fb4c8d09-kube-api-access-jbzr2\") pod \"kuadrant-operator-controller-manager-58fc56757c-xsl6g\" (UID: \"c62d575d-9d6b-497a-963e-b151fb4c8d09\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xsl6g"
Sep 08 04:08:31.413359 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:31.413244    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c62d575d-9d6b-497a-963e-b151fb4c8d09-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-xsl6g\" (UID: \"c62d575d-9d6b-497a-963e-b151fb4c8d09\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xsl6g"
Sep 08 04:08:31.513923 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:31.513900    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbzr2\" (UniqueName: \"kubernetes.io/projected/c62d575d-9d6b-497a-963e-b151fb4c8d09-kube-api-access-jbzr2\") pod \"kuadrant-operator-controller-manager-58fc56757c-xsl6g\" (UID: \"c62d575d-9d6b-497a-963e-b151fb4c8d09\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xsl6g"
Sep 08 04:08:31.514033 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:31.513935    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c62d575d-9d6b-497a-963e-b151fb4c8d09-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-xsl6g\" (UID: \"c62d575d-9d6b-497a-963e-b151fb4c8d09\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xsl6g"
Sep 08 04:08:31.514317 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:31.514301    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c62d575d-9d6b-497a-963e-b151fb4c8d09-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-xsl6g\" (UID: \"c62d575d-9d6b-497a-963e-b151fb4c8d09\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xsl6g"
Sep 08 04:08:31.522588 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:31.522545    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbzr2\" (UniqueName: \"kubernetes.io/projected/c62d575d-9d6b-497a-963e-b151fb4c8d09-kube-api-access-jbzr2\") pod \"kuadrant-operator-controller-manager-58fc56757c-xsl6g\" (UID: \"c62d575d-9d6b-497a-963e-b151fb4c8d09\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xsl6g"
Sep 08 04:08:31.556537 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:31.556514    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xsl6g"
Sep 08 04:08:31.842846 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:31.842825    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xsl6g"]
Sep 08 04:08:31.845489 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:08:31.845461    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc62d575d_9d6b_497a_963e_b151fb4c8d09.slice/crio-4eb94b07ba74d33438b167efe112d94081af8216835a8859df2f589185b554f8 WatchSource:0}: Error finding container 4eb94b07ba74d33438b167efe112d94081af8216835a8859df2f589185b554f8: Status 404 returned error can't find the container with id 4eb94b07ba74d33438b167efe112d94081af8216835a8859df2f589185b554f8
Sep 08 04:08:31.884929 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:31.884892    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xsl6g" event={"ID":"c62d575d-9d6b-497a-963e-b151fb4c8d09","Type":"ContainerStarted","Data":"4eb94b07ba74d33438b167efe112d94081af8216835a8859df2f589185b554f8"}
Sep 08 04:08:33.680935 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:33.680902    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-r7jjq"]
Sep 08 04:08:33.684340 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:33.684309    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-r7jjq"
Sep 08 04:08:33.686995 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:33.686973    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-2kz94\""
Sep 08 04:08:33.701456 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:33.701432    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-r7jjq"]
Sep 08 04:08:33.837483 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:33.837451    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdzv7\" (UniqueName: \"kubernetes.io/projected/23c969cb-5c41-4f0d-ac5f-fcc42cfbde2a-kube-api-access-qdzv7\") pod \"authorino-operator-68d88948d8-r7jjq\" (UID: \"23c969cb-5c41-4f0d-ac5f-fcc42cfbde2a\") " pod="kuadrant-system/authorino-operator-68d88948d8-r7jjq"
Sep 08 04:08:33.937993 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:33.937912    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdzv7\" (UniqueName: \"kubernetes.io/projected/23c969cb-5c41-4f0d-ac5f-fcc42cfbde2a-kube-api-access-qdzv7\") pod \"authorino-operator-68d88948d8-r7jjq\" (UID: \"23c969cb-5c41-4f0d-ac5f-fcc42cfbde2a\") " pod="kuadrant-system/authorino-operator-68d88948d8-r7jjq"
Sep 08 04:08:33.948377 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:33.948346    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdzv7\" (UniqueName: \"kubernetes.io/projected/23c969cb-5c41-4f0d-ac5f-fcc42cfbde2a-kube-api-access-qdzv7\") pod \"authorino-operator-68d88948d8-r7jjq\" (UID: \"23c969cb-5c41-4f0d-ac5f-fcc42cfbde2a\") " pod="kuadrant-system/authorino-operator-68d88948d8-r7jjq"
Sep 08 04:08:33.998463 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:33.998421    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-r7jjq"
Sep 08 04:08:34.286524 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:34.286495    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-r7jjq"]
Sep 08 04:08:34.287824 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:08:34.287787    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23c969cb_5c41_4f0d_ac5f_fcc42cfbde2a.slice/crio-e1eb8c3c840a29351d7e9612a89e480ec5a00c9022bb749c283696f0a655debc WatchSource:0}: Error finding container e1eb8c3c840a29351d7e9612a89e480ec5a00c9022bb749c283696f0a655debc: Status 404 returned error can't find the container with id e1eb8c3c840a29351d7e9612a89e480ec5a00c9022bb749c283696f0a655debc
Sep 08 04:08:34.903256 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:34.903220    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-r7jjq" event={"ID":"23c969cb-5c41-4f0d-ac5f-fcc42cfbde2a","Type":"ContainerStarted","Data":"e1eb8c3c840a29351d7e9612a89e480ec5a00c9022bb749c283696f0a655debc"}
Sep 08 04:08:36.915257 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:36.915233    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xsl6g" event={"ID":"c62d575d-9d6b-497a-963e-b151fb4c8d09","Type":"ContainerStarted","Data":"3d4d16217fa7ebdf0d734c83c44ab66a8e10adb55dba3b66b5b2c955498b7e00"}
Sep 08 04:08:36.915530 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:36.915312    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xsl6g"
Sep 08 04:08:36.939520 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:36.939475    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xsl6g" podStartSLOduration=1.6734045910000002 podStartE2EDuration="5.939458483s" totalImagesPullingTime="4.266053892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:08:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:08:36.937962174 +0000 UTC m=+476.723253410" watchObservedRunningTime="2026-09-08 04:08:36.939458483 +0000 UTC m=+476.724749718"
Sep 08 04:08:37.922278 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:37.922231    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-r7jjq" event={"ID":"23c969cb-5c41-4f0d-ac5f-fcc42cfbde2a","Type":"ContainerStarted","Data":"9f2926c7073652f6f9ae406b279965c76ee0847d211484ee9fcc1e15a433e797"}
Sep 08 04:08:37.922768 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:37.922336    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-r7jjq"
Sep 08 04:08:37.940675 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:37.940626    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-r7jjq" podStartSLOduration=2.350757745 podStartE2EDuration="4.940610809s" totalImagesPullingTime="2.589853064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:08:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:08:37.93876116 +0000 UTC m=+477.724052396" watchObservedRunningTime="2026-09-08 04:08:37.940610809 +0000 UTC m=+477.725902045"
Sep 08 04:08:39.869645 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:39.869610    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-89x5g"
Sep 08 04:08:41.887119 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:41.887088    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2cx5k"
Sep 08 04:08:47.924985 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:47.924955    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xsl6g"
Sep 08 04:08:48.930513 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:48.930485    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-r7jjq"
Sep 08 04:08:49.045968 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:49.045937    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cb2xp"]
Sep 08 04:08:49.049675 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:49.049660    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cb2xp"
Sep 08 04:08:49.062878 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:49.062849    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cb2xp"]
Sep 08 04:08:49.063007 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:49.062985    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xt9k\" (UniqueName: \"kubernetes.io/projected/f9fac442-114e-465b-aaa9-b9a612bd2623-kube-api-access-5xt9k\") pod \"kuadrant-operator-controller-manager-6bd956ccf-cb2xp\" (UID: \"f9fac442-114e-465b-aaa9-b9a612bd2623\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cb2xp"
Sep 08 04:08:49.063142 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:49.063126    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9fac442-114e-465b-aaa9-b9a612bd2623-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-cb2xp\" (UID: \"f9fac442-114e-465b-aaa9-b9a612bd2623\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cb2xp"
Sep 08 04:08:49.164145 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:49.164107    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9fac442-114e-465b-aaa9-b9a612bd2623-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-cb2xp\" (UID: \"f9fac442-114e-465b-aaa9-b9a612bd2623\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cb2xp"
Sep 08 04:08:49.164300 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:49.164181    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xt9k\" (UniqueName: \"kubernetes.io/projected/f9fac442-114e-465b-aaa9-b9a612bd2623-kube-api-access-5xt9k\") pod \"kuadrant-operator-controller-manager-6bd956ccf-cb2xp\" (UID: \"f9fac442-114e-465b-aaa9-b9a612bd2623\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cb2xp"
Sep 08 04:08:49.164441 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:49.164409    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9fac442-114e-465b-aaa9-b9a612bd2623-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-cb2xp\" (UID: \"f9fac442-114e-465b-aaa9-b9a612bd2623\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cb2xp"
Sep 08 04:08:49.173173 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:49.173145    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xt9k\" (UniqueName: \"kubernetes.io/projected/f9fac442-114e-465b-aaa9-b9a612bd2623-kube-api-access-5xt9k\") pod \"kuadrant-operator-controller-manager-6bd956ccf-cb2xp\" (UID: \"f9fac442-114e-465b-aaa9-b9a612bd2623\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cb2xp"
Sep 08 04:08:49.359515 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:49.359480    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cb2xp"
Sep 08 04:08:49.645307 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:49.645281    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cb2xp"]
Sep 08 04:08:49.647887 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:08:49.647863    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9fac442_114e_465b_aaa9_b9a612bd2623.slice/crio-9995b66756191098620815c4f7a654b73ddb1a372cee6a510105aa1293540e9d WatchSource:0}: Error finding container 9995b66756191098620815c4f7a654b73ddb1a372cee6a510105aa1293540e9d: Status 404 returned error can't find the container with id 9995b66756191098620815c4f7a654b73ddb1a372cee6a510105aa1293540e9d
Sep 08 04:08:49.960681 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:49.960606    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xsl6g"]
Sep 08 04:08:49.961127 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:49.960812    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xsl6g" podUID="c62d575d-9d6b-497a-963e-b151fb4c8d09" containerName="manager" containerID="cri-o://3d4d16217fa7ebdf0d734c83c44ab66a8e10adb55dba3b66b5b2c955498b7e00" gracePeriod=2
Sep 08 04:08:49.974634 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:49.974612    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xsl6g"]
Sep 08 04:08:49.991234 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:49.991187    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cb2xp" event={"ID":"f9fac442-114e-465b-aaa9-b9a612bd2623","Type":"ContainerStarted","Data":"df5de7a32d7f82e2084ebb2453d601d733a953a03be0d62293592a2d9e5c7028"}
Sep 08 04:08:49.991416 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:49.991248    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cb2xp" event={"ID":"f9fac442-114e-465b-aaa9-b9a612bd2623","Type":"ContainerStarted","Data":"9995b66756191098620815c4f7a654b73ddb1a372cee6a510105aa1293540e9d"}
Sep 08 04:08:49.991416 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:49.991379    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cb2xp"
Sep 08 04:08:49.994004 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:49.993981    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cb2xp"]
Sep 08 04:08:50.021142 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.021106    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cpqmd"]
Sep 08 04:08:50.021710 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.021689    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c62d575d-9d6b-497a-963e-b151fb4c8d09" containerName="manager"
Sep 08 04:08:50.021710 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.021710    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c62d575d-9d6b-497a-963e-b151fb4c8d09" containerName="manager"
Sep 08 04:08:50.021868 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.021843    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c62d575d-9d6b-497a-963e-b151fb4c8d09" containerName="manager"
Sep 08 04:08:50.024973 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.024945    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cpqmd"
Sep 08 04:08:50.032794 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.032775    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cb2xp"]
Sep 08 04:08:50.041042 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:08:50.041000    2573 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f9fac442-114e-465b-aaa9-b9a612bd2623\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"200m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://df5de7a32d7f82e2084ebb2453d601d733a953a03be0d62293592a2d9e5c7028\\\",\\\"image\\\":\\\"registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:8c2d9a84169e86454e4fb3df6f4846c5c5495d19b01137b6e78e113161981e47\\\",\\\"imageID\\\":\\\"registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:3c2960333b4e980e8f34e9089e26f8d62ec6fbbfcd89f29e3577ad4244d663a6\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"manager\\\",\\\"ready\\\":false,\\\"resources\\\":{\\\"limits\\\":{\\\"cpu\\\":\\\"200m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"requests\\\":{\\\"cpu\\\":\\\"200m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-08T04:08:49Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000690000],\\\"uid\\\":1000690000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp/kuadrant\\\",\\\"name\\\":\\\"extensions-socket-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-5xt9k\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"10.134.0.34\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"10.134.0.34\\\"}]}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-6bd956ccf-cb2xp\": pods \"kuadrant-operator-controller-manager-6bd956ccf-cb2xp\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cb2xp"
Sep 08 04:08:50.045516 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:08:50.045493    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-xsl6g\" is forbidden: User \"system:node:ip-10-0-143-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-35.ec2.internal' and this object" podUID="c62d575d-9d6b-497a-963e-b151fb4c8d09" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xsl6g"
Sep 08 04:08:50.049885 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:08:50.049859    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-xsl6g\" is forbidden: User \"system:node:ip-10-0-143-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-35.ec2.internal' and this object" podUID="c62d575d-9d6b-497a-963e-b151fb4c8d09" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xsl6g"
Sep 08 04:08:50.052639 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:08:50.052615    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-cb2xp\" is forbidden: User \"system:node:ip-10-0-143-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-35.ec2.internal' and this object" podUID="f9fac442-114e-465b-aaa9-b9a612bd2623" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cb2xp"
Sep 08 04:08:50.054943 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.054925    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cpqmd"]
Sep 08 04:08:50.058769 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.058747    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mdkjh"]
Sep 08 04:08:50.059243 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.059222    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9fac442-114e-465b-aaa9-b9a612bd2623" containerName="manager"
Sep 08 04:08:50.059351 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.059247    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9fac442-114e-465b-aaa9-b9a612bd2623" containerName="manager"
Sep 08 04:08:50.059417 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.059370    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9fac442-114e-465b-aaa9-b9a612bd2623" containerName="manager"
Sep 08 04:08:50.063267 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.063248    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2cx5k"]
Sep 08 04:08:50.063433 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.063414    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mdkjh"
Sep 08 04:08:50.063502 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.063431    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2cx5k" podUID="7c4ef623-897a-4f4f-94dd-d0bd2a9a8cfc" containerName="manager" containerID="cri-o://c2f525ccef323976973b765451fe9a7f71baafc5d6fe3c9555bf1c811b00c6a3" gracePeriod=2
Sep 08 04:08:50.072384 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.072354    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e347d1b4-2e50-47ae-ad2b-af6dee622608-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-cpqmd\" (UID: \"e347d1b4-2e50-47ae-ad2b-af6dee622608\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cpqmd"
Sep 08 04:08:50.072497 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.072431    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj8lh\" (UniqueName: \"kubernetes.io/projected/e347d1b4-2e50-47ae-ad2b-af6dee622608-kube-api-access-bj8lh\") pod \"kuadrant-operator-controller-manager-58fc56757c-cpqmd\" (UID: \"e347d1b4-2e50-47ae-ad2b-af6dee622608\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cpqmd"
Sep 08 04:08:50.080127 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.079904    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2cx5k"]
Sep 08 04:08:50.100233 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.100191    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mdkjh"]
Sep 08 04:08:50.102872 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.102829    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-g2nbs"]
Sep 08 04:08:50.103588 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.103526    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c4ef623-897a-4f4f-94dd-d0bd2a9a8cfc" containerName="manager"
Sep 08 04:08:50.103588 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.103587    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c4ef623-897a-4f4f-94dd-d0bd2a9a8cfc" containerName="manager"
Sep 08 04:08:50.103761 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:08:50.103671    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-xsl6g\" is forbidden: User \"system:node:ip-10-0-143-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-35.ec2.internal' and this object" podUID="c62d575d-9d6b-497a-963e-b151fb4c8d09" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xsl6g"
Sep 08 04:08:50.103761 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.103730    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c4ef623-897a-4f4f-94dd-d0bd2a9a8cfc" containerName="manager"
Sep 08 04:08:50.107212 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.107189    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-g2nbs"
Sep 08 04:08:50.127895 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.127863    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-g2nbs"]
Sep 08 04:08:50.142500 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:08:50.142463    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-2cx5k\" is forbidden: User \"system:node:ip-10-0-143-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-35.ec2.internal' and this object" podUID="7c4ef623-897a-4f4f-94dd-d0bd2a9a8cfc" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2cx5k"
Sep 08 04:08:50.144576 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:08:50.144527    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-cb2xp\" is forbidden: User \"system:node:ip-10-0-143-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-35.ec2.internal' and this object" podUID="f9fac442-114e-465b-aaa9-b9a612bd2623" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cb2xp"
Sep 08 04:08:50.147740 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:08:50.147718    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-cb2xp\" is forbidden: User \"system:node:ip-10-0-143-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-35.ec2.internal' and this object" podUID="f9fac442-114e-465b-aaa9-b9a612bd2623" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cb2xp"
Sep 08 04:08:50.150462 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:08:50.150426    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-xsl6g\" is forbidden: User \"system:node:ip-10-0-143-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-35.ec2.internal' and this object" podUID="c62d575d-9d6b-497a-963e-b151fb4c8d09" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xsl6g"
Sep 08 04:08:50.173764 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.173740    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sgtd\" (UniqueName: \"kubernetes.io/projected/65130749-a3a2-4a31-aa32-91123d34dfbc-kube-api-access-8sgtd\") pod \"kuadrant-operator-controller-manager-6bd956ccf-mdkjh\" (UID: \"65130749-a3a2-4a31-aa32-91123d34dfbc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mdkjh"
Sep 08 04:08:50.173886 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.173806    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtvj5\" (UniqueName: \"kubernetes.io/projected/cb3f218f-d35e-4265-85a7-002a8e710741-kube-api-access-wtvj5\") pod \"limitador-operator-controller-manager-6c549b6d85-g2nbs\" (UID: \"cb3f218f-d35e-4265-85a7-002a8e710741\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-g2nbs"
Sep 08 04:08:50.173886 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.173855    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/65130749-a3a2-4a31-aa32-91123d34dfbc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-mdkjh\" (UID: \"65130749-a3a2-4a31-aa32-91123d34dfbc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mdkjh"
Sep 08 04:08:50.173995 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.173886    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e347d1b4-2e50-47ae-ad2b-af6dee622608-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-cpqmd\" (UID: \"e347d1b4-2e50-47ae-ad2b-af6dee622608\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cpqmd"
Sep 08 04:08:50.173995 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.173934    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bj8lh\" (UniqueName: \"kubernetes.io/projected/e347d1b4-2e50-47ae-ad2b-af6dee622608-kube-api-access-bj8lh\") pod \"kuadrant-operator-controller-manager-58fc56757c-cpqmd\" (UID: \"e347d1b4-2e50-47ae-ad2b-af6dee622608\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cpqmd"
Sep 08 04:08:50.174223 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.174189    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e347d1b4-2e50-47ae-ad2b-af6dee622608-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-cpqmd\" (UID: \"e347d1b4-2e50-47ae-ad2b-af6dee622608\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cpqmd"
Sep 08 04:08:50.189703 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.189653    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj8lh\" (UniqueName: \"kubernetes.io/projected/e347d1b4-2e50-47ae-ad2b-af6dee622608-kube-api-access-bj8lh\") pod \"kuadrant-operator-controller-manager-58fc56757c-cpqmd\" (UID: \"e347d1b4-2e50-47ae-ad2b-af6dee622608\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cpqmd"
Sep 08 04:08:50.209182 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:08:50.209137    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-2cx5k\" is forbidden: User \"system:node:ip-10-0-143-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-35.ec2.internal' and this object" podUID="7c4ef623-897a-4f4f-94dd-d0bd2a9a8cfc" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2cx5k"
Sep 08 04:08:50.236603 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.232915    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xsl6g"
Sep 08 04:08:50.236900 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:08:50.236725    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-xsl6g\" is forbidden: User \"system:node:ip-10-0-143-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-35.ec2.internal' and this object" podUID="c62d575d-9d6b-497a-963e-b151fb4c8d09" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xsl6g"
Sep 08 04:08:50.246579 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:08:50.245765    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-2cx5k\" is forbidden: User \"system:node:ip-10-0-143-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-35.ec2.internal' and this object" podUID="7c4ef623-897a-4f4f-94dd-d0bd2a9a8cfc" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2cx5k"
Sep 08 04:08:50.250770 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:08:50.250739    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-cb2xp\" is forbidden: User \"system:node:ip-10-0-143-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-35.ec2.internal' and this object" podUID="f9fac442-114e-465b-aaa9-b9a612bd2623" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cb2xp"
Sep 08 04:08:50.276925 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.275800    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbzr2\" (UniqueName: \"kubernetes.io/projected/c62d575d-9d6b-497a-963e-b151fb4c8d09-kube-api-access-jbzr2\") pod \"c62d575d-9d6b-497a-963e-b151fb4c8d09\" (UID: \"c62d575d-9d6b-497a-963e-b151fb4c8d09\") "
Sep 08 04:08:50.276925 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.275891    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c62d575d-9d6b-497a-963e-b151fb4c8d09-extensions-socket-volume\") pod \"c62d575d-9d6b-497a-963e-b151fb4c8d09\" (UID: \"c62d575d-9d6b-497a-963e-b151fb4c8d09\") "
Sep 08 04:08:50.276925 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.276130    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sgtd\" (UniqueName: \"kubernetes.io/projected/65130749-a3a2-4a31-aa32-91123d34dfbc-kube-api-access-8sgtd\") pod \"kuadrant-operator-controller-manager-6bd956ccf-mdkjh\" (UID: \"65130749-a3a2-4a31-aa32-91123d34dfbc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mdkjh"
Sep 08 04:08:50.276925 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.276198    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtvj5\" (UniqueName: \"kubernetes.io/projected/cb3f218f-d35e-4265-85a7-002a8e710741-kube-api-access-wtvj5\") pod \"limitador-operator-controller-manager-6c549b6d85-g2nbs\" (UID: \"cb3f218f-d35e-4265-85a7-002a8e710741\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-g2nbs"
Sep 08 04:08:50.276925 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.276224    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/65130749-a3a2-4a31-aa32-91123d34dfbc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-mdkjh\" (UID: \"65130749-a3a2-4a31-aa32-91123d34dfbc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mdkjh"
Sep 08 04:08:50.276925 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.276631    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/65130749-a3a2-4a31-aa32-91123d34dfbc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-mdkjh\" (UID: \"65130749-a3a2-4a31-aa32-91123d34dfbc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mdkjh"
Sep 08 04:08:50.278112 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.278089    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c62d575d-9d6b-497a-963e-b151fb4c8d09-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c62d575d-9d6b-497a-963e-b151fb4c8d09" (UID: "c62d575d-9d6b-497a-963e-b151fb4c8d09"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:08:50.285434 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.285405    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c62d575d-9d6b-497a-963e-b151fb4c8d09-kube-api-access-jbzr2" (OuterVolumeSpecName: "kube-api-access-jbzr2") pod "c62d575d-9d6b-497a-963e-b151fb4c8d09" (UID: "c62d575d-9d6b-497a-963e-b151fb4c8d09"). InnerVolumeSpecName "kube-api-access-jbzr2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:08:50.300238 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.300205    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtvj5\" (UniqueName: \"kubernetes.io/projected/cb3f218f-d35e-4265-85a7-002a8e710741-kube-api-access-wtvj5\") pod \"limitador-operator-controller-manager-6c549b6d85-g2nbs\" (UID: \"cb3f218f-d35e-4265-85a7-002a8e710741\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-g2nbs"
Sep 08 04:08:50.300351 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.300264    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sgtd\" (UniqueName: \"kubernetes.io/projected/65130749-a3a2-4a31-aa32-91123d34dfbc-kube-api-access-8sgtd\") pod \"kuadrant-operator-controller-manager-6bd956ccf-mdkjh\" (UID: \"65130749-a3a2-4a31-aa32-91123d34dfbc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mdkjh"
Sep 08 04:08:50.339023 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.339001    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cpqmd"
Sep 08 04:08:50.341078 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.341065    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2cx5k"
Sep 08 04:08:50.343348 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:08:50.343324    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-xsl6g\" is forbidden: User \"system:node:ip-10-0-143-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-35.ec2.internal' and this object" podUID="c62d575d-9d6b-497a-963e-b151fb4c8d09" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xsl6g"
Sep 08 04:08:50.345399 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:08:50.345378    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-2cx5k\" is forbidden: User \"system:node:ip-10-0-143-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-35.ec2.internal' and this object" podUID="7c4ef623-897a-4f4f-94dd-d0bd2a9a8cfc" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2cx5k"
Sep 08 04:08:50.347393 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:08:50.347368    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-cb2xp\" is forbidden: User \"system:node:ip-10-0-143-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-35.ec2.internal' and this object" podUID="f9fac442-114e-465b-aaa9-b9a612bd2623" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cb2xp"
Sep 08 04:08:50.377587 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.377546    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84ncm\" (UniqueName: \"kubernetes.io/projected/7c4ef623-897a-4f4f-94dd-d0bd2a9a8cfc-kube-api-access-84ncm\") pod \"7c4ef623-897a-4f4f-94dd-d0bd2a9a8cfc\" (UID: \"7c4ef623-897a-4f4f-94dd-d0bd2a9a8cfc\") "
Sep 08 04:08:50.377858 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.377833    2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c62d575d-9d6b-497a-963e-b151fb4c8d09-extensions-socket-volume\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:08:50.377858 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.377860    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbzr2\" (UniqueName: \"kubernetes.io/projected/c62d575d-9d6b-497a-963e-b151fb4c8d09-kube-api-access-jbzr2\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:08:50.380222 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.379443    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mdkjh"
Sep 08 04:08:50.380342 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.380224    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c4ef623-897a-4f4f-94dd-d0bd2a9a8cfc-kube-api-access-84ncm" (OuterVolumeSpecName: "kube-api-access-84ncm") pod "7c4ef623-897a-4f4f-94dd-d0bd2a9a8cfc" (UID: "7c4ef623-897a-4f4f-94dd-d0bd2a9a8cfc"). InnerVolumeSpecName "kube-api-access-84ncm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:08:50.435877 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.435847    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-g2nbs"
Sep 08 04:08:50.478510 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.478430    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84ncm\" (UniqueName: \"kubernetes.io/projected/7c4ef623-897a-4f4f-94dd-d0bd2a9a8cfc-kube-api-access-84ncm\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:08:50.627119 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.627096    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cpqmd"]
Sep 08 04:08:50.629336 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:08:50.629308    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode347d1b4_2e50_47ae_ad2b_af6dee622608.slice/crio-b2dc6309d0bfa347dea4f19a6b0425c9024a836be232fd78873bc62690808d9c WatchSource:0}: Error finding container b2dc6309d0bfa347dea4f19a6b0425c9024a836be232fd78873bc62690808d9c: Status 404 returned error can't find the container with id b2dc6309d0bfa347dea4f19a6b0425c9024a836be232fd78873bc62690808d9c
Sep 08 04:08:50.672587 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:08:50.672538    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-xsl6g\" is forbidden: User \"system:node:ip-10-0-143-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-35.ec2.internal' and this object" podUID="c62d575d-9d6b-497a-963e-b151fb4c8d09" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xsl6g"
Sep 08 04:08:50.674382 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:08:50.674361    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-2cx5k\" is forbidden: User \"system:node:ip-10-0-143-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-35.ec2.internal' and this object" podUID="7c4ef623-897a-4f4f-94dd-d0bd2a9a8cfc" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2cx5k"
Sep 08 04:08:50.674946 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.674924    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c4ef623-897a-4f4f-94dd-d0bd2a9a8cfc" path="/var/lib/kubelet/pods/7c4ef623-897a-4f4f-94dd-d0bd2a9a8cfc/volumes"
Sep 08 04:08:50.675419 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.675402    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c62d575d-9d6b-497a-963e-b151fb4c8d09" path="/var/lib/kubelet/pods/c62d575d-9d6b-497a-963e-b151fb4c8d09/volumes"
Sep 08 04:08:50.676257 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:08:50.676230    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-cb2xp\" is forbidden: User \"system:node:ip-10-0-143-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-35.ec2.internal' and this object" podUID="f9fac442-114e-465b-aaa9-b9a612bd2623" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cb2xp"
Sep 08 04:08:50.687788 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.687769    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mdkjh"]
Sep 08 04:08:50.702032 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:08:50.702011    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65130749_a3a2_4a31_aa32_91123d34dfbc.slice/crio-513ecb79e5674262aad2f393384971d0c3fff84ccb12382bfaebeafa024dcc3e WatchSource:0}: Error finding container 513ecb79e5674262aad2f393384971d0c3fff84ccb12382bfaebeafa024dcc3e: Status 404 returned error can't find the container with id 513ecb79e5674262aad2f393384971d0c3fff84ccb12382bfaebeafa024dcc3e
Sep 08 04:08:50.738642 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.738615    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-g2nbs"]
Sep 08 04:08:50.739989 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:08:50.739965    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb3f218f_d35e_4265_85a7_002a8e710741.slice/crio-21b06f1af1f8f1051bd500c9e3f90395800a18d7835db923548b3a5eb4c7f305 WatchSource:0}: Error finding container 21b06f1af1f8f1051bd500c9e3f90395800a18d7835db923548b3a5eb4c7f305: Status 404 returned error can't find the container with id 21b06f1af1f8f1051bd500c9e3f90395800a18d7835db923548b3a5eb4c7f305
Sep 08 04:08:50.999356 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.999318    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mdkjh" event={"ID":"65130749-a3a2-4a31-aa32-91123d34dfbc","Type":"ContainerStarted","Data":"72d9a3af7120d58050f0ab8f7673ed14a5bc96b7fa70126233de381188ad8ccc"}
Sep 08 04:08:50.999807 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.999415    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mdkjh" event={"ID":"65130749-a3a2-4a31-aa32-91123d34dfbc","Type":"ContainerStarted","Data":"513ecb79e5674262aad2f393384971d0c3fff84ccb12382bfaebeafa024dcc3e"}
Sep 08 04:08:50.999807 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:50.999470    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mdkjh"
Sep 08 04:08:51.001024 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:51.000993    2573 generic.go:356] "Generic (PLEG): container finished" podID="7c4ef623-897a-4f4f-94dd-d0bd2a9a8cfc" containerID="c2f525ccef323976973b765451fe9a7f71baafc5d6fe3c9555bf1c811b00c6a3" exitCode=0
Sep 08 04:08:51.001182 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:51.001035    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2cx5k"
Sep 08 04:08:51.001182 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:51.001075    2573 scope.go:117] "RemoveContainer" containerID="c2f525ccef323976973b765451fe9a7f71baafc5d6fe3c9555bf1c811b00c6a3"
Sep 08 04:08:51.003271 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:51.003250    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-g2nbs" event={"ID":"cb3f218f-d35e-4265-85a7-002a8e710741","Type":"ContainerStarted","Data":"0d7310361cc1ac5a91519efb2750d73f2bc5267bd65b63bd30e8e251552734bd"}
Sep 08 04:08:51.003373 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:51.003292    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-g2nbs" event={"ID":"cb3f218f-d35e-4265-85a7-002a8e710741","Type":"ContainerStarted","Data":"21b06f1af1f8f1051bd500c9e3f90395800a18d7835db923548b3a5eb4c7f305"}
Sep 08 04:08:51.003373 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:51.003323    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-g2nbs"
Sep 08 04:08:51.004879 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:51.004857    2573 generic.go:356] "Generic (PLEG): container finished" podID="c62d575d-9d6b-497a-963e-b151fb4c8d09" containerID="3d4d16217fa7ebdf0d734c83c44ab66a8e10adb55dba3b66b5b2c955498b7e00" exitCode=0
Sep 08 04:08:51.004971 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:51.004913    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xsl6g"
Sep 08 04:08:51.006786 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:51.006761    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cpqmd" event={"ID":"e347d1b4-2e50-47ae-ad2b-af6dee622608","Type":"ContainerStarted","Data":"acd94420f4d2f815fb4cde67e473680f155ec628e06cbc5d5e1145f99b58b0e8"}
Sep 08 04:08:51.006877 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:51.006807    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cpqmd" event={"ID":"e347d1b4-2e50-47ae-ad2b-af6dee622608","Type":"ContainerStarted","Data":"b2dc6309d0bfa347dea4f19a6b0425c9024a836be232fd78873bc62690808d9c"}
Sep 08 04:08:51.006951 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:08:51.006937    2573 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cb2xp" container="manager"
Sep 08 04:08:51.007012 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:51.006972    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cpqmd"
Sep 08 04:08:51.011138 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:51.011122    2573 scope.go:117] "RemoveContainer" containerID="c2f525ccef323976973b765451fe9a7f71baafc5d6fe3c9555bf1c811b00c6a3"
Sep 08 04:08:51.011434 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:08:51.011410    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2f525ccef323976973b765451fe9a7f71baafc5d6fe3c9555bf1c811b00c6a3\": container with ID starting with c2f525ccef323976973b765451fe9a7f71baafc5d6fe3c9555bf1c811b00c6a3 not found: ID does not exist" containerID="c2f525ccef323976973b765451fe9a7f71baafc5d6fe3c9555bf1c811b00c6a3"
Sep 08 04:08:51.011497 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:51.011445    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2f525ccef323976973b765451fe9a7f71baafc5d6fe3c9555bf1c811b00c6a3"} err="failed to get container status \"c2f525ccef323976973b765451fe9a7f71baafc5d6fe3c9555bf1c811b00c6a3\": rpc error: code = NotFound desc = could not find container \"c2f525ccef323976973b765451fe9a7f71baafc5d6fe3c9555bf1c811b00c6a3\": container with ID starting with c2f525ccef323976973b765451fe9a7f71baafc5d6fe3c9555bf1c811b00c6a3 not found: ID does not exist"
Sep 08 04:08:51.011497 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:51.011466    2573 scope.go:117] "RemoveContainer" containerID="3d4d16217fa7ebdf0d734c83c44ab66a8e10adb55dba3b66b5b2c955498b7e00"
Sep 08 04:08:51.020648 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:51.020618    2573 scope.go:117] "RemoveContainer" containerID="3d4d16217fa7ebdf0d734c83c44ab66a8e10adb55dba3b66b5b2c955498b7e00"
Sep 08 04:08:51.020886 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:08:51.020870    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d4d16217fa7ebdf0d734c83c44ab66a8e10adb55dba3b66b5b2c955498b7e00\": container with ID starting with 3d4d16217fa7ebdf0d734c83c44ab66a8e10adb55dba3b66b5b2c955498b7e00 not found: ID does not exist" containerID="3d4d16217fa7ebdf0d734c83c44ab66a8e10adb55dba3b66b5b2c955498b7e00"
Sep 08 04:08:51.020945 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:51.020891    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d4d16217fa7ebdf0d734c83c44ab66a8e10adb55dba3b66b5b2c955498b7e00"} err="failed to get container status \"3d4d16217fa7ebdf0d734c83c44ab66a8e10adb55dba3b66b5b2c955498b7e00\": rpc error: code = NotFound desc = could not find container \"3d4d16217fa7ebdf0d734c83c44ab66a8e10adb55dba3b66b5b2c955498b7e00\": container with ID starting with 3d4d16217fa7ebdf0d734c83c44ab66a8e10adb55dba3b66b5b2c955498b7e00 not found: ID does not exist"
Sep 08 04:08:51.050370 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:51.050333    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mdkjh" podStartSLOduration=1.050320721 podStartE2EDuration="1.050320721s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:08:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:08:51.049508205 +0000 UTC m=+490.834799443" watchObservedRunningTime="2026-09-08 04:08:51.050320721 +0000 UTC m=+490.835611956"
Sep 08 04:08:51.074508 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:51.074466    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-g2nbs" podStartSLOduration=1.074451764 podStartE2EDuration="1.074451764s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:08:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:08:51.073374988 +0000 UTC m=+490.858666224" watchObservedRunningTime="2026-09-08 04:08:51.074451764 +0000 UTC m=+490.859742992"
Sep 08 04:08:51.107716 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:51.107669    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cpqmd" podStartSLOduration=2.107653188 podStartE2EDuration="2.107653188s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:08:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:08:51.107537025 +0000 UTC m=+490.892828260" watchObservedRunningTime="2026-09-08 04:08:51.107653188 +0000 UTC m=+490.892944424"
Sep 08 04:08:52.016221 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:52.016182    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cb2xp" podUID="f9fac442-114e-465b-aaa9-b9a612bd2623" containerName="manager" containerID="cri-o://df5de7a32d7f82e2084ebb2453d601d733a953a03be0d62293592a2d9e5c7028" gracePeriod=2
Sep 08 04:08:52.018411 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:08:52.018386    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-cb2xp\" is forbidden: User \"system:node:ip-10-0-143-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-35.ec2.internal' and this object" podUID="f9fac442-114e-465b-aaa9-b9a612bd2623" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cb2xp"
Sep 08 04:08:52.271089 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:52.271020    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cb2xp"
Sep 08 04:08:52.273946 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:08:52.273916    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-cb2xp\" is forbidden: User \"system:node:ip-10-0-143-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-35.ec2.internal' and this object" podUID="f9fac442-114e-465b-aaa9-b9a612bd2623" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cb2xp"
Sep 08 04:08:52.293832 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:52.293807    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5xt9k\" (UniqueName: \"kubernetes.io/projected/f9fac442-114e-465b-aaa9-b9a612bd2623-kube-api-access-5xt9k\") pod \"f9fac442-114e-465b-aaa9-b9a612bd2623\" (UID: \"f9fac442-114e-465b-aaa9-b9a612bd2623\") "
Sep 08 04:08:52.293939 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:52.293923    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9fac442-114e-465b-aaa9-b9a612bd2623-extensions-socket-volume\") pod \"f9fac442-114e-465b-aaa9-b9a612bd2623\" (UID: \"f9fac442-114e-465b-aaa9-b9a612bd2623\") "
Sep 08 04:08:52.294272 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:52.294251    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9fac442-114e-465b-aaa9-b9a612bd2623-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f9fac442-114e-465b-aaa9-b9a612bd2623" (UID: "f9fac442-114e-465b-aaa9-b9a612bd2623"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:08:52.296006 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:52.295989    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9fac442-114e-465b-aaa9-b9a612bd2623-kube-api-access-5xt9k" (OuterVolumeSpecName: "kube-api-access-5xt9k") pod "f9fac442-114e-465b-aaa9-b9a612bd2623" (UID: "f9fac442-114e-465b-aaa9-b9a612bd2623"). InnerVolumeSpecName "kube-api-access-5xt9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:08:52.395575 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:52.395508    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xt9k\" (UniqueName: \"kubernetes.io/projected/f9fac442-114e-465b-aaa9-b9a612bd2623-kube-api-access-5xt9k\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:08:52.395575 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:52.395550    2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9fac442-114e-465b-aaa9-b9a612bd2623-extensions-socket-volume\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:08:52.675107 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:52.675036    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9fac442-114e-465b-aaa9-b9a612bd2623" path="/var/lib/kubelet/pods/f9fac442-114e-465b-aaa9-b9a612bd2623/volumes"
Sep 08 04:08:53.022849 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:53.022816    2573 generic.go:356] "Generic (PLEG): container finished" podID="f9fac442-114e-465b-aaa9-b9a612bd2623" containerID="df5de7a32d7f82e2084ebb2453d601d733a953a03be0d62293592a2d9e5c7028" exitCode=0
Sep 08 04:08:53.023254 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:53.022860    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cb2xp"
Sep 08 04:08:53.023254 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:53.022871    2573 scope.go:117] "RemoveContainer" containerID="df5de7a32d7f82e2084ebb2453d601d733a953a03be0d62293592a2d9e5c7028"
Sep 08 04:08:53.031066 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:08:53.031037    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-cb2xp\" is forbidden: User \"system:node:ip-10-0-143-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-35.ec2.internal' and this object" podUID="f9fac442-114e-465b-aaa9-b9a612bd2623" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cb2xp"
Sep 08 04:08:53.031354 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:53.031337    2573 scope.go:117] "RemoveContainer" containerID="df5de7a32d7f82e2084ebb2453d601d733a953a03be0d62293592a2d9e5c7028"
Sep 08 04:08:53.031661 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:08:53.031634    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df5de7a32d7f82e2084ebb2453d601d733a953a03be0d62293592a2d9e5c7028\": container with ID starting with df5de7a32d7f82e2084ebb2453d601d733a953a03be0d62293592a2d9e5c7028 not found: ID does not exist" containerID="df5de7a32d7f82e2084ebb2453d601d733a953a03be0d62293592a2d9e5c7028"
Sep 08 04:08:53.031713 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:08:53.031662    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df5de7a32d7f82e2084ebb2453d601d733a953a03be0d62293592a2d9e5c7028"} err="failed to get container status \"df5de7a32d7f82e2084ebb2453d601d733a953a03be0d62293592a2d9e5c7028\": rpc error: code = NotFound desc = could not find container \"df5de7a32d7f82e2084ebb2453d601d733a953a03be0d62293592a2d9e5c7028\": container with ID starting with df5de7a32d7f82e2084ebb2453d601d733a953a03be0d62293592a2d9e5c7028 not found: ID does not exist"
Sep 08 04:09:02.018800 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:02.018769    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cpqmd"
Sep 08 04:09:02.019246 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:02.018837    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-g2nbs"
Sep 08 04:09:02.019246 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:02.018961    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mdkjh"
Sep 08 04:09:02.146284 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:02.146251    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cpqmd"]
Sep 08 04:09:02.146541 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:02.146488    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cpqmd" podUID="e347d1b4-2e50-47ae-ad2b-af6dee622608" containerName="manager" containerID="cri-o://acd94420f4d2f815fb4cde67e473680f155ec628e06cbc5d5e1145f99b58b0e8" gracePeriod=10
Sep 08 04:09:02.397205 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:02.397180    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cpqmd"
Sep 08 04:09:02.400221 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:02.400199    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-q6g8c"]
Sep 08 04:09:02.400604 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:02.400591    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e347d1b4-2e50-47ae-ad2b-af6dee622608" containerName="manager"
Sep 08 04:09:02.400655 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:02.400605    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e347d1b4-2e50-47ae-ad2b-af6dee622608" containerName="manager"
Sep 08 04:09:02.400698 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:02.400689    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e347d1b4-2e50-47ae-ad2b-af6dee622608" containerName="manager"
Sep 08 04:09:02.402447 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:02.402433    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-q6g8c"
Sep 08 04:09:02.427352 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:02.427319    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-q6g8c"]
Sep 08 04:09:02.480552 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:02.480522    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bj8lh\" (UniqueName: \"kubernetes.io/projected/e347d1b4-2e50-47ae-ad2b-af6dee622608-kube-api-access-bj8lh\") pod \"e347d1b4-2e50-47ae-ad2b-af6dee622608\" (UID: \"e347d1b4-2e50-47ae-ad2b-af6dee622608\") "
Sep 08 04:09:02.480716 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:02.480664    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e347d1b4-2e50-47ae-ad2b-af6dee622608-extensions-socket-volume\") pod \"e347d1b4-2e50-47ae-ad2b-af6dee622608\" (UID: \"e347d1b4-2e50-47ae-ad2b-af6dee622608\") "
Sep 08 04:09:02.480907 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:02.480884    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42ns5\" (UniqueName: \"kubernetes.io/projected/5be73652-1097-4089-9948-9fdf4b40b3ea-kube-api-access-42ns5\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-q6g8c\" (UID: \"5be73652-1097-4089-9948-9fdf4b40b3ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-q6g8c"
Sep 08 04:09:02.480991 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:02.480940    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5be73652-1097-4089-9948-9fdf4b40b3ea-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-q6g8c\" (UID: \"5be73652-1097-4089-9948-9fdf4b40b3ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-q6g8c"
Sep 08 04:09:02.481055 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:02.481023    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e347d1b4-2e50-47ae-ad2b-af6dee622608-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e347d1b4-2e50-47ae-ad2b-af6dee622608" (UID: "e347d1b4-2e50-47ae-ad2b-af6dee622608"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:09:02.482534 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:02.482512    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e347d1b4-2e50-47ae-ad2b-af6dee622608-kube-api-access-bj8lh" (OuterVolumeSpecName: "kube-api-access-bj8lh") pod "e347d1b4-2e50-47ae-ad2b-af6dee622608" (UID: "e347d1b4-2e50-47ae-ad2b-af6dee622608"). InnerVolumeSpecName "kube-api-access-bj8lh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:09:02.581819 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:02.581756    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5be73652-1097-4089-9948-9fdf4b40b3ea-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-q6g8c\" (UID: \"5be73652-1097-4089-9948-9fdf4b40b3ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-q6g8c"
Sep 08 04:09:02.581917 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:02.581845    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42ns5\" (UniqueName: \"kubernetes.io/projected/5be73652-1097-4089-9948-9fdf4b40b3ea-kube-api-access-42ns5\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-q6g8c\" (UID: \"5be73652-1097-4089-9948-9fdf4b40b3ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-q6g8c"
Sep 08 04:09:02.581917 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:02.581876    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bj8lh\" (UniqueName: \"kubernetes.io/projected/e347d1b4-2e50-47ae-ad2b-af6dee622608-kube-api-access-bj8lh\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:09:02.581917 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:02.581887    2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e347d1b4-2e50-47ae-ad2b-af6dee622608-extensions-socket-volume\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:09:02.582104 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:02.582085    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5be73652-1097-4089-9948-9fdf4b40b3ea-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-q6g8c\" (UID: \"5be73652-1097-4089-9948-9fdf4b40b3ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-q6g8c"
Sep 08 04:09:02.592431 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:02.592410    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42ns5\" (UniqueName: \"kubernetes.io/projected/5be73652-1097-4089-9948-9fdf4b40b3ea-kube-api-access-42ns5\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-q6g8c\" (UID: \"5be73652-1097-4089-9948-9fdf4b40b3ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-q6g8c"
Sep 08 04:09:02.711637 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:02.711612    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-q6g8c"
Sep 08 04:09:02.991143 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:02.991121    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-q6g8c"]
Sep 08 04:09:02.994019 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:09:02.993984    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5be73652_1097_4089_9948_9fdf4b40b3ea.slice/crio-033c509350e2dce9e58fbef9931c2e8737c26f47e4e6e91c831f9e54db09990b WatchSource:0}: Error finding container 033c509350e2dce9e58fbef9931c2e8737c26f47e4e6e91c831f9e54db09990b: Status 404 returned error can't find the container with id 033c509350e2dce9e58fbef9931c2e8737c26f47e4e6e91c831f9e54db09990b
Sep 08 04:09:03.077190 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:03.077159    2573 generic.go:356] "Generic (PLEG): container finished" podID="e347d1b4-2e50-47ae-ad2b-af6dee622608" containerID="acd94420f4d2f815fb4cde67e473680f155ec628e06cbc5d5e1145f99b58b0e8" exitCode=0
Sep 08 04:09:03.077598 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:03.077202    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cpqmd"
Sep 08 04:09:03.077598 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:03.077241    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cpqmd" event={"ID":"e347d1b4-2e50-47ae-ad2b-af6dee622608","Type":"ContainerDied","Data":"acd94420f4d2f815fb4cde67e473680f155ec628e06cbc5d5e1145f99b58b0e8"}
Sep 08 04:09:03.077598 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:03.077299    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cpqmd" event={"ID":"e347d1b4-2e50-47ae-ad2b-af6dee622608","Type":"ContainerDied","Data":"b2dc6309d0bfa347dea4f19a6b0425c9024a836be232fd78873bc62690808d9c"}
Sep 08 04:09:03.077598 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:03.077322    2573 scope.go:117] "RemoveContainer" containerID="acd94420f4d2f815fb4cde67e473680f155ec628e06cbc5d5e1145f99b58b0e8"
Sep 08 04:09:03.079211 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:03.079171    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-q6g8c" event={"ID":"5be73652-1097-4089-9948-9fdf4b40b3ea","Type":"ContainerStarted","Data":"006299855e58789195198fe02dee5daa8a92b1bf76bf95c124c206a7efed0997"}
Sep 08 04:09:03.079356 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:03.079234    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-q6g8c" event={"ID":"5be73652-1097-4089-9948-9fdf4b40b3ea","Type":"ContainerStarted","Data":"033c509350e2dce9e58fbef9931c2e8737c26f47e4e6e91c831f9e54db09990b"}
Sep 08 04:09:03.079356 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:03.079333    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-q6g8c"
Sep 08 04:09:03.086140 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:03.086109    2573 scope.go:117] "RemoveContainer" containerID="acd94420f4d2f815fb4cde67e473680f155ec628e06cbc5d5e1145f99b58b0e8"
Sep 08 04:09:03.086426 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:09:03.086407    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acd94420f4d2f815fb4cde67e473680f155ec628e06cbc5d5e1145f99b58b0e8\": container with ID starting with acd94420f4d2f815fb4cde67e473680f155ec628e06cbc5d5e1145f99b58b0e8 not found: ID does not exist" containerID="acd94420f4d2f815fb4cde67e473680f155ec628e06cbc5d5e1145f99b58b0e8"
Sep 08 04:09:03.086494 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:03.086436    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acd94420f4d2f815fb4cde67e473680f155ec628e06cbc5d5e1145f99b58b0e8"} err="failed to get container status \"acd94420f4d2f815fb4cde67e473680f155ec628e06cbc5d5e1145f99b58b0e8\": rpc error: code = NotFound desc = could not find container \"acd94420f4d2f815fb4cde67e473680f155ec628e06cbc5d5e1145f99b58b0e8\": container with ID starting with acd94420f4d2f815fb4cde67e473680f155ec628e06cbc5d5e1145f99b58b0e8 not found: ID does not exist"
Sep 08 04:09:03.105814 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:03.104945    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-q6g8c" podStartSLOduration=1.104924633 podStartE2EDuration="1.104924633s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:09:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:09:03.103830265 +0000 UTC m=+502.889121501" watchObservedRunningTime="2026-09-08 04:09:03.104924633 +0000 UTC m=+502.890215870"
Sep 08 04:09:03.135431 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:03.135401    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cpqmd"]
Sep 08 04:09:03.142569 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:03.142535    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cpqmd"]
Sep 08 04:09:04.674379 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:04.674349    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e347d1b4-2e50-47ae-ad2b-af6dee622608" path="/var/lib/kubelet/pods/e347d1b4-2e50-47ae-ad2b-af6dee622608/volumes"
Sep 08 04:09:14.089014 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:14.088974    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-q6g8c"
Sep 08 04:09:14.142288 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:14.142256    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mdkjh"]
Sep 08 04:09:14.142594 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:14.142541    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mdkjh" podUID="65130749-a3a2-4a31-aa32-91123d34dfbc" containerName="manager" containerID="cri-o://72d9a3af7120d58050f0ab8f7673ed14a5bc96b7fa70126233de381188ad8ccc" gracePeriod=10
Sep 08 04:09:14.409446 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:14.409423    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mdkjh"
Sep 08 04:09:14.486820 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:14.486790    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8sgtd\" (UniqueName: \"kubernetes.io/projected/65130749-a3a2-4a31-aa32-91123d34dfbc-kube-api-access-8sgtd\") pod \"65130749-a3a2-4a31-aa32-91123d34dfbc\" (UID: \"65130749-a3a2-4a31-aa32-91123d34dfbc\") "
Sep 08 04:09:14.486820 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:14.486821    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/65130749-a3a2-4a31-aa32-91123d34dfbc-extensions-socket-volume\") pod \"65130749-a3a2-4a31-aa32-91123d34dfbc\" (UID: \"65130749-a3a2-4a31-aa32-91123d34dfbc\") "
Sep 08 04:09:14.487256 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:14.487234    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65130749-a3a2-4a31-aa32-91123d34dfbc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "65130749-a3a2-4a31-aa32-91123d34dfbc" (UID: "65130749-a3a2-4a31-aa32-91123d34dfbc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:09:14.489144 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:14.489122    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65130749-a3a2-4a31-aa32-91123d34dfbc-kube-api-access-8sgtd" (OuterVolumeSpecName: "kube-api-access-8sgtd") pod "65130749-a3a2-4a31-aa32-91123d34dfbc" (UID: "65130749-a3a2-4a31-aa32-91123d34dfbc"). InnerVolumeSpecName "kube-api-access-8sgtd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:09:14.587851 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:14.587826    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8sgtd\" (UniqueName: \"kubernetes.io/projected/65130749-a3a2-4a31-aa32-91123d34dfbc-kube-api-access-8sgtd\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:09:14.587851 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:14.587845    2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/65130749-a3a2-4a31-aa32-91123d34dfbc-extensions-socket-volume\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:09:15.150456 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:15.150428    2573 generic.go:356] "Generic (PLEG): container finished" podID="65130749-a3a2-4a31-aa32-91123d34dfbc" containerID="72d9a3af7120d58050f0ab8f7673ed14a5bc96b7fa70126233de381188ad8ccc" exitCode=0
Sep 08 04:09:15.150828 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:15.150472    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mdkjh"
Sep 08 04:09:15.150828 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:15.150518    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mdkjh" event={"ID":"65130749-a3a2-4a31-aa32-91123d34dfbc","Type":"ContainerDied","Data":"72d9a3af7120d58050f0ab8f7673ed14a5bc96b7fa70126233de381188ad8ccc"}
Sep 08 04:09:15.150828 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:15.150591    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mdkjh" event={"ID":"65130749-a3a2-4a31-aa32-91123d34dfbc","Type":"ContainerDied","Data":"513ecb79e5674262aad2f393384971d0c3fff84ccb12382bfaebeafa024dcc3e"}
Sep 08 04:09:15.150828 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:15.150622    2573 scope.go:117] "RemoveContainer" containerID="72d9a3af7120d58050f0ab8f7673ed14a5bc96b7fa70126233de381188ad8ccc"
Sep 08 04:09:15.159253 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:15.159238    2573 scope.go:117] "RemoveContainer" containerID="72d9a3af7120d58050f0ab8f7673ed14a5bc96b7fa70126233de381188ad8ccc"
Sep 08 04:09:15.159506 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:09:15.159486    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72d9a3af7120d58050f0ab8f7673ed14a5bc96b7fa70126233de381188ad8ccc\": container with ID starting with 72d9a3af7120d58050f0ab8f7673ed14a5bc96b7fa70126233de381188ad8ccc not found: ID does not exist" containerID="72d9a3af7120d58050f0ab8f7673ed14a5bc96b7fa70126233de381188ad8ccc"
Sep 08 04:09:15.159598 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:15.159517    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72d9a3af7120d58050f0ab8f7673ed14a5bc96b7fa70126233de381188ad8ccc"} err="failed to get container status \"72d9a3af7120d58050f0ab8f7673ed14a5bc96b7fa70126233de381188ad8ccc\": rpc error: code = NotFound desc = could not find container \"72d9a3af7120d58050f0ab8f7673ed14a5bc96b7fa70126233de381188ad8ccc\": container with ID starting with 72d9a3af7120d58050f0ab8f7673ed14a5bc96b7fa70126233de381188ad8ccc not found: ID does not exist"
Sep 08 04:09:15.173202 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:15.173177    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mdkjh"]
Sep 08 04:09:15.181100 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:15.181079    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mdkjh"]
Sep 08 04:09:16.674608 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:16.674546    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65130749-a3a2-4a31-aa32-91123d34dfbc" path="/var/lib/kubelet/pods/65130749-a3a2-4a31-aa32-91123d34dfbc/volumes"
Sep 08 04:09:18.480239 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:18.480202    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4"]
Sep 08 04:09:18.480640 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:18.480625    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65130749-a3a2-4a31-aa32-91123d34dfbc" containerName="manager"
Sep 08 04:09:18.480640 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:18.480641    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="65130749-a3a2-4a31-aa32-91123d34dfbc" containerName="manager"
Sep 08 04:09:18.481041 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:18.480709    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="65130749-a3a2-4a31-aa32-91123d34dfbc" containerName="manager"
Sep 08 04:09:18.483360 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:18.483344    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4"
Sep 08 04:09:18.486309 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:18.486287    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-b4zvq\""
Sep 08 04:09:18.486428 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:18.486295    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 08 04:09:18.494147 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:18.494124    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4"]
Sep 08 04:09:18.619970 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:18.619944    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ebf3915-eaae-4906-8fba-46f66c55d4e3-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t6lf4\" (UID: \"6ebf3915-eaae-4906-8fba-46f66c55d4e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4"
Sep 08 04:09:18.620128 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:18.619976    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ebf3915-eaae-4906-8fba-46f66c55d4e3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t6lf4\" (UID: \"6ebf3915-eaae-4906-8fba-46f66c55d4e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4"
Sep 08 04:09:18.620128 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:18.620007    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ebf3915-eaae-4906-8fba-46f66c55d4e3-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t6lf4\" (UID: \"6ebf3915-eaae-4906-8fba-46f66c55d4e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4"
Sep 08 04:09:18.620128 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:18.620023    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rfnn\" (UniqueName: \"kubernetes.io/projected/6ebf3915-eaae-4906-8fba-46f66c55d4e3-kube-api-access-6rfnn\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t6lf4\" (UID: \"6ebf3915-eaae-4906-8fba-46f66c55d4e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4"
Sep 08 04:09:18.620128 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:18.620077    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ebf3915-eaae-4906-8fba-46f66c55d4e3-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t6lf4\" (UID: \"6ebf3915-eaae-4906-8fba-46f66c55d4e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4"
Sep 08 04:09:18.620128 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:18.620115    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ebf3915-eaae-4906-8fba-46f66c55d4e3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t6lf4\" (UID: \"6ebf3915-eaae-4906-8fba-46f66c55d4e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4"
Sep 08 04:09:18.620311 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:18.620138    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ebf3915-eaae-4906-8fba-46f66c55d4e3-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t6lf4\" (UID: \"6ebf3915-eaae-4906-8fba-46f66c55d4e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4"
Sep 08 04:09:18.620311 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:18.620177    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ebf3915-eaae-4906-8fba-46f66c55d4e3-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t6lf4\" (UID: \"6ebf3915-eaae-4906-8fba-46f66c55d4e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4"
Sep 08 04:09:18.620311 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:18.620221    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ebf3915-eaae-4906-8fba-46f66c55d4e3-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t6lf4\" (UID: \"6ebf3915-eaae-4906-8fba-46f66c55d4e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4"
Sep 08 04:09:18.721261 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:18.721228    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ebf3915-eaae-4906-8fba-46f66c55d4e3-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t6lf4\" (UID: \"6ebf3915-eaae-4906-8fba-46f66c55d4e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4"
Sep 08 04:09:18.721261 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:18.721259    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rfnn\" (UniqueName: \"kubernetes.io/projected/6ebf3915-eaae-4906-8fba-46f66c55d4e3-kube-api-access-6rfnn\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t6lf4\" (UID: \"6ebf3915-eaae-4906-8fba-46f66c55d4e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4"
Sep 08 04:09:18.721439 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:18.721280    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ebf3915-eaae-4906-8fba-46f66c55d4e3-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t6lf4\" (UID: \"6ebf3915-eaae-4906-8fba-46f66c55d4e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4"
Sep 08 04:09:18.721439 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:18.721386    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ebf3915-eaae-4906-8fba-46f66c55d4e3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t6lf4\" (UID: \"6ebf3915-eaae-4906-8fba-46f66c55d4e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4"
Sep 08 04:09:18.721439 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:18.721418    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ebf3915-eaae-4906-8fba-46f66c55d4e3-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t6lf4\" (UID: \"6ebf3915-eaae-4906-8fba-46f66c55d4e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4"
Sep 08 04:09:18.721608 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:18.721542    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ebf3915-eaae-4906-8fba-46f66c55d4e3-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t6lf4\" (UID: \"6ebf3915-eaae-4906-8fba-46f66c55d4e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4"
Sep 08 04:09:18.721749 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:18.721649    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ebf3915-eaae-4906-8fba-46f66c55d4e3-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t6lf4\" (UID: \"6ebf3915-eaae-4906-8fba-46f66c55d4e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4"
Sep 08 04:09:18.721749 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:18.721727    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ebf3915-eaae-4906-8fba-46f66c55d4e3-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t6lf4\" (UID: \"6ebf3915-eaae-4906-8fba-46f66c55d4e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4"
Sep 08 04:09:18.721872 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:18.721754    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ebf3915-eaae-4906-8fba-46f66c55d4e3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t6lf4\" (UID: \"6ebf3915-eaae-4906-8fba-46f66c55d4e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4"
Sep 08 04:09:18.721872 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:18.721768    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ebf3915-eaae-4906-8fba-46f66c55d4e3-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t6lf4\" (UID: \"6ebf3915-eaae-4906-8fba-46f66c55d4e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4"
Sep 08 04:09:18.721872 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:18.721815    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ebf3915-eaae-4906-8fba-46f66c55d4e3-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t6lf4\" (UID: \"6ebf3915-eaae-4906-8fba-46f66c55d4e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4"
Sep 08 04:09:18.722004 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:18.721981    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ebf3915-eaae-4906-8fba-46f66c55d4e3-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t6lf4\" (UID: \"6ebf3915-eaae-4906-8fba-46f66c55d4e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4"
Sep 08 04:09:18.722050 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:18.722012    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ebf3915-eaae-4906-8fba-46f66c55d4e3-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t6lf4\" (UID: \"6ebf3915-eaae-4906-8fba-46f66c55d4e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4"
Sep 08 04:09:18.722630 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:18.722608    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ebf3915-eaae-4906-8fba-46f66c55d4e3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t6lf4\" (UID: \"6ebf3915-eaae-4906-8fba-46f66c55d4e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4"
Sep 08 04:09:18.723603 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:18.723583    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ebf3915-eaae-4906-8fba-46f66c55d4e3-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t6lf4\" (UID: \"6ebf3915-eaae-4906-8fba-46f66c55d4e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4"
Sep 08 04:09:18.724029 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:18.724008    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ebf3915-eaae-4906-8fba-46f66c55d4e3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t6lf4\" (UID: \"6ebf3915-eaae-4906-8fba-46f66c55d4e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4"
Sep 08 04:09:18.729284 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:18.729266    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rfnn\" (UniqueName: \"kubernetes.io/projected/6ebf3915-eaae-4906-8fba-46f66c55d4e3-kube-api-access-6rfnn\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t6lf4\" (UID: \"6ebf3915-eaae-4906-8fba-46f66c55d4e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4"
Sep 08 04:09:18.729349 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:18.729273    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ebf3915-eaae-4906-8fba-46f66c55d4e3-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t6lf4\" (UID: \"6ebf3915-eaae-4906-8fba-46f66c55d4e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4"
Sep 08 04:09:18.794911 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:18.794890    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4"
Sep 08 04:09:19.081472 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:19.072626    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4"]
Sep 08 04:09:19.174009 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:19.173980    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4" event={"ID":"6ebf3915-eaae-4906-8fba-46f66c55d4e3","Type":"ContainerStarted","Data":"7d0356195e4623f103dee1da564c4556279ca77197bba74f61e294226f0ab758"}
Sep 08 04:09:21.872404 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:21.872363    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:09:21.872857 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:21.872464    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:09:21.872857 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:21.872521    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:09:22.193353 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:22.193268    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4" event={"ID":"6ebf3915-eaae-4906-8fba-46f66c55d4e3","Type":"ContainerStarted","Data":"d264d0858638f17aeeb816fd1e160aeade9e0704a76e6605c8f556e2843d6395"}
Sep 08 04:09:22.795195 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:22.795161    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4"
Sep 08 04:09:22.800069 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:22.800045    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4"
Sep 08 04:09:22.820673 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:22.820633    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4" podStartSLOduration=2.027155253 podStartE2EDuration="4.820618862s" totalImagesPullingTime="2.793463609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:09:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:09:22.212885944 +0000 UTC m=+521.998177208" watchObservedRunningTime="2026-09-08 04:09:22.820618862 +0000 UTC m=+522.605910097"
Sep 08 04:09:23.198280 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:23.198196    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4"
Sep 08 04:09:23.199246 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:23.199232    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4"
Sep 08 04:09:32.050036 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:32.049961    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-2wdm2"]
Sep 08 04:09:32.054012 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:32.053993    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-2wdm2"
Sep 08 04:09:32.056363 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:32.056344    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-d4vgw\""
Sep 08 04:09:32.056453 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:32.056345    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 08 04:09:32.063274 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:32.063252    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-2wdm2"]
Sep 08 04:09:32.153206 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:32.153174    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-2wdm2"]
Sep 08 04:09:32.231625 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:32.231594    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1ebb8285-1d76-427f-af0b-f5e807bd9442-config-file\") pod \"limitador-limitador-859c4d96d6-2wdm2\" (UID: \"1ebb8285-1d76-427f-af0b-f5e807bd9442\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-2wdm2"
Sep 08 04:09:32.231775 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:32.231628    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpwdt\" (UniqueName: \"kubernetes.io/projected/1ebb8285-1d76-427f-af0b-f5e807bd9442-kube-api-access-gpwdt\") pod \"limitador-limitador-859c4d96d6-2wdm2\" (UID: \"1ebb8285-1d76-427f-af0b-f5e807bd9442\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-2wdm2"
Sep 08 04:09:32.332328 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:32.332246    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1ebb8285-1d76-427f-af0b-f5e807bd9442-config-file\") pod \"limitador-limitador-859c4d96d6-2wdm2\" (UID: \"1ebb8285-1d76-427f-af0b-f5e807bd9442\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-2wdm2"
Sep 08 04:09:32.332328 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:32.332280    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpwdt\" (UniqueName: \"kubernetes.io/projected/1ebb8285-1d76-427f-af0b-f5e807bd9442-kube-api-access-gpwdt\") pod \"limitador-limitador-859c4d96d6-2wdm2\" (UID: \"1ebb8285-1d76-427f-af0b-f5e807bd9442\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-2wdm2"
Sep 08 04:09:32.332893 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:32.332872    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1ebb8285-1d76-427f-af0b-f5e807bd9442-config-file\") pod \"limitador-limitador-859c4d96d6-2wdm2\" (UID: \"1ebb8285-1d76-427f-af0b-f5e807bd9442\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-2wdm2"
Sep 08 04:09:32.340592 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:32.340546    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpwdt\" (UniqueName: \"kubernetes.io/projected/1ebb8285-1d76-427f-af0b-f5e807bd9442-kube-api-access-gpwdt\") pod \"limitador-limitador-859c4d96d6-2wdm2\" (UID: \"1ebb8285-1d76-427f-af0b-f5e807bd9442\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-2wdm2"
Sep 08 04:09:32.364370 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:32.364343    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-2wdm2"
Sep 08 04:09:32.639847 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:32.639818    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-2wdm2"]
Sep 08 04:09:33.253421 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:33.253384    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-2wdm2" event={"ID":"1ebb8285-1d76-427f-af0b-f5e807bd9442","Type":"ContainerStarted","Data":"6ab249e1aec85c0cc4441f2d41fbb9280829e115e990d42e6db020176ca249b4"}
Sep 08 04:09:34.260284 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:34.260249    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-2wdm2" event={"ID":"1ebb8285-1d76-427f-af0b-f5e807bd9442","Type":"ContainerStarted","Data":"919ecab97ab44347ab42aefb74677e7b915cc27de6a14c714905145ef1cc3b47"}
Sep 08 04:09:34.260641 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:34.260388    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-2wdm2"
Sep 08 04:09:34.277740 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:34.277699    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-859c4d96d6-2wdm2" podStartSLOduration=1.122835882 podStartE2EDuration="2.277685048s" totalImagesPullingTime="1.154849166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:09:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:09:34.275515595 +0000 UTC m=+534.060806822" watchObservedRunningTime="2026-09-08 04:09:34.277685048 +0000 UTC m=+534.062976283"
Sep 08 04:09:45.266403 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:45.266373    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-2wdm2"
Sep 08 04:09:48.288958 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:48.288923    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-2wdm2"]
Sep 08 04:09:48.289433 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:48.289093    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-859c4d96d6-2wdm2" podUID="1ebb8285-1d76-427f-af0b-f5e807bd9442" containerName="limitador" containerID="cri-o://919ecab97ab44347ab42aefb74677e7b915cc27de6a14c714905145ef1cc3b47" gracePeriod=30
Sep 08 04:09:48.842422 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:48.842333    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-2wdm2"
Sep 08 04:09:48.871581 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:48.871494    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpwdt\" (UniqueName: \"kubernetes.io/projected/1ebb8285-1d76-427f-af0b-f5e807bd9442-kube-api-access-gpwdt\") pod \"1ebb8285-1d76-427f-af0b-f5e807bd9442\" (UID: \"1ebb8285-1d76-427f-af0b-f5e807bd9442\") "
Sep 08 04:09:48.871581 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:48.871577    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1ebb8285-1d76-427f-af0b-f5e807bd9442-config-file\") pod \"1ebb8285-1d76-427f-af0b-f5e807bd9442\" (UID: \"1ebb8285-1d76-427f-af0b-f5e807bd9442\") "
Sep 08 04:09:48.871927 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:48.871904    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ebb8285-1d76-427f-af0b-f5e807bd9442-config-file" (OuterVolumeSpecName: "config-file") pod "1ebb8285-1d76-427f-af0b-f5e807bd9442" (UID: "1ebb8285-1d76-427f-af0b-f5e807bd9442"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 04:09:48.873551 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:48.873530    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ebb8285-1d76-427f-af0b-f5e807bd9442-kube-api-access-gpwdt" (OuterVolumeSpecName: "kube-api-access-gpwdt") pod "1ebb8285-1d76-427f-af0b-f5e807bd9442" (UID: "1ebb8285-1d76-427f-af0b-f5e807bd9442"). InnerVolumeSpecName "kube-api-access-gpwdt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:09:48.972395 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:48.972368    2573 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1ebb8285-1d76-427f-af0b-f5e807bd9442-config-file\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:09:48.972395 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:48.972391    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpwdt\" (UniqueName: \"kubernetes.io/projected/1ebb8285-1d76-427f-af0b-f5e807bd9442-kube-api-access-gpwdt\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:09:49.337396 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:49.337361    2573 generic.go:356] "Generic (PLEG): container finished" podID="1ebb8285-1d76-427f-af0b-f5e807bd9442" containerID="919ecab97ab44347ab42aefb74677e7b915cc27de6a14c714905145ef1cc3b47" exitCode=0
Sep 08 04:09:49.337794 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:49.337399    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-2wdm2"
Sep 08 04:09:49.337794 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:49.337413    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-2wdm2" event={"ID":"1ebb8285-1d76-427f-af0b-f5e807bd9442","Type":"ContainerDied","Data":"919ecab97ab44347ab42aefb74677e7b915cc27de6a14c714905145ef1cc3b47"}
Sep 08 04:09:49.337794 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:49.337468    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-2wdm2" event={"ID":"1ebb8285-1d76-427f-af0b-f5e807bd9442","Type":"ContainerDied","Data":"6ab249e1aec85c0cc4441f2d41fbb9280829e115e990d42e6db020176ca249b4"}
Sep 08 04:09:49.337794 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:49.337492    2573 scope.go:117] "RemoveContainer" containerID="919ecab97ab44347ab42aefb74677e7b915cc27de6a14c714905145ef1cc3b47"
Sep 08 04:09:49.346341 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:49.346323    2573 scope.go:117] "RemoveContainer" containerID="919ecab97ab44347ab42aefb74677e7b915cc27de6a14c714905145ef1cc3b47"
Sep 08 04:09:49.346604 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:09:49.346586    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"919ecab97ab44347ab42aefb74677e7b915cc27de6a14c714905145ef1cc3b47\": container with ID starting with 919ecab97ab44347ab42aefb74677e7b915cc27de6a14c714905145ef1cc3b47 not found: ID does not exist" containerID="919ecab97ab44347ab42aefb74677e7b915cc27de6a14c714905145ef1cc3b47"
Sep 08 04:09:49.346673 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:49.346613    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"919ecab97ab44347ab42aefb74677e7b915cc27de6a14c714905145ef1cc3b47"} err="failed to get container status \"919ecab97ab44347ab42aefb74677e7b915cc27de6a14c714905145ef1cc3b47\": rpc error: code = NotFound desc = could not find container \"919ecab97ab44347ab42aefb74677e7b915cc27de6a14c714905145ef1cc3b47\": container with ID starting with 919ecab97ab44347ab42aefb74677e7b915cc27de6a14c714905145ef1cc3b47 not found: ID does not exist"
Sep 08 04:09:49.357526 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:49.357499    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-2wdm2"]
Sep 08 04:09:49.360832 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:49.360813    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-2wdm2"]
Sep 08 04:09:49.967187 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:49.967154    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-j5f6q"]
Sep 08 04:09:49.967552 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:49.967538    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ebb8285-1d76-427f-af0b-f5e807bd9442" containerName="limitador"
Sep 08 04:09:49.967552 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:49.967552    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ebb8285-1d76-427f-af0b-f5e807bd9442" containerName="limitador"
Sep 08 04:09:49.967697 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:49.967634    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ebb8285-1d76-427f-af0b-f5e807bd9442" containerName="limitador"
Sep 08 04:09:49.972895 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:49.972876    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-j5f6q"
Sep 08 04:09:49.975417 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:49.975399    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-wlkc5\""
Sep 08 04:09:49.976352 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:49.976331    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 04:09:49.976458 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:49.976355    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 08 04:09:49.976458 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:49.976376    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 08 04:09:49.978258 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:49.978229    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-j5f6q"]
Sep 08 04:09:50.082030 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:50.081998    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/548cf291-e5ec-4ee7-8f77-4a7fe5f97373-data\") pod \"postgres-69fb4594cf-j5f6q\" (UID: \"548cf291-e5ec-4ee7-8f77-4a7fe5f97373\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-j5f6q"
Sep 08 04:09:50.082191 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:50.082055    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8pvm\" (UniqueName: \"kubernetes.io/projected/548cf291-e5ec-4ee7-8f77-4a7fe5f97373-kube-api-access-h8pvm\") pod \"postgres-69fb4594cf-j5f6q\" (UID: \"548cf291-e5ec-4ee7-8f77-4a7fe5f97373\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-j5f6q"
Sep 08 04:09:50.183436 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:50.183400    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8pvm\" (UniqueName: \"kubernetes.io/projected/548cf291-e5ec-4ee7-8f77-4a7fe5f97373-kube-api-access-h8pvm\") pod \"postgres-69fb4594cf-j5f6q\" (UID: \"548cf291-e5ec-4ee7-8f77-4a7fe5f97373\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-j5f6q"
Sep 08 04:09:50.183625 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:50.183491    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/548cf291-e5ec-4ee7-8f77-4a7fe5f97373-data\") pod \"postgres-69fb4594cf-j5f6q\" (UID: \"548cf291-e5ec-4ee7-8f77-4a7fe5f97373\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-j5f6q"
Sep 08 04:09:50.183831 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:50.183816    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/548cf291-e5ec-4ee7-8f77-4a7fe5f97373-data\") pod \"postgres-69fb4594cf-j5f6q\" (UID: \"548cf291-e5ec-4ee7-8f77-4a7fe5f97373\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-j5f6q"
Sep 08 04:09:50.192489 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:50.192470    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8pvm\" (UniqueName: \"kubernetes.io/projected/548cf291-e5ec-4ee7-8f77-4a7fe5f97373-kube-api-access-h8pvm\") pod \"postgres-69fb4594cf-j5f6q\" (UID: \"548cf291-e5ec-4ee7-8f77-4a7fe5f97373\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-j5f6q"
Sep 08 04:09:50.283616 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:50.283591    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-j5f6q"
Sep 08 04:09:50.554667 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:50.554640    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-j5f6q"]
Sep 08 04:09:50.556426 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:09:50.556394    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod548cf291_e5ec_4ee7_8f77_4a7fe5f97373.slice/crio-7f6d526d2f4bcd267613c5db7753569be6e4a0d1dd74831b600a550fe2752be6 WatchSource:0}: Error finding container 7f6d526d2f4bcd267613c5db7753569be6e4a0d1dd74831b600a550fe2752be6: Status 404 returned error can't find the container with id 7f6d526d2f4bcd267613c5db7753569be6e4a0d1dd74831b600a550fe2752be6
Sep 08 04:09:50.674516 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:50.674483    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ebb8285-1d76-427f-af0b-f5e807bd9442" path="/var/lib/kubelet/pods/1ebb8285-1d76-427f-af0b-f5e807bd9442/volumes"
Sep 08 04:09:51.356870 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:51.356832    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-j5f6q" event={"ID":"548cf291-e5ec-4ee7-8f77-4a7fe5f97373","Type":"ContainerStarted","Data":"7f6d526d2f4bcd267613c5db7753569be6e4a0d1dd74831b600a550fe2752be6"}
Sep 08 04:09:56.389983 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:56.389953    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-j5f6q" event={"ID":"548cf291-e5ec-4ee7-8f77-4a7fe5f97373","Type":"ContainerStarted","Data":"a137c214153154c0832466b227ca0e389fe8bf93bc16f00161ac03ca9d888385"}
Sep 08 04:09:56.390398 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:56.390125    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-j5f6q"
Sep 08 04:09:56.405762 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:09:56.405718    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-j5f6q" podStartSLOduration=2.621687347 podStartE2EDuration="7.405703212s" totalImagesPullingTime="4.784015865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:09:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:09:56.405292384 +0000 UTC m=+556.190583621" watchObservedRunningTime="2026-09-08 04:09:56.405703212 +0000 UTC m=+556.190994447"
Sep 08 04:10:02.424902 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:02.424872    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-j5f6q"
Sep 08 04:10:10.205268 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:10.205235    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6cb48d57d-x2rpk"]
Sep 08 04:10:10.208784 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:10.208767    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cb48d57d-x2rpk"
Sep 08 04:10:10.211420 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:10.211396    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-g7lt2\""
Sep 08 04:10:10.211420 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:10.211410    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 08 04:10:10.211599 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:10.211396    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 08 04:10:10.212121 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:10.212104    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 08 04:10:10.220003 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:10.219986    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cb48d57d-x2rpk"]
Sep 08 04:10:10.368255 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:10.368221    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a53ff60a-0af1-4ffa-b589-bd906aa02cdc-metrics-certs\") pod \"maas-controller-6cb48d57d-x2rpk\" (UID: \"a53ff60a-0af1-4ffa-b589-bd906aa02cdc\") " pod="opendatahub/maas-controller-6cb48d57d-x2rpk"
Sep 08 04:10:10.368422 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:10.368313    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a53ff60a-0af1-4ffa-b589-bd906aa02cdc-webhook-cert\") pod \"maas-controller-6cb48d57d-x2rpk\" (UID: \"a53ff60a-0af1-4ffa-b589-bd906aa02cdc\") " pod="opendatahub/maas-controller-6cb48d57d-x2rpk"
Sep 08 04:10:10.368482 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:10.368415    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmdcg\" (UniqueName: \"kubernetes.io/projected/a53ff60a-0af1-4ffa-b589-bd906aa02cdc-kube-api-access-nmdcg\") pod \"maas-controller-6cb48d57d-x2rpk\" (UID: \"a53ff60a-0af1-4ffa-b589-bd906aa02cdc\") " pod="opendatahub/maas-controller-6cb48d57d-x2rpk"
Sep 08 04:10:10.386709 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:10.386675    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-f86964c84-tvwxb"]
Sep 08 04:10:10.390587 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:10.390550    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f86964c84-tvwxb"
Sep 08 04:10:10.399644 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:10.399625    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f86964c84-tvwxb"]
Sep 08 04:10:10.469909 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:10.469833    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a53ff60a-0af1-4ffa-b589-bd906aa02cdc-metrics-certs\") pod \"maas-controller-6cb48d57d-x2rpk\" (UID: \"a53ff60a-0af1-4ffa-b589-bd906aa02cdc\") " pod="opendatahub/maas-controller-6cb48d57d-x2rpk"
Sep 08 04:10:10.469909 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:10.469895    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a53ff60a-0af1-4ffa-b589-bd906aa02cdc-webhook-cert\") pod \"maas-controller-6cb48d57d-x2rpk\" (UID: \"a53ff60a-0af1-4ffa-b589-bd906aa02cdc\") " pod="opendatahub/maas-controller-6cb48d57d-x2rpk"
Sep 08 04:10:10.470124 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:10.469919    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef-webhook-cert\") pod \"maas-controller-f86964c84-tvwxb\" (UID: \"7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef\") " pod="opendatahub/maas-controller-f86964c84-tvwxb"
Sep 08 04:10:10.470124 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:10.469936    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-587qx\" (UniqueName: \"kubernetes.io/projected/7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef-kube-api-access-587qx\") pod \"maas-controller-f86964c84-tvwxb\" (UID: \"7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef\") " pod="opendatahub/maas-controller-f86964c84-tvwxb"
Sep 08 04:10:10.470124 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:10.470001    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmdcg\" (UniqueName: \"kubernetes.io/projected/a53ff60a-0af1-4ffa-b589-bd906aa02cdc-kube-api-access-nmdcg\") pod \"maas-controller-6cb48d57d-x2rpk\" (UID: \"a53ff60a-0af1-4ffa-b589-bd906aa02cdc\") " pod="opendatahub/maas-controller-6cb48d57d-x2rpk"
Sep 08 04:10:10.470124 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:10:10.470041    2573 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 08 04:10:10.470124 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:10.470059    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef-metrics-certs\") pod \"maas-controller-f86964c84-tvwxb\" (UID: \"7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef\") " pod="opendatahub/maas-controller-f86964c84-tvwxb"
Sep 08 04:10:10.470124 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:10:10.470110    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a53ff60a-0af1-4ffa-b589-bd906aa02cdc-webhook-cert podName:a53ff60a-0af1-4ffa-b589-bd906aa02cdc nodeName:}" failed. No retries permitted until 2026-09-08 04:10:10.970093596 +0000 UTC m=+570.755384813 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/a53ff60a-0af1-4ffa-b589-bd906aa02cdc-webhook-cert") pod "maas-controller-6cb48d57d-x2rpk" (UID: "a53ff60a-0af1-4ffa-b589-bd906aa02cdc") : secret "maas-controller-webhook-cert" not found
Sep 08 04:10:10.472527 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:10.472505    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a53ff60a-0af1-4ffa-b589-bd906aa02cdc-metrics-certs\") pod \"maas-controller-6cb48d57d-x2rpk\" (UID: \"a53ff60a-0af1-4ffa-b589-bd906aa02cdc\") " pod="opendatahub/maas-controller-6cb48d57d-x2rpk"
Sep 08 04:10:10.479727 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:10.479704    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmdcg\" (UniqueName: \"kubernetes.io/projected/a53ff60a-0af1-4ffa-b589-bd906aa02cdc-kube-api-access-nmdcg\") pod \"maas-controller-6cb48d57d-x2rpk\" (UID: \"a53ff60a-0af1-4ffa-b589-bd906aa02cdc\") " pod="opendatahub/maas-controller-6cb48d57d-x2rpk"
Sep 08 04:10:10.570792 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:10.570769    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef-webhook-cert\") pod \"maas-controller-f86964c84-tvwxb\" (UID: \"7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef\") " pod="opendatahub/maas-controller-f86964c84-tvwxb"
Sep 08 04:10:10.570903 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:10.570797    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-587qx\" (UniqueName: \"kubernetes.io/projected/7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef-kube-api-access-587qx\") pod \"maas-controller-f86964c84-tvwxb\" (UID: \"7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef\") " pod="opendatahub/maas-controller-f86964c84-tvwxb"
Sep 08 04:10:10.570903 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:10.570845    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef-metrics-certs\") pod \"maas-controller-f86964c84-tvwxb\" (UID: \"7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef\") " pod="opendatahub/maas-controller-f86964c84-tvwxb"
Sep 08 04:10:10.570971 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:10:10.570909    2573 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 08 04:10:10.570971 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:10:10.570965    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef-webhook-cert podName:7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef nodeName:}" failed. No retries permitted until 2026-09-08 04:10:11.070950829 +0000 UTC m=+570.856242043 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef-webhook-cert") pod "maas-controller-f86964c84-tvwxb" (UID: "7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef") : secret "maas-controller-webhook-cert" not found
Sep 08 04:10:10.573089 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:10.573068    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef-metrics-certs\") pod \"maas-controller-f86964c84-tvwxb\" (UID: \"7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef\") " pod="opendatahub/maas-controller-f86964c84-tvwxb"
Sep 08 04:10:10.583379 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:10.583355    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-587qx\" (UniqueName: \"kubernetes.io/projected/7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef-kube-api-access-587qx\") pod \"maas-controller-f86964c84-tvwxb\" (UID: \"7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef\") " pod="opendatahub/maas-controller-f86964c84-tvwxb"
Sep 08 04:10:10.973389 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:10.973359    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a53ff60a-0af1-4ffa-b589-bd906aa02cdc-webhook-cert\") pod \"maas-controller-6cb48d57d-x2rpk\" (UID: \"a53ff60a-0af1-4ffa-b589-bd906aa02cdc\") " pod="opendatahub/maas-controller-6cb48d57d-x2rpk"
Sep 08 04:10:10.975872 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:10.975846    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a53ff60a-0af1-4ffa-b589-bd906aa02cdc-webhook-cert\") pod \"maas-controller-6cb48d57d-x2rpk\" (UID: \"a53ff60a-0af1-4ffa-b589-bd906aa02cdc\") " pod="opendatahub/maas-controller-6cb48d57d-x2rpk"
Sep 08 04:10:11.074571 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:11.074534    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef-webhook-cert\") pod \"maas-controller-f86964c84-tvwxb\" (UID: \"7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef\") " pod="opendatahub/maas-controller-f86964c84-tvwxb"
Sep 08 04:10:11.076914 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:11.076884    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef-webhook-cert\") pod \"maas-controller-f86964c84-tvwxb\" (UID: \"7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef\") " pod="opendatahub/maas-controller-f86964c84-tvwxb"
Sep 08 04:10:11.119898 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:11.119875    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cb48d57d-x2rpk"
Sep 08 04:10:11.310017 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:11.309984    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f86964c84-tvwxb"
Sep 08 04:10:11.393941 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:11.393918    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cb48d57d-x2rpk"]
Sep 08 04:10:11.395286 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:10:11.395261    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda53ff60a_0af1_4ffa_b589_bd906aa02cdc.slice/crio-925cae11ae95ef066e46c25e8c929e06b1e5673b872b530e65d8e0667a485685 WatchSource:0}: Error finding container 925cae11ae95ef066e46c25e8c929e06b1e5673b872b530e65d8e0667a485685: Status 404 returned error can't find the container with id 925cae11ae95ef066e46c25e8c929e06b1e5673b872b530e65d8e0667a485685
Sep 08 04:10:11.467125 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:11.467095    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cb48d57d-x2rpk" event={"ID":"a53ff60a-0af1-4ffa-b589-bd906aa02cdc","Type":"ContainerStarted","Data":"925cae11ae95ef066e46c25e8c929e06b1e5673b872b530e65d8e0667a485685"}
Sep 08 04:10:11.582178 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:11.582151    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f86964c84-tvwxb"]
Sep 08 04:10:11.583898 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:10:11.583868    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7edd45d6_5ece_4f16_a2ad_9e4fd0dccdef.slice/crio-0dac2f585842cb30645096adff7260ececc2572f4b212ea29e4dd9f0df1d2fd9 WatchSource:0}: Error finding container 0dac2f585842cb30645096adff7260ececc2572f4b212ea29e4dd9f0df1d2fd9: Status 404 returned error can't find the container with id 0dac2f585842cb30645096adff7260ececc2572f4b212ea29e4dd9f0df1d2fd9
Sep 08 04:10:12.479821 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:12.479777    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f86964c84-tvwxb" event={"ID":"7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef","Type":"ContainerStarted","Data":"0dac2f585842cb30645096adff7260ececc2572f4b212ea29e4dd9f0df1d2fd9"}
Sep 08 04:10:14.492790 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:14.492697    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f86964c84-tvwxb" event={"ID":"7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef","Type":"ContainerStarted","Data":"17fd25fa01a62fab1af7b25cb47d1237d18d39ee181024abb0fbd8bda4fd5032"}
Sep 08 04:10:14.493225 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:14.492812    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-f86964c84-tvwxb"
Sep 08 04:10:14.494278 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:14.494247    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cb48d57d-x2rpk" event={"ID":"a53ff60a-0af1-4ffa-b589-bd906aa02cdc","Type":"ContainerStarted","Data":"8ba718cd7e6e37cba48c09751998f4f0face4272ec20a0c485a5a37b9e8e4696"}
Sep 08 04:10:14.494366 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:14.494331    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6cb48d57d-x2rpk"
Sep 08 04:10:14.513401 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:14.513360    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-f86964c84-tvwxb" podStartSLOduration=1.888459547 podStartE2EDuration="4.513347381s" totalImagesPullingTime="2.624887834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:10:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:10:14.511902811 +0000 UTC m=+574.297194048" watchObservedRunningTime="2026-09-08 04:10:14.513347381 +0000 UTC m=+574.298638637"
Sep 08 04:10:14.542802 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:14.542763    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6cb48d57d-x2rpk" podStartSLOduration=1.71911435 podStartE2EDuration="4.542750242s" totalImagesPullingTime="2.823635892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:10:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:10:14.537638426 +0000 UTC m=+574.322929661" watchObservedRunningTime="2026-09-08 04:10:14.542750242 +0000 UTC m=+574.328041478"
Sep 08 04:10:25.503277 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:25.503247    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-f86964c84-tvwxb"
Sep 08 04:10:25.503710 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:25.503315    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6cb48d57d-x2rpk"
Sep 08 04:10:25.575529 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:25.575498    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6cb48d57d-x2rpk"]
Sep 08 04:10:25.575798 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:25.575775    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6cb48d57d-x2rpk" podUID="a53ff60a-0af1-4ffa-b589-bd906aa02cdc" containerName="manager" containerID="cri-o://8ba718cd7e6e37cba48c09751998f4f0face4272ec20a0c485a5a37b9e8e4696" gracePeriod=30
Sep 08 04:10:25.815019 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:25.814992    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cb48d57d-x2rpk"
Sep 08 04:10:25.910520 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:25.910487    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a53ff60a-0af1-4ffa-b589-bd906aa02cdc-webhook-cert\") pod \"a53ff60a-0af1-4ffa-b589-bd906aa02cdc\" (UID: \"a53ff60a-0af1-4ffa-b589-bd906aa02cdc\") "
Sep 08 04:10:25.910693 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:25.910579    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmdcg\" (UniqueName: \"kubernetes.io/projected/a53ff60a-0af1-4ffa-b589-bd906aa02cdc-kube-api-access-nmdcg\") pod \"a53ff60a-0af1-4ffa-b589-bd906aa02cdc\" (UID: \"a53ff60a-0af1-4ffa-b589-bd906aa02cdc\") "
Sep 08 04:10:25.910693 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:25.910636    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a53ff60a-0af1-4ffa-b589-bd906aa02cdc-metrics-certs\") pod \"a53ff60a-0af1-4ffa-b589-bd906aa02cdc\" (UID: \"a53ff60a-0af1-4ffa-b589-bd906aa02cdc\") "
Sep 08 04:10:25.912782 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:25.912751    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a53ff60a-0af1-4ffa-b589-bd906aa02cdc-kube-api-access-nmdcg" (OuterVolumeSpecName: "kube-api-access-nmdcg") pod "a53ff60a-0af1-4ffa-b589-bd906aa02cdc" (UID: "a53ff60a-0af1-4ffa-b589-bd906aa02cdc"). InnerVolumeSpecName "kube-api-access-nmdcg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:10:25.912896 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:25.912776    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a53ff60a-0af1-4ffa-b589-bd906aa02cdc-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a53ff60a-0af1-4ffa-b589-bd906aa02cdc" (UID: "a53ff60a-0af1-4ffa-b589-bd906aa02cdc"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:10:25.912896 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:25.912841    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a53ff60a-0af1-4ffa-b589-bd906aa02cdc-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a53ff60a-0af1-4ffa-b589-bd906aa02cdc" (UID: "a53ff60a-0af1-4ffa-b589-bd906aa02cdc"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:10:26.011452 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:26.011417    2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a53ff60a-0af1-4ffa-b589-bd906aa02cdc-webhook-cert\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:10:26.011452 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:26.011447    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmdcg\" (UniqueName: \"kubernetes.io/projected/a53ff60a-0af1-4ffa-b589-bd906aa02cdc-kube-api-access-nmdcg\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:10:26.011649 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:26.011463    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a53ff60a-0af1-4ffa-b589-bd906aa02cdc-metrics-certs\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:10:26.557312 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:26.557274    2573 generic.go:356] "Generic (PLEG): container finished" podID="a53ff60a-0af1-4ffa-b589-bd906aa02cdc" containerID="8ba718cd7e6e37cba48c09751998f4f0face4272ec20a0c485a5a37b9e8e4696" exitCode=0
Sep 08 04:10:26.557807 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:26.557326    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cb48d57d-x2rpk"
Sep 08 04:10:26.557807 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:26.557362    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cb48d57d-x2rpk" event={"ID":"a53ff60a-0af1-4ffa-b589-bd906aa02cdc","Type":"ContainerDied","Data":"8ba718cd7e6e37cba48c09751998f4f0face4272ec20a0c485a5a37b9e8e4696"}
Sep 08 04:10:26.557807 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:26.557407    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cb48d57d-x2rpk" event={"ID":"a53ff60a-0af1-4ffa-b589-bd906aa02cdc","Type":"ContainerDied","Data":"925cae11ae95ef066e46c25e8c929e06b1e5673b872b530e65d8e0667a485685"}
Sep 08 04:10:26.557807 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:26.557429    2573 scope.go:117] "RemoveContainer" containerID="8ba718cd7e6e37cba48c09751998f4f0face4272ec20a0c485a5a37b9e8e4696"
Sep 08 04:10:26.566681 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:26.566665    2573 scope.go:117] "RemoveContainer" containerID="8ba718cd7e6e37cba48c09751998f4f0face4272ec20a0c485a5a37b9e8e4696"
Sep 08 04:10:26.566937 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:10:26.566920    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ba718cd7e6e37cba48c09751998f4f0face4272ec20a0c485a5a37b9e8e4696\": container with ID starting with 8ba718cd7e6e37cba48c09751998f4f0face4272ec20a0c485a5a37b9e8e4696 not found: ID does not exist" containerID="8ba718cd7e6e37cba48c09751998f4f0face4272ec20a0c485a5a37b9e8e4696"
Sep 08 04:10:26.566999 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:26.566949    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ba718cd7e6e37cba48c09751998f4f0face4272ec20a0c485a5a37b9e8e4696"} err="failed to get container status \"8ba718cd7e6e37cba48c09751998f4f0face4272ec20a0c485a5a37b9e8e4696\": rpc error: code = NotFound desc = could not find container \"8ba718cd7e6e37cba48c09751998f4f0face4272ec20a0c485a5a37b9e8e4696\": container with ID starting with 8ba718cd7e6e37cba48c09751998f4f0face4272ec20a0c485a5a37b9e8e4696 not found: ID does not exist"
Sep 08 04:10:26.583888 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:26.583860    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6cb48d57d-x2rpk"]
Sep 08 04:10:26.587572 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:26.587537    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6cb48d57d-x2rpk"]
Sep 08 04:10:26.674469 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:26.674446    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a53ff60a-0af1-4ffa-b589-bd906aa02cdc" path="/var/lib/kubelet/pods/a53ff60a-0af1-4ffa-b589-bd906aa02cdc/volumes"
Sep 08 04:10:47.406889 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:47.406841    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7df9d55888-qznvn"]
Sep 08 04:10:47.407276 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:47.407263    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a53ff60a-0af1-4ffa-b589-bd906aa02cdc" containerName="manager"
Sep 08 04:10:47.407322 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:47.407278    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a53ff60a-0af1-4ffa-b589-bd906aa02cdc" containerName="manager"
Sep 08 04:10:47.407363 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:47.407358    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a53ff60a-0af1-4ffa-b589-bd906aa02cdc" containerName="manager"
Sep 08 04:10:47.414049 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:47.414027    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7df9d55888-qznvn"
Sep 08 04:10:47.417333 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:47.417306    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 08 04:10:47.417456 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:47.417394    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 08 04:10:47.418379 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:47.418363    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-npqmj\""
Sep 08 04:10:47.422524 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:47.422504    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7df9d55888-qznvn"]
Sep 08 04:10:47.498512 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:47.498482    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3b812cb-6afb-425f-aa81-b486b0ee995f-openshift-service-ca\") pod \"maas-api-7df9d55888-qznvn\" (UID: \"d3b812cb-6afb-425f-aa81-b486b0ee995f\") " pod="odh-ai-gateway-infra/maas-api-7df9d55888-qznvn"
Sep 08 04:10:47.498512 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:47.498515    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4s8j\" (UniqueName: \"kubernetes.io/projected/d3b812cb-6afb-425f-aa81-b486b0ee995f-kube-api-access-q4s8j\") pod \"maas-api-7df9d55888-qznvn\" (UID: \"d3b812cb-6afb-425f-aa81-b486b0ee995f\") " pod="odh-ai-gateway-infra/maas-api-7df9d55888-qznvn"
Sep 08 04:10:47.498781 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:47.498543    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3b812cb-6afb-425f-aa81-b486b0ee995f-maas-api-tls\") pod \"maas-api-7df9d55888-qznvn\" (UID: \"d3b812cb-6afb-425f-aa81-b486b0ee995f\") " pod="odh-ai-gateway-infra/maas-api-7df9d55888-qznvn"
Sep 08 04:10:47.498781 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:47.498676    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3b812cb-6afb-425f-aa81-b486b0ee995f-metrics-certs\") pod \"maas-api-7df9d55888-qznvn\" (UID: \"d3b812cb-6afb-425f-aa81-b486b0ee995f\") " pod="odh-ai-gateway-infra/maas-api-7df9d55888-qznvn"
Sep 08 04:10:47.599712 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:47.599676    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3b812cb-6afb-425f-aa81-b486b0ee995f-metrics-certs\") pod \"maas-api-7df9d55888-qznvn\" (UID: \"d3b812cb-6afb-425f-aa81-b486b0ee995f\") " pod="odh-ai-gateway-infra/maas-api-7df9d55888-qznvn"
Sep 08 04:10:47.599897 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:47.599746    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3b812cb-6afb-425f-aa81-b486b0ee995f-openshift-service-ca\") pod \"maas-api-7df9d55888-qznvn\" (UID: \"d3b812cb-6afb-425f-aa81-b486b0ee995f\") " pod="odh-ai-gateway-infra/maas-api-7df9d55888-qznvn"
Sep 08 04:10:47.599897 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:47.599761    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4s8j\" (UniqueName: \"kubernetes.io/projected/d3b812cb-6afb-425f-aa81-b486b0ee995f-kube-api-access-q4s8j\") pod \"maas-api-7df9d55888-qznvn\" (UID: \"d3b812cb-6afb-425f-aa81-b486b0ee995f\") " pod="odh-ai-gateway-infra/maas-api-7df9d55888-qznvn"
Sep 08 04:10:47.599897 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:47.599786    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3b812cb-6afb-425f-aa81-b486b0ee995f-maas-api-tls\") pod \"maas-api-7df9d55888-qznvn\" (UID: \"d3b812cb-6afb-425f-aa81-b486b0ee995f\") " pod="odh-ai-gateway-infra/maas-api-7df9d55888-qznvn"
Sep 08 04:10:47.600507 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:47.600484    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3b812cb-6afb-425f-aa81-b486b0ee995f-openshift-service-ca\") pod \"maas-api-7df9d55888-qznvn\" (UID: \"d3b812cb-6afb-425f-aa81-b486b0ee995f\") " pod="odh-ai-gateway-infra/maas-api-7df9d55888-qznvn"
Sep 08 04:10:47.602364 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:47.602340    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3b812cb-6afb-425f-aa81-b486b0ee995f-maas-api-tls\") pod \"maas-api-7df9d55888-qznvn\" (UID: \"d3b812cb-6afb-425f-aa81-b486b0ee995f\") " pod="odh-ai-gateway-infra/maas-api-7df9d55888-qznvn"
Sep 08 04:10:47.602460 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:47.602413    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3b812cb-6afb-425f-aa81-b486b0ee995f-metrics-certs\") pod \"maas-api-7df9d55888-qznvn\" (UID: \"d3b812cb-6afb-425f-aa81-b486b0ee995f\") " pod="odh-ai-gateway-infra/maas-api-7df9d55888-qznvn"
Sep 08 04:10:47.609641 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:47.609619    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4s8j\" (UniqueName: \"kubernetes.io/projected/d3b812cb-6afb-425f-aa81-b486b0ee995f-kube-api-access-q4s8j\") pod \"maas-api-7df9d55888-qznvn\" (UID: \"d3b812cb-6afb-425f-aa81-b486b0ee995f\") " pod="odh-ai-gateway-infra/maas-api-7df9d55888-qznvn"
Sep 08 04:10:47.727473 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:47.727394    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7df9d55888-qznvn"
Sep 08 04:10:47.834108 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:47.834075    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-72hb9"]
Sep 08 04:10:47.845896 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:47.845864    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-72hb9"
Sep 08 04:10:47.848462 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:47.848434    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-wgzx4\""
Sep 08 04:10:47.848757 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:47.848735    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 08 04:10:47.848901 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:47.848876    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-72hb9"]
Sep 08 04:10:47.876346 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:47.876319    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-g6mbv"]
Sep 08 04:10:47.880025 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:47.880005    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-g6mbv"
Sep 08 04:10:47.891831 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:47.891808    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-g6mbv"]
Sep 08 04:10:47.903191 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:47.903168    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnzbd\" (UniqueName: \"kubernetes.io/projected/170d8dd1-15b0-4fb0-ab11-eefe97714cbd-kube-api-access-cnzbd\") pod \"payload-processing-5b54b7fbb7-72hb9\" (UID: \"170d8dd1-15b0-4fb0-ab11-eefe97714cbd\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-72hb9"
Sep 08 04:10:47.903307 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:47.903206    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/170d8dd1-15b0-4fb0-ab11-eefe97714cbd-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-72hb9\" (UID: \"170d8dd1-15b0-4fb0-ab11-eefe97714cbd\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-72hb9"
Sep 08 04:10:48.001366 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:48.001343    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7df9d55888-qznvn"]
Sep 08 04:10:48.003453 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:10:48.003420    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3b812cb_6afb_425f_aa81_b486b0ee995f.slice/crio-112d9dd91e91f2a2bfc2a2f370ab15b67c55703d1fec64cbe693f1511c2bfc29 WatchSource:0}: Error finding container 112d9dd91e91f2a2bfc2a2f370ab15b67c55703d1fec64cbe693f1511c2bfc29: Status 404 returned error can't find the container with id 112d9dd91e91f2a2bfc2a2f370ab15b67c55703d1fec64cbe693f1511c2bfc29
Sep 08 04:10:48.003825 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:48.003802    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/19d1b657-1b48-4e9c-9174-3052e1bc7b9e-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-g6mbv\" (UID: \"19d1b657-1b48-4e9c-9174-3052e1bc7b9e\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-g6mbv"
Sep 08 04:10:48.003974 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:48.003948    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnzbd\" (UniqueName: \"kubernetes.io/projected/170d8dd1-15b0-4fb0-ab11-eefe97714cbd-kube-api-access-cnzbd\") pod \"payload-processing-5b54b7fbb7-72hb9\" (UID: \"170d8dd1-15b0-4fb0-ab11-eefe97714cbd\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-72hb9"
Sep 08 04:10:48.004058 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:48.004040    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/170d8dd1-15b0-4fb0-ab11-eefe97714cbd-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-72hb9\" (UID: \"170d8dd1-15b0-4fb0-ab11-eefe97714cbd\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-72hb9"
Sep 08 04:10:48.004178 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:48.004092    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdg7g\" (UniqueName: \"kubernetes.io/projected/19d1b657-1b48-4e9c-9174-3052e1bc7b9e-kube-api-access-kdg7g\") pod \"payload-pre-processing-59fbc47bf8-g6mbv\" (UID: \"19d1b657-1b48-4e9c-9174-3052e1bc7b9e\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-g6mbv"
Sep 08 04:10:48.004993 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:48.004970    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/170d8dd1-15b0-4fb0-ab11-eefe97714cbd-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-72hb9\" (UID: \"170d8dd1-15b0-4fb0-ab11-eefe97714cbd\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-72hb9"
Sep 08 04:10:48.013712 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:48.013686    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnzbd\" (UniqueName: \"kubernetes.io/projected/170d8dd1-15b0-4fb0-ab11-eefe97714cbd-kube-api-access-cnzbd\") pod \"payload-processing-5b54b7fbb7-72hb9\" (UID: \"170d8dd1-15b0-4fb0-ab11-eefe97714cbd\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-72hb9"
Sep 08 04:10:48.105232 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:48.105199    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdg7g\" (UniqueName: \"kubernetes.io/projected/19d1b657-1b48-4e9c-9174-3052e1bc7b9e-kube-api-access-kdg7g\") pod \"payload-pre-processing-59fbc47bf8-g6mbv\" (UID: \"19d1b657-1b48-4e9c-9174-3052e1bc7b9e\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-g6mbv"
Sep 08 04:10:48.105412 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:48.105257    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/19d1b657-1b48-4e9c-9174-3052e1bc7b9e-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-g6mbv\" (UID: \"19d1b657-1b48-4e9c-9174-3052e1bc7b9e\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-g6mbv"
Sep 08 04:10:48.106034 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:48.106001    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/19d1b657-1b48-4e9c-9174-3052e1bc7b9e-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-g6mbv\" (UID: \"19d1b657-1b48-4e9c-9174-3052e1bc7b9e\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-g6mbv"
Sep 08 04:10:48.113120 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:48.113093    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdg7g\" (UniqueName: \"kubernetes.io/projected/19d1b657-1b48-4e9c-9174-3052e1bc7b9e-kube-api-access-kdg7g\") pod \"payload-pre-processing-59fbc47bf8-g6mbv\" (UID: \"19d1b657-1b48-4e9c-9174-3052e1bc7b9e\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-g6mbv"
Sep 08 04:10:48.157640 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:48.157617    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-72hb9"
Sep 08 04:10:48.190761 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:48.190727    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-g6mbv"
Sep 08 04:10:48.434180 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:48.434154    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-72hb9"]
Sep 08 04:10:48.434855 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:10:48.434828    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod170d8dd1_15b0_4fb0_ab11_eefe97714cbd.slice/crio-0768a46426831d1e468b121deb2d33cb8051e767911e5f894b08a5acce1fcdcf WatchSource:0}: Error finding container 0768a46426831d1e468b121deb2d33cb8051e767911e5f894b08a5acce1fcdcf: Status 404 returned error can't find the container with id 0768a46426831d1e468b121deb2d33cb8051e767911e5f894b08a5acce1fcdcf
Sep 08 04:10:48.472779 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:48.472754    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-g6mbv"]
Sep 08 04:10:48.474120 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:10:48.474100    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19d1b657_1b48_4e9c_9174_3052e1bc7b9e.slice/crio-6e5c4b8b600c07ac868df555a65336e1ddcdf95d033c1b5a41f378790a3dfb0e WatchSource:0}: Error finding container 6e5c4b8b600c07ac868df555a65336e1ddcdf95d033c1b5a41f378790a3dfb0e: Status 404 returned error can't find the container with id 6e5c4b8b600c07ac868df555a65336e1ddcdf95d033c1b5a41f378790a3dfb0e
Sep 08 04:10:48.678587 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:48.678472    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-g6mbv" event={"ID":"19d1b657-1b48-4e9c-9174-3052e1bc7b9e","Type":"ContainerStarted","Data":"6e5c4b8b600c07ac868df555a65336e1ddcdf95d033c1b5a41f378790a3dfb0e"}
Sep 08 04:10:48.679900 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:48.679871    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-72hb9" event={"ID":"170d8dd1-15b0-4fb0-ab11-eefe97714cbd","Type":"ContainerStarted","Data":"0768a46426831d1e468b121deb2d33cb8051e767911e5f894b08a5acce1fcdcf"}
Sep 08 04:10:48.684299 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:48.684276    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7df9d55888-qznvn" event={"ID":"d3b812cb-6afb-425f-aa81-b486b0ee995f","Type":"ContainerStarted","Data":"112d9dd91e91f2a2bfc2a2f370ab15b67c55703d1fec64cbe693f1511c2bfc29"}
Sep 08 04:10:50.726971 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:50.726875    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7df9d55888-qznvn" event={"ID":"d3b812cb-6afb-425f-aa81-b486b0ee995f","Type":"ContainerStarted","Data":"64bbd86fb74215e02d61cff31628c949263c8c6cc942fbb85da87370760324d1"}
Sep 08 04:10:50.727467 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:50.727028    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7df9d55888-qznvn"
Sep 08 04:10:50.745618 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:50.745500    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7df9d55888-qznvn" podStartSLOduration=1.314050588 podStartE2EDuration="3.745477209s" totalImagesPullingTime="2.431426621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:10:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:10:50.7444837 +0000 UTC m=+610.529774940" watchObservedRunningTime="2026-09-08 04:10:50.745477209 +0000 UTC m=+610.530768444"
Sep 08 04:10:51.733856 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:51.733822    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-g6mbv" event={"ID":"19d1b657-1b48-4e9c-9174-3052e1bc7b9e","Type":"ContainerStarted","Data":"a3067680f04fbe927af1f49aeb08c9a5c5154d22a2aaf181690c6da7c960e20d"}
Sep 08 04:10:51.734356 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:51.733899    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-g6mbv"
Sep 08 04:10:51.735591 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:51.735543    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-72hb9" event={"ID":"170d8dd1-15b0-4fb0-ab11-eefe97714cbd","Type":"ContainerStarted","Data":"3fafae2740c497ad0d9475fd7e58b919b4f7474d65b9c52c0fe22ac76a64e3b0"}
Sep 08 04:10:51.735746 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:51.735728    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-72hb9"
Sep 08 04:10:51.752267 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:51.752225    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-g6mbv" podStartSLOduration=2.211448454 podStartE2EDuration="4.752209029s" totalImagesPullingTime="2.540760575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:10:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:10:51.751989531 +0000 UTC m=+611.537280768" watchObservedRunningTime="2026-09-08 04:10:51.752209029 +0000 UTC m=+611.537500264"
Sep 08 04:10:51.770133 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:51.770088    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-72hb9" podStartSLOduration=2.183550149 podStartE2EDuration="4.770073745s" totalImagesPullingTime="2.586523596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:10:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:10:51.768169826 +0000 UTC m=+611.553461066" watchObservedRunningTime="2026-09-08 04:10:51.770073745 +0000 UTC m=+611.555364982"
Sep 08 04:10:56.741131 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:56.741100    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7df9d55888-qznvn"
Sep 08 04:10:57.770551 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:57.770518    2573 generic.go:356] "Generic (PLEG): container finished" podID="6ebf3915-eaae-4906-8fba-46f66c55d4e3" containerID="d264d0858638f17aeeb816fd1e160aeade9e0704a76e6605c8f556e2843d6395" exitCode=0
Sep 08 04:10:57.770952 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:57.770606    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4" event={"ID":"6ebf3915-eaae-4906-8fba-46f66c55d4e3","Type":"ContainerDied","Data":"d264d0858638f17aeeb816fd1e160aeade9e0704a76e6605c8f556e2843d6395"}
Sep 08 04:10:57.771010 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:57.770997    2573 scope.go:117] "RemoveContainer" containerID="d264d0858638f17aeeb816fd1e160aeade9e0704a76e6605c8f556e2843d6395"
Sep 08 04:10:57.772065 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:57.772036    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:10:57.772123 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:57.772110    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:10:57.772159 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:57.772145    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:10:58.778587 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:58.778534    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4" event={"ID":"6ebf3915-eaae-4906-8fba-46f66c55d4e3","Type":"ContainerStarted","Data":"10085d35e80848f4e312c70126510839df9f8094a5a729d4d14b9ff1317e7776"}
Sep 08 04:10:58.795298 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:58.795264    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4"
Sep 08 04:10:58.795537 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:58.795505    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-t6lf4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 08 04:10:58.795802 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:58.795774    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4" podUID="6ebf3915-eaae-4906-8fba-46f66c55d4e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 08 04:10:59.796271 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:59.796226    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-t6lf4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 08 04:10:59.796754 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:10:59.796288    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4" podUID="6ebf3915-eaae-4906-8fba-46f66c55d4e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 08 04:11:00.799648 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:00.799615    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-t6lf4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 08 04:11:00.800225 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:00.800193    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4" podUID="6ebf3915-eaae-4906-8fba-46f66c55d4e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 08 04:11:01.799636 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:01.799415    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-t6lf4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 08 04:11:01.800134 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:01.800107    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4" podUID="6ebf3915-eaae-4906-8fba-46f66c55d4e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 08 04:11:02.742726 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:02.742700    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-g6mbv"
Sep 08 04:11:02.742945 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:02.742928    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-72hb9"
Sep 08 04:11:02.804580 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:02.800900    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-t6lf4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 08 04:11:02.804580 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:02.800969    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4" podUID="6ebf3915-eaae-4906-8fba-46f66c55d4e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 08 04:11:03.799642 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:03.799610    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4"
Sep 08 04:11:03.799929 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:03.799903    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4"
Sep 08 04:11:03.800497 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:03.800479    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4"
Sep 08 04:11:43.239012 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:43.238977    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd"]
Sep 08 04:11:43.243409 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:43.243382    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd"
Sep 08 04:11:43.245777 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:43.245756    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ts7g5\""
Sep 08 04:11:43.246158 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:43.245956    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 08 04:11:43.246656 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:43.246636    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 08 04:11:43.246768 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:43.246665    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 08 04:11:43.253864 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:43.253840    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd"]
Sep 08 04:11:43.326765 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:43.326731    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50ce2858-9e59-4c56-8a04-a406002f646e-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd\" (UID: \"50ce2858-9e59-4c56-8a04-a406002f646e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd"
Sep 08 04:11:43.326942 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:43.326771    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50ce2858-9e59-4c56-8a04-a406002f646e-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd\" (UID: \"50ce2858-9e59-4c56-8a04-a406002f646e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd"
Sep 08 04:11:43.326942 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:43.326793    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50ce2858-9e59-4c56-8a04-a406002f646e-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd\" (UID: \"50ce2858-9e59-4c56-8a04-a406002f646e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd"
Sep 08 04:11:43.326942 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:43.326833    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gt8j4\" (UniqueName: \"kubernetes.io/projected/50ce2858-9e59-4c56-8a04-a406002f646e-kube-api-access-gt8j4\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd\" (UID: \"50ce2858-9e59-4c56-8a04-a406002f646e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd"
Sep 08 04:11:43.326942 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:43.326917    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50ce2858-9e59-4c56-8a04-a406002f646e-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd\" (UID: \"50ce2858-9e59-4c56-8a04-a406002f646e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd"
Sep 08 04:11:43.327153 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:43.327021    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50ce2858-9e59-4c56-8a04-a406002f646e-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd\" (UID: \"50ce2858-9e59-4c56-8a04-a406002f646e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd"
Sep 08 04:11:43.427605 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:43.427528    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50ce2858-9e59-4c56-8a04-a406002f646e-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd\" (UID: \"50ce2858-9e59-4c56-8a04-a406002f646e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd"
Sep 08 04:11:43.427769 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:43.427628    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50ce2858-9e59-4c56-8a04-a406002f646e-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd\" (UID: \"50ce2858-9e59-4c56-8a04-a406002f646e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd"
Sep 08 04:11:43.427769 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:43.427663    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50ce2858-9e59-4c56-8a04-a406002f646e-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd\" (UID: \"50ce2858-9e59-4c56-8a04-a406002f646e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd"
Sep 08 04:11:43.427769 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:43.427679    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50ce2858-9e59-4c56-8a04-a406002f646e-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd\" (UID: \"50ce2858-9e59-4c56-8a04-a406002f646e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd"
Sep 08 04:11:43.427769 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:43.427695    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50ce2858-9e59-4c56-8a04-a406002f646e-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd\" (UID: \"50ce2858-9e59-4c56-8a04-a406002f646e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd"
Sep 08 04:11:43.427769 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:43.427713    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gt8j4\" (UniqueName: \"kubernetes.io/projected/50ce2858-9e59-4c56-8a04-a406002f646e-kube-api-access-gt8j4\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd\" (UID: \"50ce2858-9e59-4c56-8a04-a406002f646e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd"
Sep 08 04:11:43.428032 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:43.427997    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50ce2858-9e59-4c56-8a04-a406002f646e-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd\" (UID: \"50ce2858-9e59-4c56-8a04-a406002f646e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd"
Sep 08 04:11:43.428110 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:43.428068    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50ce2858-9e59-4c56-8a04-a406002f646e-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd\" (UID: \"50ce2858-9e59-4c56-8a04-a406002f646e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd"
Sep 08 04:11:43.428110 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:43.428096    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50ce2858-9e59-4c56-8a04-a406002f646e-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd\" (UID: \"50ce2858-9e59-4c56-8a04-a406002f646e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd"
Sep 08 04:11:43.430027 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:43.429999    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50ce2858-9e59-4c56-8a04-a406002f646e-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd\" (UID: \"50ce2858-9e59-4c56-8a04-a406002f646e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd"
Sep 08 04:11:43.430192 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:43.430170    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50ce2858-9e59-4c56-8a04-a406002f646e-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd\" (UID: \"50ce2858-9e59-4c56-8a04-a406002f646e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd"
Sep 08 04:11:43.436148 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:43.436123    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gt8j4\" (UniqueName: \"kubernetes.io/projected/50ce2858-9e59-4c56-8a04-a406002f646e-kube-api-access-gt8j4\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd\" (UID: \"50ce2858-9e59-4c56-8a04-a406002f646e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd"
Sep 08 04:11:43.557464 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:43.557436    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd"
Sep 08 04:11:43.832226 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:43.832202    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd"]
Sep 08 04:11:43.837314 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:11:43.834442    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50ce2858_9e59_4c56_8a04_a406002f646e.slice/crio-c53365e5ba6fc04419b296bc887a979026eeb49425adb4da4712c5e10763c5df WatchSource:0}: Error finding container c53365e5ba6fc04419b296bc887a979026eeb49425adb4da4712c5e10763c5df: Status 404 returned error can't find the container with id c53365e5ba6fc04419b296bc887a979026eeb49425adb4da4712c5e10763c5df
Sep 08 04:11:43.838785 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:43.838765    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 04:11:44.030544 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:44.030509    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd" event={"ID":"50ce2858-9e59-4c56-8a04-a406002f646e","Type":"ContainerStarted","Data":"c53365e5ba6fc04419b296bc887a979026eeb49425adb4da4712c5e10763c5df"}
Sep 08 04:11:45.039866 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:45.039821    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd" event={"ID":"50ce2858-9e59-4c56-8a04-a406002f646e","Type":"ContainerStarted","Data":"512de1e4ff9d238f8d114289ab63221b3e56f8778572e05459e21c77fd190fbd"}
Sep 08 04:11:45.059631 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:45.059585    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd" podStartSLOduration=1.070326047 podStartE2EDuration="2.059570046s" totalImagesPullingTime="989.243999ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:11:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:11:45.057201613 +0000 UTC m=+664.842492852" watchObservedRunningTime="2026-09-08 04:11:45.059570046 +0000 UTC m=+664.844861272"
Sep 08 04:11:48.333486 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:48.333456    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-v9l9f"]
Sep 08 04:11:48.337423 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:48.337400    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v9l9f"
Sep 08 04:11:48.339481 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:48.339460    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 08 04:11:48.347141 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:48.347120    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-v9l9f"]
Sep 08 04:11:48.477741 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:48.477705    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmzjc\" (UniqueName: \"kubernetes.io/projected/e881d4ce-00b4-4734-a653-b2c836b45d36-kube-api-access-zmzjc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v9l9f\" (UID: \"e881d4ce-00b4-4734-a653-b2c836b45d36\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v9l9f"
Sep 08 04:11:48.478021 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:48.477750    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e881d4ce-00b4-4734-a653-b2c836b45d36-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v9l9f\" (UID: \"e881d4ce-00b4-4734-a653-b2c836b45d36\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v9l9f"
Sep 08 04:11:48.478021 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:48.477821    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e881d4ce-00b4-4734-a653-b2c836b45d36-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v9l9f\" (UID: \"e881d4ce-00b4-4734-a653-b2c836b45d36\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v9l9f"
Sep 08 04:11:48.478021 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:48.477926    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e881d4ce-00b4-4734-a653-b2c836b45d36-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v9l9f\" (UID: \"e881d4ce-00b4-4734-a653-b2c836b45d36\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v9l9f"
Sep 08 04:11:48.478021 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:48.477985    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e881d4ce-00b4-4734-a653-b2c836b45d36-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v9l9f\" (UID: \"e881d4ce-00b4-4734-a653-b2c836b45d36\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v9l9f"
Sep 08 04:11:48.478221 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:48.478077    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e881d4ce-00b4-4734-a653-b2c836b45d36-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v9l9f\" (UID: \"e881d4ce-00b4-4734-a653-b2c836b45d36\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v9l9f"
Sep 08 04:11:48.579326 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:48.579294    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmzjc\" (UniqueName: \"kubernetes.io/projected/e881d4ce-00b4-4734-a653-b2c836b45d36-kube-api-access-zmzjc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v9l9f\" (UID: \"e881d4ce-00b4-4734-a653-b2c836b45d36\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v9l9f"
Sep 08 04:11:48.579326 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:48.579328    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e881d4ce-00b4-4734-a653-b2c836b45d36-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v9l9f\" (UID: \"e881d4ce-00b4-4734-a653-b2c836b45d36\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v9l9f"
Sep 08 04:11:48.579606 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:48.579357    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e881d4ce-00b4-4734-a653-b2c836b45d36-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v9l9f\" (UID: \"e881d4ce-00b4-4734-a653-b2c836b45d36\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v9l9f"
Sep 08 04:11:48.579606 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:48.579389    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e881d4ce-00b4-4734-a653-b2c836b45d36-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v9l9f\" (UID: \"e881d4ce-00b4-4734-a653-b2c836b45d36\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v9l9f"
Sep 08 04:11:48.579606 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:48.579419    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e881d4ce-00b4-4734-a653-b2c836b45d36-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v9l9f\" (UID: \"e881d4ce-00b4-4734-a653-b2c836b45d36\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v9l9f"
Sep 08 04:11:48.579606 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:48.579575    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e881d4ce-00b4-4734-a653-b2c836b45d36-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v9l9f\" (UID: \"e881d4ce-00b4-4734-a653-b2c836b45d36\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v9l9f"
Sep 08 04:11:48.579934 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:48.579910    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e881d4ce-00b4-4734-a653-b2c836b45d36-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v9l9f\" (UID: \"e881d4ce-00b4-4734-a653-b2c836b45d36\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v9l9f"
Sep 08 04:11:48.580006 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:48.579939    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e881d4ce-00b4-4734-a653-b2c836b45d36-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v9l9f\" (UID: \"e881d4ce-00b4-4734-a653-b2c836b45d36\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v9l9f"
Sep 08 04:11:48.580006 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:48.579964    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e881d4ce-00b4-4734-a653-b2c836b45d36-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v9l9f\" (UID: \"e881d4ce-00b4-4734-a653-b2c836b45d36\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v9l9f"
Sep 08 04:11:48.581764 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:48.581744    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e881d4ce-00b4-4734-a653-b2c836b45d36-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v9l9f\" (UID: \"e881d4ce-00b4-4734-a653-b2c836b45d36\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v9l9f"
Sep 08 04:11:48.581981 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:48.581963    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e881d4ce-00b4-4734-a653-b2c836b45d36-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v9l9f\" (UID: \"e881d4ce-00b4-4734-a653-b2c836b45d36\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v9l9f"
Sep 08 04:11:48.587285 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:48.587222    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmzjc\" (UniqueName: \"kubernetes.io/projected/e881d4ce-00b4-4734-a653-b2c836b45d36-kube-api-access-zmzjc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v9l9f\" (UID: \"e881d4ce-00b4-4734-a653-b2c836b45d36\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v9l9f"
Sep 08 04:11:48.649750 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:48.649718    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v9l9f"
Sep 08 04:11:48.927589 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:48.927550    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-v9l9f"]
Sep 08 04:11:48.929278 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:11:48.929242    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode881d4ce_00b4_4734_a653_b2c836b45d36.slice/crio-03776cfe28033de401fe06f1ac79e481d2822f39fd1fee236f1b5a902e5cd07d WatchSource:0}: Error finding container 03776cfe28033de401fe06f1ac79e481d2822f39fd1fee236f1b5a902e5cd07d: Status 404 returned error can't find the container with id 03776cfe28033de401fe06f1ac79e481d2822f39fd1fee236f1b5a902e5cd07d
Sep 08 04:11:49.061803 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:49.061770    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v9l9f" event={"ID":"e881d4ce-00b4-4734-a653-b2c836b45d36","Type":"ContainerStarted","Data":"03776cfe28033de401fe06f1ac79e481d2822f39fd1fee236f1b5a902e5cd07d"}
Sep 08 04:11:50.068206 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:50.068169    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v9l9f" event={"ID":"e881d4ce-00b4-4734-a653-b2c836b45d36","Type":"ContainerStarted","Data":"40e17c89bfedfd2211a238e44f0fc0a4a8784f51eee235fa232ec7a818d3225a"}
Sep 08 04:11:50.089080 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:50.088871    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v9l9f" podStartSLOduration=1.925660362 podStartE2EDuration="2.088852937s" totalImagesPullingTime="163.192575ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:11:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:11:50.088667684 +0000 UTC m=+669.873958933" watchObservedRunningTime="2026-09-08 04:11:50.088852937 +0000 UTC m=+669.874144173"
Sep 08 04:11:53.558457 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:53.558409    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd"
Sep 08 04:11:53.558902 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:53.558477    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd"
Sep 08 04:11:53.571267 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:53.571240    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd"
Sep 08 04:11:54.100945 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:54.100912    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd"
Sep 08 04:11:56.050322 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:56.050287    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp"]
Sep 08 04:11:56.054226 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:56.054209    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp"
Sep 08 04:11:56.056532 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:56.056507    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 08 04:11:56.062410 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:56.062384    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp"]
Sep 08 04:11:56.156694 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:56.156662    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd53c8a1-2244-4e34-98d8-7223e39590dd-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp\" (UID: \"bd53c8a1-2244-4e34-98d8-7223e39590dd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp"
Sep 08 04:11:56.156857 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:56.156820    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd53c8a1-2244-4e34-98d8-7223e39590dd-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp\" (UID: \"bd53c8a1-2244-4e34-98d8-7223e39590dd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp"
Sep 08 04:11:56.156917 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:56.156877    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd53c8a1-2244-4e34-98d8-7223e39590dd-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp\" (UID: \"bd53c8a1-2244-4e34-98d8-7223e39590dd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp"
Sep 08 04:11:56.156959 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:56.156927    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd53c8a1-2244-4e34-98d8-7223e39590dd-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp\" (UID: \"bd53c8a1-2244-4e34-98d8-7223e39590dd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp"
Sep 08 04:11:56.156994 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:56.156958    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9zg6\" (UniqueName: \"kubernetes.io/projected/bd53c8a1-2244-4e34-98d8-7223e39590dd-kube-api-access-r9zg6\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp\" (UID: \"bd53c8a1-2244-4e34-98d8-7223e39590dd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp"
Sep 08 04:11:56.156994 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:56.156984    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd53c8a1-2244-4e34-98d8-7223e39590dd-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp\" (UID: \"bd53c8a1-2244-4e34-98d8-7223e39590dd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp"
Sep 08 04:11:56.257829 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:56.257789    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd53c8a1-2244-4e34-98d8-7223e39590dd-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp\" (UID: \"bd53c8a1-2244-4e34-98d8-7223e39590dd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp"
Sep 08 04:11:56.257988 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:56.257860    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd53c8a1-2244-4e34-98d8-7223e39590dd-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp\" (UID: \"bd53c8a1-2244-4e34-98d8-7223e39590dd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp"
Sep 08 04:11:56.257988 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:56.257895    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd53c8a1-2244-4e34-98d8-7223e39590dd-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp\" (UID: \"bd53c8a1-2244-4e34-98d8-7223e39590dd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp"
Sep 08 04:11:56.257988 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:56.257919    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9zg6\" (UniqueName: \"kubernetes.io/projected/bd53c8a1-2244-4e34-98d8-7223e39590dd-kube-api-access-r9zg6\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp\" (UID: \"bd53c8a1-2244-4e34-98d8-7223e39590dd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp"
Sep 08 04:11:56.257988 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:56.257948    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd53c8a1-2244-4e34-98d8-7223e39590dd-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp\" (UID: \"bd53c8a1-2244-4e34-98d8-7223e39590dd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp"
Sep 08 04:11:56.257988 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:56.257983    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd53c8a1-2244-4e34-98d8-7223e39590dd-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp\" (UID: \"bd53c8a1-2244-4e34-98d8-7223e39590dd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp"
Sep 08 04:11:56.258297 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:56.258234    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd53c8a1-2244-4e34-98d8-7223e39590dd-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp\" (UID: \"bd53c8a1-2244-4e34-98d8-7223e39590dd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp"
Sep 08 04:11:56.258297 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:56.258277    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd53c8a1-2244-4e34-98d8-7223e39590dd-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp\" (UID: \"bd53c8a1-2244-4e34-98d8-7223e39590dd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp"
Sep 08 04:11:56.258382 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:56.258329    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd53c8a1-2244-4e34-98d8-7223e39590dd-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp\" (UID: \"bd53c8a1-2244-4e34-98d8-7223e39590dd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp"
Sep 08 04:11:56.260381 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:56.260356    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd53c8a1-2244-4e34-98d8-7223e39590dd-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp\" (UID: \"bd53c8a1-2244-4e34-98d8-7223e39590dd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp"
Sep 08 04:11:56.260766 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:56.260746    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd53c8a1-2244-4e34-98d8-7223e39590dd-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp\" (UID: \"bd53c8a1-2244-4e34-98d8-7223e39590dd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp"
Sep 08 04:11:56.265908 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:56.265884    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9zg6\" (UniqueName: \"kubernetes.io/projected/bd53c8a1-2244-4e34-98d8-7223e39590dd-kube-api-access-r9zg6\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp\" (UID: \"bd53c8a1-2244-4e34-98d8-7223e39590dd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp"
Sep 08 04:11:56.365806 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:56.365738    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp"
Sep 08 04:11:56.636234 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:56.636210    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp"]
Sep 08 04:11:56.638063 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:11:56.638027    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd53c8a1_2244_4e34_98d8_7223e39590dd.slice/crio-39a0de69272818a41ef23b21931c03e4390994d8d56f4892410dce588c0c4136 WatchSource:0}: Error finding container 39a0de69272818a41ef23b21931c03e4390994d8d56f4892410dce588c0c4136: Status 404 returned error can't find the container with id 39a0de69272818a41ef23b21931c03e4390994d8d56f4892410dce588c0c4136
Sep 08 04:11:57.107319 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:57.107282    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp" event={"ID":"bd53c8a1-2244-4e34-98d8-7223e39590dd","Type":"ContainerStarted","Data":"02d716b89f8609cedee9dff36319196bd72dc38328cdd76ab1a4e5a6e079c44e"}
Sep 08 04:11:57.107712 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:57.107342    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp" event={"ID":"bd53c8a1-2244-4e34-98d8-7223e39590dd","Type":"ContainerStarted","Data":"39a0de69272818a41ef23b21931c03e4390994d8d56f4892410dce588c0c4136"}
Sep 08 04:11:57.127082 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:57.127031    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp" podStartSLOduration=0.954008803 podStartE2EDuration="1.127015651s" totalImagesPullingTime="173.006848ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:11:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:11:57.124349933 +0000 UTC m=+676.909641169" watchObservedRunningTime="2026-09-08 04:11:57.127015651 +0000 UTC m=+676.912306887"
Sep 08 04:11:58.650918 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:58.650878    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v9l9f"
Sep 08 04:11:58.651409 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:58.650940    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v9l9f"
Sep 08 04:11:58.663971 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:58.663946    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v9l9f"
Sep 08 04:11:59.132186 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:11:59.132156    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v9l9f"
Sep 08 04:12:06.365921 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:12:06.365878    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp"
Sep 08 04:12:06.366440 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:12:06.365964    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp"
Sep 08 04:12:06.378577 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:12:06.378524    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp"
Sep 08 04:12:07.180502 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:12:07.180468    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp"
Sep 08 04:13:33.152290 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:33.152260    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx"]
Sep 08 04:13:33.156443 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:33.156422    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx"
Sep 08 04:13:33.158806 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:33.158787    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-ff0f3e-serving-cert\""
Sep 08 04:13:33.164745 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:33.163460    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c26b6a29-57eb-40b5-81e7-acba8e12a666-openshift-service-ca\") pod \"maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx\" (UID: \"c26b6a29-57eb-40b5-81e7-acba8e12a666\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx"
Sep 08 04:13:33.164745 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:33.164622    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c26b6a29-57eb-40b5-81e7-acba8e12a666-metrics-certs\") pod \"maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx\" (UID: \"c26b6a29-57eb-40b5-81e7-acba8e12a666\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx"
Sep 08 04:13:33.164745 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:33.164672    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s79v5\" (UniqueName: \"kubernetes.io/projected/c26b6a29-57eb-40b5-81e7-acba8e12a666-kube-api-access-s79v5\") pod \"maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx\" (UID: \"c26b6a29-57eb-40b5-81e7-acba8e12a666\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx"
Sep 08 04:13:33.165002 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:33.164808    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c26b6a29-57eb-40b5-81e7-acba8e12a666-maas-api-tls\") pod \"maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx\" (UID: \"c26b6a29-57eb-40b5-81e7-acba8e12a666\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx"
Sep 08 04:13:33.167414 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:33.167375    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx"]
Sep 08 04:13:33.265619 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:33.265547    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c26b6a29-57eb-40b5-81e7-acba8e12a666-openshift-service-ca\") pod \"maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx\" (UID: \"c26b6a29-57eb-40b5-81e7-acba8e12a666\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx"
Sep 08 04:13:33.265789 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:33.265680    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c26b6a29-57eb-40b5-81e7-acba8e12a666-metrics-certs\") pod \"maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx\" (UID: \"c26b6a29-57eb-40b5-81e7-acba8e12a666\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx"
Sep 08 04:13:33.265789 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:33.265724    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s79v5\" (UniqueName: \"kubernetes.io/projected/c26b6a29-57eb-40b5-81e7-acba8e12a666-kube-api-access-s79v5\") pod \"maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx\" (UID: \"c26b6a29-57eb-40b5-81e7-acba8e12a666\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx"
Sep 08 04:13:33.265906 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:33.265789    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c26b6a29-57eb-40b5-81e7-acba8e12a666-maas-api-tls\") pod \"maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx\" (UID: \"c26b6a29-57eb-40b5-81e7-acba8e12a666\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx"
Sep 08 04:13:33.265963 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:13:33.265934    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-ff0f3e-serving-cert: secret "maas-api-e2e-inf-a-ff0f3e-serving-cert" not found
Sep 08 04:13:33.266038 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:13:33.266026    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c26b6a29-57eb-40b5-81e7-acba8e12a666-maas-api-tls podName:c26b6a29-57eb-40b5-81e7-acba8e12a666 nodeName:}" failed. No retries permitted until 2026-09-08 04:13:33.766004696 +0000 UTC m=+773.551295916 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c26b6a29-57eb-40b5-81e7-acba8e12a666-maas-api-tls") pod "maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx" (UID: "c26b6a29-57eb-40b5-81e7-acba8e12a666") : secret "maas-api-e2e-inf-a-ff0f3e-serving-cert" not found
Sep 08 04:13:33.266390 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:33.266349    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c26b6a29-57eb-40b5-81e7-acba8e12a666-openshift-service-ca\") pod \"maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx\" (UID: \"c26b6a29-57eb-40b5-81e7-acba8e12a666\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx"
Sep 08 04:13:33.268478 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:33.268460    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c26b6a29-57eb-40b5-81e7-acba8e12a666-metrics-certs\") pod \"maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx\" (UID: \"c26b6a29-57eb-40b5-81e7-acba8e12a666\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx"
Sep 08 04:13:33.274718 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:33.274702    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s79v5\" (UniqueName: \"kubernetes.io/projected/c26b6a29-57eb-40b5-81e7-acba8e12a666-kube-api-access-s79v5\") pod \"maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx\" (UID: \"c26b6a29-57eb-40b5-81e7-acba8e12a666\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx"
Sep 08 04:13:33.770766 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:33.770732    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c26b6a29-57eb-40b5-81e7-acba8e12a666-maas-api-tls\") pod \"maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx\" (UID: \"c26b6a29-57eb-40b5-81e7-acba8e12a666\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx"
Sep 08 04:13:33.770942 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:13:33.770903    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-ff0f3e-serving-cert: secret "maas-api-e2e-inf-a-ff0f3e-serving-cert" not found
Sep 08 04:13:33.771000 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:13:33.770984    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c26b6a29-57eb-40b5-81e7-acba8e12a666-maas-api-tls podName:c26b6a29-57eb-40b5-81e7-acba8e12a666 nodeName:}" failed. No retries permitted until 2026-09-08 04:13:34.770964258 +0000 UTC m=+774.556255473 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c26b6a29-57eb-40b5-81e7-acba8e12a666-maas-api-tls") pod "maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx" (UID: "c26b6a29-57eb-40b5-81e7-acba8e12a666") : secret "maas-api-e2e-inf-a-ff0f3e-serving-cert" not found
Sep 08 04:13:34.780877 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:34.780846    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c26b6a29-57eb-40b5-81e7-acba8e12a666-maas-api-tls\") pod \"maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx\" (UID: \"c26b6a29-57eb-40b5-81e7-acba8e12a666\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx"
Sep 08 04:13:34.783360 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:34.783332    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c26b6a29-57eb-40b5-81e7-acba8e12a666-maas-api-tls\") pod \"maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx\" (UID: \"c26b6a29-57eb-40b5-81e7-acba8e12a666\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx"
Sep 08 04:13:34.969262 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:34.969226    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx"
Sep 08 04:13:35.253693 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:35.253669    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx"]
Sep 08 04:13:35.255741 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:13:35.255715    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc26b6a29_57eb_40b5_81e7_acba8e12a666.slice/crio-8a20a62ee1f3b9b02b74fa7156c9cb4dbaf2dc7f603e22b1d281573c30a52d6f WatchSource:0}: Error finding container 8a20a62ee1f3b9b02b74fa7156c9cb4dbaf2dc7f603e22b1d281573c30a52d6f: Status 404 returned error can't find the container with id 8a20a62ee1f3b9b02b74fa7156c9cb4dbaf2dc7f603e22b1d281573c30a52d6f
Sep 08 04:13:35.659679 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:35.659643    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx" event={"ID":"c26b6a29-57eb-40b5-81e7-acba8e12a666","Type":"ContainerStarted","Data":"8a20a62ee1f3b9b02b74fa7156c9cb4dbaf2dc7f603e22b1d281573c30a52d6f"}
Sep 08 04:13:36.666351 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:36.666313    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx" event={"ID":"c26b6a29-57eb-40b5-81e7-acba8e12a666","Type":"ContainerStarted","Data":"9ce79f9d04de1dce50d05d771bbbe62e344d6a735d1b19617870b895aca642e8"}
Sep 08 04:13:36.666759 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:36.666374    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx"
Sep 08 04:13:36.683650 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:36.683587    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx" podStartSLOduration=3.336977334 podStartE2EDuration="3.683571948s" totalImagesPullingTime="346.594614ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:13:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:13:36.681770455 +0000 UTC m=+776.467061692" watchObservedRunningTime="2026-09-08 04:13:36.683571948 +0000 UTC m=+776.468863175"
Sep 08 04:13:37.466676 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:37.466645    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"]
Sep 08 04:13:37.470390 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:37.470372    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"
Sep 08 04:13:37.473980 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:37.473960    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-8d710ebd-openshift-default-dockercfg-jdszg\""
Sep 08 04:13:37.508393 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:37.508367    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-istio-podinfo\") pod \"e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x\" (UID: \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\") " pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"
Sep 08 04:13:37.508536 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:37.508407    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-workload-certs\") pod \"e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x\" (UID: \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\") " pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"
Sep 08 04:13:37.508536 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:37.508449    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-credential-socket\") pod \"e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x\" (UID: \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\") " pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"
Sep 08 04:13:37.508680 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:37.508549    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-istio-data\") pod \"e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x\" (UID: \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\") " pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"
Sep 08 04:13:37.508680 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:37.508652    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gfh4\" (UniqueName: \"kubernetes.io/projected/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-kube-api-access-9gfh4\") pod \"e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x\" (UID: \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\") " pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"
Sep 08 04:13:37.508779 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:37.508694    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-istio-token\") pod \"e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x\" (UID: \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\") " pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"
Sep 08 04:13:37.508779 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:37.508746    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-workload-socket\") pod \"e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x\" (UID: \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\") " pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"
Sep 08 04:13:37.508869 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:37.508779    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-istio-envoy\") pod \"e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x\" (UID: \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\") " pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"
Sep 08 04:13:37.508869 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:37.508809    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-istiod-ca-cert\") pod \"e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x\" (UID: \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\") " pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"
Sep 08 04:13:37.557756 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:37.557723    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"]
Sep 08 04:13:37.609632 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:37.609582    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-workload-certs\") pod \"e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x\" (UID: \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\") " pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"
Sep 08 04:13:37.609632 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:37.609635    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-credential-socket\") pod \"e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x\" (UID: \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\") " pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"
Sep 08 04:13:37.609879 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:37.609697    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-istio-data\") pod \"e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x\" (UID: \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\") " pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"
Sep 08 04:13:37.609879 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:37.609762    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gfh4\" (UniqueName: \"kubernetes.io/projected/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-kube-api-access-9gfh4\") pod \"e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x\" (UID: \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\") " pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"
Sep 08 04:13:37.609879 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:37.609791    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-istio-token\") pod \"e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x\" (UID: \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\") " pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"
Sep 08 04:13:37.609879 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:37.609837    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-workload-socket\") pod \"e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x\" (UID: \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\") " pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"
Sep 08 04:13:37.609879 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:37.609876    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-istio-envoy\") pod \"e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x\" (UID: \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\") " pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"
Sep 08 04:13:37.610134 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:37.609905    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-istiod-ca-cert\") pod \"e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x\" (UID: \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\") " pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"
Sep 08 04:13:37.610134 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:37.609963    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-istio-podinfo\") pod \"e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x\" (UID: \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\") " pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"
Sep 08 04:13:37.610134 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:37.609994    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-credential-socket\") pod \"e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x\" (UID: \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\") " pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"
Sep 08 04:13:37.610134 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:37.610072    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-workload-certs\") pod \"e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x\" (UID: \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\") " pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"
Sep 08 04:13:37.610134 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:37.610093    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-istio-data\") pod \"e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x\" (UID: \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\") " pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"
Sep 08 04:13:37.610405 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:37.610234    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-workload-socket\") pod \"e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x\" (UID: \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\") " pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"
Sep 08 04:13:37.610707 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:37.610689    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-istiod-ca-cert\") pod \"e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x\" (UID: \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\") " pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"
Sep 08 04:13:37.612381 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:37.612359    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-istio-envoy\") pod \"e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x\" (UID: \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\") " pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"
Sep 08 04:13:37.612506 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:37.612488    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-istio-podinfo\") pod \"e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x\" (UID: \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\") " pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"
Sep 08 04:13:37.620944 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:37.620916    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-istio-token\") pod \"e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x\" (UID: \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\") " pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"
Sep 08 04:13:37.621346 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:37.621323    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gfh4\" (UniqueName: \"kubernetes.io/projected/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-kube-api-access-9gfh4\") pod \"e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x\" (UID: \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\") " pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"
Sep 08 04:13:37.781137 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:37.781106    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"
Sep 08 04:13:38.060395 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:38.060366    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"]
Sep 08 04:13:38.061246 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:13:38.061221    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cf9ce6d_918d_4f62_82ed_3dec68c0f956.slice/crio-94dcd71ed1cc23cc3840e97293ccd8ac4a9aef0f771e869a1aa93f3022988985 WatchSource:0}: Error finding container 94dcd71ed1cc23cc3840e97293ccd8ac4a9aef0f771e869a1aa93f3022988985: Status 404 returned error can't find the container with id 94dcd71ed1cc23cc3840e97293ccd8ac4a9aef0f771e869a1aa93f3022988985
Sep 08 04:13:38.063496 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:38.063460    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:13:38.063595 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:38.063528    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:13:38.063595 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:38.063586    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:13:38.678644 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:38.678608    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x" event={"ID":"3cf9ce6d-918d-4f62-82ed-3dec68c0f956","Type":"ContainerStarted","Data":"59cf60cb0d0bdd3be2d045597dec7bf1a9aec78d40d3e6010b85cdcbec67ca01"}
Sep 08 04:13:38.678976 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:38.678666    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x" event={"ID":"3cf9ce6d-918d-4f62-82ed-3dec68c0f956","Type":"ContainerStarted","Data":"94dcd71ed1cc23cc3840e97293ccd8ac4a9aef0f771e869a1aa93f3022988985"}
Sep 08 04:13:38.702769 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:38.702728    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x" podStartSLOduration=1.702713288 podStartE2EDuration="1.702713288s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:13:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:13:38.701120071 +0000 UTC m=+778.486411319" watchObservedRunningTime="2026-09-08 04:13:38.702713288 +0000 UTC m=+778.488004525"
Sep 08 04:13:38.782277 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:38.782250    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"
Sep 08 04:13:39.786423 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:39.786390    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"
Sep 08 04:13:40.691444 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:40.691407    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"
Sep 08 04:13:40.692447 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:40.692425    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"
Sep 08 04:13:41.361623 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:41.361326    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg"]
Sep 08 04:13:41.365105 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:41.365083    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg"
Sep 08 04:13:41.367333 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:41.367306    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-8d710ebd-serving-cert\""
Sep 08 04:13:41.374917 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:41.374895    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg"]
Sep 08 04:13:41.450229 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:41.450188    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02d9d531-85e7-4276-8d6e-0abe68641289-openshift-service-ca\") pod \"maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg\" (UID: \"02d9d531-85e7-4276-8d6e-0abe68641289\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg"
Sep 08 04:13:41.450390 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:41.450268    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02d9d531-85e7-4276-8d6e-0abe68641289-metrics-certs\") pod \"maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg\" (UID: \"02d9d531-85e7-4276-8d6e-0abe68641289\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg"
Sep 08 04:13:41.450390 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:41.450316    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pgv2\" (UniqueName: \"kubernetes.io/projected/02d9d531-85e7-4276-8d6e-0abe68641289-kube-api-access-2pgv2\") pod \"maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg\" (UID: \"02d9d531-85e7-4276-8d6e-0abe68641289\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg"
Sep 08 04:13:41.450465 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:41.450391    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02d9d531-85e7-4276-8d6e-0abe68641289-maas-api-tls\") pod \"maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg\" (UID: \"02d9d531-85e7-4276-8d6e-0abe68641289\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg"
Sep 08 04:13:41.551874 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:41.551838    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pgv2\" (UniqueName: \"kubernetes.io/projected/02d9d531-85e7-4276-8d6e-0abe68641289-kube-api-access-2pgv2\") pod \"maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg\" (UID: \"02d9d531-85e7-4276-8d6e-0abe68641289\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg"
Sep 08 04:13:41.552064 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:41.551895    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02d9d531-85e7-4276-8d6e-0abe68641289-maas-api-tls\") pod \"maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg\" (UID: \"02d9d531-85e7-4276-8d6e-0abe68641289\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg"
Sep 08 04:13:41.552064 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:41.551955    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02d9d531-85e7-4276-8d6e-0abe68641289-openshift-service-ca\") pod \"maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg\" (UID: \"02d9d531-85e7-4276-8d6e-0abe68641289\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg"
Sep 08 04:13:41.552064 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:41.552004    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02d9d531-85e7-4276-8d6e-0abe68641289-metrics-certs\") pod \"maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg\" (UID: \"02d9d531-85e7-4276-8d6e-0abe68641289\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg"
Sep 08 04:13:41.552248 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:13:41.552068    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-8d710ebd-serving-cert: secret "maas-api-e2e-ait-8d710ebd-serving-cert" not found
Sep 08 04:13:41.552248 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:13:41.552147    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02d9d531-85e7-4276-8d6e-0abe68641289-maas-api-tls podName:02d9d531-85e7-4276-8d6e-0abe68641289 nodeName:}" failed. No retries permitted until 2026-09-08 04:13:42.052125352 +0000 UTC m=+781.837416585 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/02d9d531-85e7-4276-8d6e-0abe68641289-maas-api-tls") pod "maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg" (UID: "02d9d531-85e7-4276-8d6e-0abe68641289") : secret "maas-api-e2e-ait-8d710ebd-serving-cert" not found
Sep 08 04:13:41.552676 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:41.552653    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02d9d531-85e7-4276-8d6e-0abe68641289-openshift-service-ca\") pod \"maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg\" (UID: \"02d9d531-85e7-4276-8d6e-0abe68641289\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg"
Sep 08 04:13:41.554538 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:41.554521    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02d9d531-85e7-4276-8d6e-0abe68641289-metrics-certs\") pod \"maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg\" (UID: \"02d9d531-85e7-4276-8d6e-0abe68641289\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg"
Sep 08 04:13:41.559908 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:41.559883    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pgv2\" (UniqueName: \"kubernetes.io/projected/02d9d531-85e7-4276-8d6e-0abe68641289-kube-api-access-2pgv2\") pod \"maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg\" (UID: \"02d9d531-85e7-4276-8d6e-0abe68641289\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg"
Sep 08 04:13:42.057149 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:42.057115    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02d9d531-85e7-4276-8d6e-0abe68641289-maas-api-tls\") pod \"maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg\" (UID: \"02d9d531-85e7-4276-8d6e-0abe68641289\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg"
Sep 08 04:13:42.060126 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:42.060095    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02d9d531-85e7-4276-8d6e-0abe68641289-maas-api-tls\") pod \"maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg\" (UID: \"02d9d531-85e7-4276-8d6e-0abe68641289\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg"
Sep 08 04:13:42.280399 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:42.280362    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg"
Sep 08 04:13:42.558014 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:42.557988    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg"]
Sep 08 04:13:42.559042 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:13:42.559019    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02d9d531_85e7_4276_8d6e_0abe68641289.slice/crio-5539bef8b5ffbc0cc3187e512e5d94ec0733541b249f618e0e3735a792826a11 WatchSource:0}: Error finding container 5539bef8b5ffbc0cc3187e512e5d94ec0733541b249f618e0e3735a792826a11: Status 404 returned error can't find the container with id 5539bef8b5ffbc0cc3187e512e5d94ec0733541b249f618e0e3735a792826a11
Sep 08 04:13:42.677786 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:42.677701    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx"
Sep 08 04:13:42.704715 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:42.704666    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg" event={"ID":"02d9d531-85e7-4276-8d6e-0abe68641289","Type":"ContainerStarted","Data":"5539bef8b5ffbc0cc3187e512e5d94ec0733541b249f618e0e3735a792826a11"}
Sep 08 04:13:43.712348 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:43.712314    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg" event={"ID":"02d9d531-85e7-4276-8d6e-0abe68641289","Type":"ContainerStarted","Data":"94dbf360f6dd84cb333bf63a8813308dc6ebe82c805165d6183581b53024dd5b"}
Sep 08 04:13:43.712780 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:43.712450    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg"
Sep 08 04:13:43.730254 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:43.730195    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg" podStartSLOduration=2.410644604 podStartE2EDuration="2.730177978s" totalImagesPullingTime="319.533374ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:13:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:13:43.72964375 +0000 UTC m=+783.514934998" watchObservedRunningTime="2026-09-08 04:13:43.730177978 +0000 UTC m=+783.515469215"
Sep 08 04:13:49.723226 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:49.723197    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg"
Sep 08 04:13:55.946946 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:55.945634    2573 patch_prober.go:28] interesting pod/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": read tcp 10.134.0.2:43992->10.134.0.51:15021: read: connection reset by peer" start-of-body=
Sep 08 04:13:55.946946 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:55.945707    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x" podUID="3cf9ce6d-918d-4f62-82ed-3dec68c0f956" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": read tcp 10.134.0.2:43992->10.134.0.51:15021: read: connection reset by peer"
Sep 08 04:13:56.786771 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:56.786735    2573 generic.go:356] "Generic (PLEG): container finished" podID="3cf9ce6d-918d-4f62-82ed-3dec68c0f956" containerID="59cf60cb0d0bdd3be2d045597dec7bf1a9aec78d40d3e6010b85cdcbec67ca01" exitCode=0
Sep 08 04:13:56.786973 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:56.786817    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x" event={"ID":"3cf9ce6d-918d-4f62-82ed-3dec68c0f956","Type":"ContainerDied","Data":"59cf60cb0d0bdd3be2d045597dec7bf1a9aec78d40d3e6010b85cdcbec67ca01"}
Sep 08 04:13:56.787321 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:56.787303    2573 scope.go:117] "RemoveContainer" containerID="59cf60cb0d0bdd3be2d045597dec7bf1a9aec78d40d3e6010b85cdcbec67ca01"
Sep 08 04:13:56.788760 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:56.788727    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:13:56.788866 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:56.788818    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:13:56.788936 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:56.788868    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:13:57.529142 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:57.529107    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"]
Sep 08 04:13:57.543412 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:57.542728    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"
Sep 08 04:13:57.545472 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:57.545446    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"]
Sep 08 04:13:57.545931 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:57.545859    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-cf5ae2-openshift-default-dockercfg-n7c6g\""
Sep 08 04:13:57.726013 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:57.725978    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de329c00-1862-45e1-9091-0a6f50f7d988-workload-certs\") pod \"e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds\" (UID: \"de329c00-1862-45e1-9091-0a6f50f7d988\") " pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"
Sep 08 04:13:57.726196 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:57.726031    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de329c00-1862-45e1-9091-0a6f50f7d988-istio-data\") pod \"e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds\" (UID: \"de329c00-1862-45e1-9091-0a6f50f7d988\") " pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"
Sep 08 04:13:57.726196 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:57.726089    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de329c00-1862-45e1-9091-0a6f50f7d988-istiod-ca-cert\") pod \"e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds\" (UID: \"de329c00-1862-45e1-9091-0a6f50f7d988\") " pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"
Sep 08 04:13:57.726196 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:57.726161    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de329c00-1862-45e1-9091-0a6f50f7d988-istio-token\") pod \"e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds\" (UID: \"de329c00-1862-45e1-9091-0a6f50f7d988\") " pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"
Sep 08 04:13:57.726386 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:57.726239    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de329c00-1862-45e1-9091-0a6f50f7d988-credential-socket\") pod \"e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds\" (UID: \"de329c00-1862-45e1-9091-0a6f50f7d988\") " pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"
Sep 08 04:13:57.726386 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:57.726290    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de329c00-1862-45e1-9091-0a6f50f7d988-istio-podinfo\") pod \"e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds\" (UID: \"de329c00-1862-45e1-9091-0a6f50f7d988\") " pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"
Sep 08 04:13:57.726386 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:57.726332    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr24w\" (UniqueName: \"kubernetes.io/projected/de329c00-1862-45e1-9091-0a6f50f7d988-kube-api-access-vr24w\") pod \"e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds\" (UID: \"de329c00-1862-45e1-9091-0a6f50f7d988\") " pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"
Sep 08 04:13:57.726533 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:57.726395    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de329c00-1862-45e1-9091-0a6f50f7d988-workload-socket\") pod \"e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds\" (UID: \"de329c00-1862-45e1-9091-0a6f50f7d988\") " pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"
Sep 08 04:13:57.726533 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:57.726438    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de329c00-1862-45e1-9091-0a6f50f7d988-istio-envoy\") pod \"e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds\" (UID: \"de329c00-1862-45e1-9091-0a6f50f7d988\") " pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"
Sep 08 04:13:57.795708 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:57.795634    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x" event={"ID":"3cf9ce6d-918d-4f62-82ed-3dec68c0f956","Type":"ContainerStarted","Data":"e334c800dac0519cb9986a36b443b1511890f6f6313792c6145fe49708e614d4"}
Sep 08 04:13:57.827048 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:57.827020    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de329c00-1862-45e1-9091-0a6f50f7d988-istio-envoy\") pod \"e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds\" (UID: \"de329c00-1862-45e1-9091-0a6f50f7d988\") " pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"
Sep 08 04:13:57.827219 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:57.827080    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de329c00-1862-45e1-9091-0a6f50f7d988-workload-certs\") pod \"e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds\" (UID: \"de329c00-1862-45e1-9091-0a6f50f7d988\") " pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"
Sep 08 04:13:57.827219 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:57.827112    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de329c00-1862-45e1-9091-0a6f50f7d988-istio-data\") pod \"e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds\" (UID: \"de329c00-1862-45e1-9091-0a6f50f7d988\") " pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"
Sep 08 04:13:57.827219 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:57.827128    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de329c00-1862-45e1-9091-0a6f50f7d988-istiod-ca-cert\") pod \"e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds\" (UID: \"de329c00-1862-45e1-9091-0a6f50f7d988\") " pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"
Sep 08 04:13:57.827219 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:57.827200    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de329c00-1862-45e1-9091-0a6f50f7d988-istio-token\") pod \"e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds\" (UID: \"de329c00-1862-45e1-9091-0a6f50f7d988\") " pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"
Sep 08 04:13:57.827460 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:57.827241    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de329c00-1862-45e1-9091-0a6f50f7d988-credential-socket\") pod \"e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds\" (UID: \"de329c00-1862-45e1-9091-0a6f50f7d988\") " pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"
Sep 08 04:13:57.827460 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:57.827266    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de329c00-1862-45e1-9091-0a6f50f7d988-istio-podinfo\") pod \"e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds\" (UID: \"de329c00-1862-45e1-9091-0a6f50f7d988\") " pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"
Sep 08 04:13:57.827460 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:57.827296    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr24w\" (UniqueName: \"kubernetes.io/projected/de329c00-1862-45e1-9091-0a6f50f7d988-kube-api-access-vr24w\") pod \"e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds\" (UID: \"de329c00-1862-45e1-9091-0a6f50f7d988\") " pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"
Sep 08 04:13:57.827460 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:57.827402    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de329c00-1862-45e1-9091-0a6f50f7d988-workload-socket\") pod \"e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds\" (UID: \"de329c00-1862-45e1-9091-0a6f50f7d988\") " pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"
Sep 08 04:13:57.827715 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:57.827538    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de329c00-1862-45e1-9091-0a6f50f7d988-workload-certs\") pod \"e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds\" (UID: \"de329c00-1862-45e1-9091-0a6f50f7d988\") " pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"
Sep 08 04:13:57.827715 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:57.827670    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de329c00-1862-45e1-9091-0a6f50f7d988-istio-data\") pod \"e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds\" (UID: \"de329c00-1862-45e1-9091-0a6f50f7d988\") " pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"
Sep 08 04:13:57.827826 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:57.827735    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de329c00-1862-45e1-9091-0a6f50f7d988-workload-socket\") pod \"e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds\" (UID: \"de329c00-1862-45e1-9091-0a6f50f7d988\") " pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"
Sep 08 04:13:57.828141 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:57.828115    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de329c00-1862-45e1-9091-0a6f50f7d988-credential-socket\") pod \"e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds\" (UID: \"de329c00-1862-45e1-9091-0a6f50f7d988\") " pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"
Sep 08 04:13:57.828238 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:57.828207    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de329c00-1862-45e1-9091-0a6f50f7d988-istiod-ca-cert\") pod \"e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds\" (UID: \"de329c00-1862-45e1-9091-0a6f50f7d988\") " pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"
Sep 08 04:13:57.829515 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:57.829484    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de329c00-1862-45e1-9091-0a6f50f7d988-istio-envoy\") pod \"e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds\" (UID: \"de329c00-1862-45e1-9091-0a6f50f7d988\") " pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"
Sep 08 04:13:57.829818 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:57.829800    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de329c00-1862-45e1-9091-0a6f50f7d988-istio-podinfo\") pod \"e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds\" (UID: \"de329c00-1862-45e1-9091-0a6f50f7d988\") " pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"
Sep 08 04:13:57.835517 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:57.835491    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr24w\" (UniqueName: \"kubernetes.io/projected/de329c00-1862-45e1-9091-0a6f50f7d988-kube-api-access-vr24w\") pod \"e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds\" (UID: \"de329c00-1862-45e1-9091-0a6f50f7d988\") " pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"
Sep 08 04:13:57.835684 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:57.835663    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de329c00-1862-45e1-9091-0a6f50f7d988-istio-token\") pod \"e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds\" (UID: \"de329c00-1862-45e1-9091-0a6f50f7d988\") " pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"
Sep 08 04:13:57.857567 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:57.857532    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"
Sep 08 04:13:58.137362 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:58.137333    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"]
Sep 08 04:13:58.138297 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:13:58.138274    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde329c00_1862_45e1_9091_0a6f50f7d988.slice/crio-89c3008162d69bbf08faf0ddc2dd729e5f0220249012c3c778484dd6351f7455 WatchSource:0}: Error finding container 89c3008162d69bbf08faf0ddc2dd729e5f0220249012c3c778484dd6351f7455: Status 404 returned error can't find the container with id 89c3008162d69bbf08faf0ddc2dd729e5f0220249012c3c778484dd6351f7455
Sep 08 04:13:58.140538 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:58.140504    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:13:58.140676 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:58.140601    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:13:58.140676 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:58.140646    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:13:58.782404 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:58.782366    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"
Sep 08 04:13:58.782796 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:58.782587    2573 patch_prober.go:28] interesting pod/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 08 04:13:58.782796 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:58.782632    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x" podUID="3cf9ce6d-918d-4f62-82ed-3dec68c0f956" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 08 04:13:58.808114 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:58.808070    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds" event={"ID":"de329c00-1862-45e1-9091-0a6f50f7d988","Type":"ContainerStarted","Data":"94627dc1b85bdd93c923da73c76671fb47df572789a094faf93e48721c0d3adc"}
Sep 08 04:13:58.808306 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:58.808136    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds" event={"ID":"de329c00-1862-45e1-9091-0a6f50f7d988","Type":"ContainerStarted","Data":"89c3008162d69bbf08faf0ddc2dd729e5f0220249012c3c778484dd6351f7455"}
Sep 08 04:13:58.858179 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:58.858149    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"
Sep 08 04:13:59.782451 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:59.782420    2573 patch_prober.go:28] interesting pod/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 08 04:13:59.782831 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:59.782476    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x" podUID="3cf9ce6d-918d-4f62-82ed-3dec68c0f956" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 08 04:13:59.862737 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:59.862702    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"
Sep 08 04:13:59.882308 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:13:59.882260    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds" podStartSLOduration=2.882244566 podStartE2EDuration="2.882244566s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:13:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:13:58.855134145 +0000 UTC m=+798.640425383" watchObservedRunningTime="2026-09-08 04:13:59.882244566 +0000 UTC m=+799.667535821"
Sep 08 04:14:00.781653 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:00.781617    2573 patch_prober.go:28] interesting pod/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 08 04:14:00.781798 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:00.781669    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x" podUID="3cf9ce6d-918d-4f62-82ed-3dec68c0f956" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 08 04:14:00.821424 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:00.821397    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"
Sep 08 04:14:00.822433 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:00.822408    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"
Sep 08 04:14:01.782505 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:01.782434    2573 patch_prober.go:28] interesting pod/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 08 04:14:01.782505 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:01.782485    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x" podUID="3cf9ce6d-918d-4f62-82ed-3dec68c0f956" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 08 04:14:02.781971 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:02.781931    2573 patch_prober.go:28] interesting pod/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 08 04:14:02.782368 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:02.781990    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x" podUID="3cf9ce6d-918d-4f62-82ed-3dec68c0f956" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 08 04:14:03.785907 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:03.785878    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"
Sep 08 04:14:03.786337 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:03.786164    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"
Sep 08 04:14:03.787004 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:03.786978    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"
Sep 08 04:14:16.815074 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:16.813957    2573 patch_prober.go:28] interesting pod/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": read tcp 10.134.0.2:48908->10.134.0.53:15021: read: connection reset by peer" start-of-body=
Sep 08 04:14:16.815074 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:16.814028    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds" podUID="de329c00-1862-45e1-9091-0a6f50f7d988" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": read tcp 10.134.0.2:48908->10.134.0.53:15021: read: connection reset by peer"
Sep 08 04:14:16.921296 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:16.921261    2573 generic.go:356] "Generic (PLEG): container finished" podID="de329c00-1862-45e1-9091-0a6f50f7d988" containerID="94627dc1b85bdd93c923da73c76671fb47df572789a094faf93e48721c0d3adc" exitCode=0
Sep 08 04:14:16.921444 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:16.921335    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds" event={"ID":"de329c00-1862-45e1-9091-0a6f50f7d988","Type":"ContainerDied","Data":"94627dc1b85bdd93c923da73c76671fb47df572789a094faf93e48721c0d3adc"}
Sep 08 04:14:16.921772 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:16.921758    2573 scope.go:117] "RemoveContainer" containerID="94627dc1b85bdd93c923da73c76671fb47df572789a094faf93e48721c0d3adc"
Sep 08 04:14:16.922935 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:16.922906    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:14:16.923043 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:16.922990    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:14:16.923107 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:16.923042    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:14:17.930670 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:17.930636    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds" event={"ID":"de329c00-1862-45e1-9091-0a6f50f7d988","Type":"ContainerStarted","Data":"f4a4f38083c555aa4e694587919d7764c6420fc2a026770a5c87144f895a825f"}
Sep 08 04:14:18.857939 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:18.857905    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"
Sep 08 04:14:18.858132 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:18.858107    2573 patch_prober.go:28] interesting pod/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 08 04:14:18.858182 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:18.858162    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds" podUID="de329c00-1862-45e1-9091-0a6f50f7d988" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 08 04:14:19.858108 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:19.858071    2573 patch_prober.go:28] interesting pod/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 08 04:14:19.858623 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:19.858133    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds" podUID="de329c00-1862-45e1-9091-0a6f50f7d988" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 08 04:14:20.858808 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:20.858773    2573 patch_prober.go:28] interesting pod/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 08 04:14:20.859250 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:20.858829    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds" podUID="de329c00-1862-45e1-9091-0a6f50f7d988" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 08 04:14:21.858327 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:21.858285    2573 patch_prober.go:28] interesting pod/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 08 04:14:21.858500 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:21.858350    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds" podUID="de329c00-1862-45e1-9091-0a6f50f7d988" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 08 04:14:22.056572 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:22.056520    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg"]
Sep 08 04:14:22.057038 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:22.056966    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg" podUID="02d9d531-85e7-4276-8d6e-0abe68641289" containerName="maas-api" containerID="cri-o://94dbf360f6dd84cb333bf63a8813308dc6ebe82c805165d6183581b53024dd5b" gracePeriod=30
Sep 08 04:14:22.366280 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:22.366257    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg"
Sep 08 04:14:22.436655 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:22.436528    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"]
Sep 08 04:14:22.437190 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:22.437159    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x" podUID="3cf9ce6d-918d-4f62-82ed-3dec68c0f956" containerName="istio-proxy" containerID="cri-o://e334c800dac0519cb9986a36b443b1511890f6f6313792c6145fe49708e614d4" gracePeriod=30
Sep 08 04:14:22.484902 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:22.484871    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02d9d531-85e7-4276-8d6e-0abe68641289-openshift-service-ca\") pod \"02d9d531-85e7-4276-8d6e-0abe68641289\" (UID: \"02d9d531-85e7-4276-8d6e-0abe68641289\") "
Sep 08 04:14:22.485076 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:22.484974    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pgv2\" (UniqueName: \"kubernetes.io/projected/02d9d531-85e7-4276-8d6e-0abe68641289-kube-api-access-2pgv2\") pod \"02d9d531-85e7-4276-8d6e-0abe68641289\" (UID: \"02d9d531-85e7-4276-8d6e-0abe68641289\") "
Sep 08 04:14:22.485076 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:22.484992    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02d9d531-85e7-4276-8d6e-0abe68641289-maas-api-tls\") pod \"02d9d531-85e7-4276-8d6e-0abe68641289\" (UID: \"02d9d531-85e7-4276-8d6e-0abe68641289\") "
Sep 08 04:14:22.485076 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:22.485015    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02d9d531-85e7-4276-8d6e-0abe68641289-metrics-certs\") pod \"02d9d531-85e7-4276-8d6e-0abe68641289\" (UID: \"02d9d531-85e7-4276-8d6e-0abe68641289\") "
Sep 08 04:14:22.485288 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:22.485259    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02d9d531-85e7-4276-8d6e-0abe68641289-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "02d9d531-85e7-4276-8d6e-0abe68641289" (UID: "02d9d531-85e7-4276-8d6e-0abe68641289"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 04:14:22.485438 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:22.485422    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02d9d531-85e7-4276-8d6e-0abe68641289-openshift-service-ca\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:14:22.512891 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:22.512697    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02d9d531-85e7-4276-8d6e-0abe68641289-kube-api-access-2pgv2" (OuterVolumeSpecName: "kube-api-access-2pgv2") pod "02d9d531-85e7-4276-8d6e-0abe68641289" (UID: "02d9d531-85e7-4276-8d6e-0abe68641289"). InnerVolumeSpecName "kube-api-access-2pgv2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:14:22.517721 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:22.517688    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02d9d531-85e7-4276-8d6e-0abe68641289-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "02d9d531-85e7-4276-8d6e-0abe68641289" (UID: "02d9d531-85e7-4276-8d6e-0abe68641289"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:14:22.518004 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:22.517976    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02d9d531-85e7-4276-8d6e-0abe68641289-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "02d9d531-85e7-4276-8d6e-0abe68641289" (UID: "02d9d531-85e7-4276-8d6e-0abe68641289"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:14:22.586415 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:22.586383    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pgv2\" (UniqueName: \"kubernetes.io/projected/02d9d531-85e7-4276-8d6e-0abe68641289-kube-api-access-2pgv2\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:14:22.586415 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:22.586412    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02d9d531-85e7-4276-8d6e-0abe68641289-maas-api-tls\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:14:22.586415 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:22.586421    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02d9d531-85e7-4276-8d6e-0abe68641289-metrics-certs\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:14:22.858846 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:22.858811    2573 patch_prober.go:28] interesting pod/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 08 04:14:22.859011 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:22.858874    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds" podUID="de329c00-1862-45e1-9091-0a6f50f7d988" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 08 04:14:22.960675 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:22.960643    2573 generic.go:356] "Generic (PLEG): container finished" podID="02d9d531-85e7-4276-8d6e-0abe68641289" containerID="94dbf360f6dd84cb333bf63a8813308dc6ebe82c805165d6183581b53024dd5b" exitCode=0
Sep 08 04:14:22.960826 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:22.960712    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg" event={"ID":"02d9d531-85e7-4276-8d6e-0abe68641289","Type":"ContainerDied","Data":"94dbf360f6dd84cb333bf63a8813308dc6ebe82c805165d6183581b53024dd5b"}
Sep 08 04:14:22.960826 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:22.960749    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg" event={"ID":"02d9d531-85e7-4276-8d6e-0abe68641289","Type":"ContainerDied","Data":"5539bef8b5ffbc0cc3187e512e5d94ec0733541b249f618e0e3735a792826a11"}
Sep 08 04:14:22.960826 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:22.960771    2573 scope.go:117] "RemoveContainer" containerID="94dbf360f6dd84cb333bf63a8813308dc6ebe82c805165d6183581b53024dd5b"
Sep 08 04:14:22.960934 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:22.960882    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg"
Sep 08 04:14:22.972490 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:22.972468    2573 scope.go:117] "RemoveContainer" containerID="94dbf360f6dd84cb333bf63a8813308dc6ebe82c805165d6183581b53024dd5b"
Sep 08 04:14:22.972800 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:14:22.972779    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94dbf360f6dd84cb333bf63a8813308dc6ebe82c805165d6183581b53024dd5b\": container with ID starting with 94dbf360f6dd84cb333bf63a8813308dc6ebe82c805165d6183581b53024dd5b not found: ID does not exist" containerID="94dbf360f6dd84cb333bf63a8813308dc6ebe82c805165d6183581b53024dd5b"
Sep 08 04:14:22.972870 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:22.972817    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94dbf360f6dd84cb333bf63a8813308dc6ebe82c805165d6183581b53024dd5b"} err="failed to get container status \"94dbf360f6dd84cb333bf63a8813308dc6ebe82c805165d6183581b53024dd5b\": rpc error: code = NotFound desc = could not find container \"94dbf360f6dd84cb333bf63a8813308dc6ebe82c805165d6183581b53024dd5b\": container with ID starting with 94dbf360f6dd84cb333bf63a8813308dc6ebe82c805165d6183581b53024dd5b not found: ID does not exist"
Sep 08 04:14:22.978133 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:22.978108    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg"]
Sep 08 04:14:22.985294 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:22.985273    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8d710ebd-b4c4f698-frcpg"]
Sep 08 04:14:23.383197 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:23.383152    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"]
Sep 08 04:14:23.383715 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:23.383691    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02d9d531-85e7-4276-8d6e-0abe68641289" containerName="maas-api"
Sep 08 04:14:23.383715 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:23.383716    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="02d9d531-85e7-4276-8d6e-0abe68641289" containerName="maas-api"
Sep 08 04:14:23.383822 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:23.383813    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="02d9d531-85e7-4276-8d6e-0abe68641289" containerName="maas-api"
Sep 08 04:14:23.390842 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:23.390815    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"
Sep 08 04:14:23.426666 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:23.409334    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-4cc32bbe-gw-openshift-default-dockercfg-24qtn\""
Sep 08 04:14:23.426666 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:23.424305    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"]
Sep 08 04:14:23.506041 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:23.506005    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66a3cb3b-a642-40b7-aa73-555034586d62-istio-envoy\") pod \"e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4\" (UID: \"66a3cb3b-a642-40b7-aa73-555034586d62\") " pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"
Sep 08 04:14:23.506255 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:23.506051    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66a3cb3b-a642-40b7-aa73-555034586d62-istiod-ca-cert\") pod \"e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4\" (UID: \"66a3cb3b-a642-40b7-aa73-555034586d62\") " pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"
Sep 08 04:14:23.506255 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:23.506083    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66a3cb3b-a642-40b7-aa73-555034586d62-istio-data\") pod \"e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4\" (UID: \"66a3cb3b-a642-40b7-aa73-555034586d62\") " pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"
Sep 08 04:14:23.506255 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:23.506210    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66a3cb3b-a642-40b7-aa73-555034586d62-istio-podinfo\") pod \"e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4\" (UID: \"66a3cb3b-a642-40b7-aa73-555034586d62\") " pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"
Sep 08 04:14:23.506430 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:23.506281    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66a3cb3b-a642-40b7-aa73-555034586d62-credential-socket\") pod \"e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4\" (UID: \"66a3cb3b-a642-40b7-aa73-555034586d62\") " pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"
Sep 08 04:14:23.506430 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:23.506325    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66a3cb3b-a642-40b7-aa73-555034586d62-workload-socket\") pod \"e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4\" (UID: \"66a3cb3b-a642-40b7-aa73-555034586d62\") " pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"
Sep 08 04:14:23.506430 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:23.506352    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms7bz\" (UniqueName: \"kubernetes.io/projected/66a3cb3b-a642-40b7-aa73-555034586d62-kube-api-access-ms7bz\") pod \"e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4\" (UID: \"66a3cb3b-a642-40b7-aa73-555034586d62\") " pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"
Sep 08 04:14:23.506430 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:23.506394    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66a3cb3b-a642-40b7-aa73-555034586d62-istio-token\") pod \"e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4\" (UID: \"66a3cb3b-a642-40b7-aa73-555034586d62\") " pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"
Sep 08 04:14:23.506610 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:23.506467    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66a3cb3b-a642-40b7-aa73-555034586d62-workload-certs\") pod \"e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4\" (UID: \"66a3cb3b-a642-40b7-aa73-555034586d62\") " pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"
Sep 08 04:14:23.607992 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:23.607951    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66a3cb3b-a642-40b7-aa73-555034586d62-istio-token\") pod \"e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4\" (UID: \"66a3cb3b-a642-40b7-aa73-555034586d62\") " pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"
Sep 08 04:14:23.608161 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:23.608010    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66a3cb3b-a642-40b7-aa73-555034586d62-workload-certs\") pod \"e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4\" (UID: \"66a3cb3b-a642-40b7-aa73-555034586d62\") " pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"
Sep 08 04:14:23.608161 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:23.608101    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66a3cb3b-a642-40b7-aa73-555034586d62-istio-envoy\") pod \"e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4\" (UID: \"66a3cb3b-a642-40b7-aa73-555034586d62\") " pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"
Sep 08 04:14:23.608161 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:23.608149    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66a3cb3b-a642-40b7-aa73-555034586d62-istiod-ca-cert\") pod \"e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4\" (UID: \"66a3cb3b-a642-40b7-aa73-555034586d62\") " pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"
Sep 08 04:14:23.608359 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:23.608204    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66a3cb3b-a642-40b7-aa73-555034586d62-istio-data\") pod \"e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4\" (UID: \"66a3cb3b-a642-40b7-aa73-555034586d62\") " pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"
Sep 08 04:14:23.608359 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:23.608281    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66a3cb3b-a642-40b7-aa73-555034586d62-istio-podinfo\") pod \"e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4\" (UID: \"66a3cb3b-a642-40b7-aa73-555034586d62\") " pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"
Sep 08 04:14:23.608359 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:23.608327    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66a3cb3b-a642-40b7-aa73-555034586d62-credential-socket\") pod \"e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4\" (UID: \"66a3cb3b-a642-40b7-aa73-555034586d62\") " pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"
Sep 08 04:14:23.608501 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:23.608375    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66a3cb3b-a642-40b7-aa73-555034586d62-workload-socket\") pod \"e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4\" (UID: \"66a3cb3b-a642-40b7-aa73-555034586d62\") " pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"
Sep 08 04:14:23.608501 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:23.608403    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms7bz\" (UniqueName: \"kubernetes.io/projected/66a3cb3b-a642-40b7-aa73-555034586d62-kube-api-access-ms7bz\") pod \"e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4\" (UID: \"66a3cb3b-a642-40b7-aa73-555034586d62\") " pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"
Sep 08 04:14:23.608501 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:23.608445    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66a3cb3b-a642-40b7-aa73-555034586d62-workload-certs\") pod \"e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4\" (UID: \"66a3cb3b-a642-40b7-aa73-555034586d62\") " pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"
Sep 08 04:14:23.608972 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:23.608949    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66a3cb3b-a642-40b7-aa73-555034586d62-credential-socket\") pod \"e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4\" (UID: \"66a3cb3b-a642-40b7-aa73-555034586d62\") " pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"
Sep 08 04:14:23.609088 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:23.609045    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66a3cb3b-a642-40b7-aa73-555034586d62-istio-data\") pod \"e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4\" (UID: \"66a3cb3b-a642-40b7-aa73-555034586d62\") " pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"
Sep 08 04:14:23.609088 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:23.609078    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66a3cb3b-a642-40b7-aa73-555034586d62-workload-socket\") pod \"e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4\" (UID: \"66a3cb3b-a642-40b7-aa73-555034586d62\") " pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"
Sep 08 04:14:23.609465 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:23.609439    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66a3cb3b-a642-40b7-aa73-555034586d62-istiod-ca-cert\") pod \"e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4\" (UID: \"66a3cb3b-a642-40b7-aa73-555034586d62\") " pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"
Sep 08 04:14:23.610986 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:23.610961    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66a3cb3b-a642-40b7-aa73-555034586d62-istio-podinfo\") pod \"e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4\" (UID: \"66a3cb3b-a642-40b7-aa73-555034586d62\") " pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"
Sep 08 04:14:23.610986 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:23.610981    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66a3cb3b-a642-40b7-aa73-555034586d62-istio-envoy\") pod \"e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4\" (UID: \"66a3cb3b-a642-40b7-aa73-555034586d62\") " pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"
Sep 08 04:14:23.617310 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:23.617261    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66a3cb3b-a642-40b7-aa73-555034586d62-istio-token\") pod \"e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4\" (UID: \"66a3cb3b-a642-40b7-aa73-555034586d62\") " pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"
Sep 08 04:14:23.617419 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:23.617378    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms7bz\" (UniqueName: \"kubernetes.io/projected/66a3cb3b-a642-40b7-aa73-555034586d62-kube-api-access-ms7bz\") pod \"e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4\" (UID: \"66a3cb3b-a642-40b7-aa73-555034586d62\") " pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"
Sep 08 04:14:23.729262 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:23.729174    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"
Sep 08 04:14:23.861930 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:23.861898    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"
Sep 08 04:14:23.862292 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:23.862265    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"
Sep 08 04:14:23.863012 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:23.862995    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"
Sep 08 04:14:24.019125 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:24.018927    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"]
Sep 08 04:14:24.021999 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:14:24.021971    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66a3cb3b_a642_40b7_aa73_555034586d62.slice/crio-75c6ca5815e89daa76d7e59c24486568ae4e815c977b936f3a8a0f662436f649 WatchSource:0}: Error finding container 75c6ca5815e89daa76d7e59c24486568ae4e815c977b936f3a8a0f662436f649: Status 404 returned error can't find the container with id 75c6ca5815e89daa76d7e59c24486568ae4e815c977b936f3a8a0f662436f649
Sep 08 04:14:24.024420 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:24.024387    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:14:24.024520 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:24.024462    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:14:24.024520 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:24.024508    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:14:24.676398 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:24.676369    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02d9d531-85e7-4276-8d6e-0abe68641289" path="/var/lib/kubelet/pods/02d9d531-85e7-4276-8d6e-0abe68641289/volumes"
Sep 08 04:14:24.978333 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:24.978257    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4" event={"ID":"66a3cb3b-a642-40b7-aa73-555034586d62","Type":"ContainerStarted","Data":"cd24f90beabe817d9f4ef7868eae5da25a080b4df66b4a9247ce63eadcf0f584"}
Sep 08 04:14:24.978333 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:24.978317    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4" event={"ID":"66a3cb3b-a642-40b7-aa73-555034586d62","Type":"ContainerStarted","Data":"75c6ca5815e89daa76d7e59c24486568ae4e815c977b936f3a8a0f662436f649"}
Sep 08 04:14:24.999439 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:24.999389    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4" podStartSLOduration=1.999374439 podStartE2EDuration="1.999374439s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:14:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:14:24.996592325 +0000 UTC m=+824.781883564" watchObservedRunningTime="2026-09-08 04:14:24.999374439 +0000 UTC m=+824.784665757"
Sep 08 04:14:25.729674 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:25.729641    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"
Sep 08 04:14:25.735169 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:25.735141    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"
Sep 08 04:14:25.984385 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:25.984299    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"
Sep 08 04:14:25.985319 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:25.985296    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"
Sep 08 04:14:26.568489 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:26.568451    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4"]
Sep 08 04:14:26.581763 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:26.581182    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4"
Sep 08 04:14:26.585120 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:26.585090    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4"]
Sep 08 04:14:26.587935 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:26.587253    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-4cc32bbe-serving-cert\""
Sep 08 04:14:26.739819 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:26.739786    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp5cm\" (UniqueName: \"kubernetes.io/projected/7fda5949-b6df-4617-830c-cf8f339e32b1-kube-api-access-mp5cm\") pod \"maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4\" (UID: \"7fda5949-b6df-4617-830c-cf8f339e32b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4"
Sep 08 04:14:26.740245 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:26.739826    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7fda5949-b6df-4617-830c-cf8f339e32b1-maas-api-tls\") pod \"maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4\" (UID: \"7fda5949-b6df-4617-830c-cf8f339e32b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4"
Sep 08 04:14:26.740245 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:26.739957    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fda5949-b6df-4617-830c-cf8f339e32b1-metrics-certs\") pod \"maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4\" (UID: \"7fda5949-b6df-4617-830c-cf8f339e32b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4"
Sep 08 04:14:26.740245 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:26.739997    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fda5949-b6df-4617-830c-cf8f339e32b1-openshift-service-ca\") pod \"maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4\" (UID: \"7fda5949-b6df-4617-830c-cf8f339e32b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4"
Sep 08 04:14:26.841377 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:26.841285    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp5cm\" (UniqueName: \"kubernetes.io/projected/7fda5949-b6df-4617-830c-cf8f339e32b1-kube-api-access-mp5cm\") pod \"maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4\" (UID: \"7fda5949-b6df-4617-830c-cf8f339e32b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4"
Sep 08 04:14:26.841377 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:26.841330    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7fda5949-b6df-4617-830c-cf8f339e32b1-maas-api-tls\") pod \"maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4\" (UID: \"7fda5949-b6df-4617-830c-cf8f339e32b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4"
Sep 08 04:14:26.841604 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:26.841402    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fda5949-b6df-4617-830c-cf8f339e32b1-metrics-certs\") pod \"maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4\" (UID: \"7fda5949-b6df-4617-830c-cf8f339e32b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4"
Sep 08 04:14:26.841604 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:26.841427    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fda5949-b6df-4617-830c-cf8f339e32b1-openshift-service-ca\") pod \"maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4\" (UID: \"7fda5949-b6df-4617-830c-cf8f339e32b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4"
Sep 08 04:14:26.841604 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:14:26.841495    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-4cc32bbe-serving-cert: secret "maas-api-e2e-migrate-4cc32bbe-serving-cert" not found
Sep 08 04:14:26.841604 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:14:26.841600    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fda5949-b6df-4617-830c-cf8f339e32b1-maas-api-tls podName:7fda5949-b6df-4617-830c-cf8f339e32b1 nodeName:}" failed. No retries permitted until 2026-09-08 04:14:27.341581294 +0000 UTC m=+827.126872522 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7fda5949-b6df-4617-830c-cf8f339e32b1-maas-api-tls") pod "maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4" (UID: "7fda5949-b6df-4617-830c-cf8f339e32b1") : secret "maas-api-e2e-migrate-4cc32bbe-serving-cert" not found
Sep 08 04:14:26.842147 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:26.842120    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fda5949-b6df-4617-830c-cf8f339e32b1-openshift-service-ca\") pod \"maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4\" (UID: \"7fda5949-b6df-4617-830c-cf8f339e32b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4"
Sep 08 04:14:26.843967 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:26.843940    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fda5949-b6df-4617-830c-cf8f339e32b1-metrics-certs\") pod \"maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4\" (UID: \"7fda5949-b6df-4617-830c-cf8f339e32b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4"
Sep 08 04:14:26.849879 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:26.849855    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp5cm\" (UniqueName: \"kubernetes.io/projected/7fda5949-b6df-4617-830c-cf8f339e32b1-kube-api-access-mp5cm\") pod \"maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4\" (UID: \"7fda5949-b6df-4617-830c-cf8f339e32b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4"
Sep 08 04:14:27.347455 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:27.347419    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7fda5949-b6df-4617-830c-cf8f339e32b1-maas-api-tls\") pod \"maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4\" (UID: \"7fda5949-b6df-4617-830c-cf8f339e32b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4"
Sep 08 04:14:27.349951 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:27.349922    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7fda5949-b6df-4617-830c-cf8f339e32b1-maas-api-tls\") pod \"maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4\" (UID: \"7fda5949-b6df-4617-830c-cf8f339e32b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4"
Sep 08 04:14:27.500376 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:27.500348    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4"
Sep 08 04:14:27.737369 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:27.737336    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"
Sep 08 04:14:27.780309 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:27.780284    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4"]
Sep 08 04:14:27.782098 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:14:27.782070    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fda5949_b6df_4617_830c_cf8f339e32b1.slice/crio-b1c2a5a8bc69862187245c1d63610569e37d49bc1c80737f77fb64c8c24b6d7a WatchSource:0}: Error finding container b1c2a5a8bc69862187245c1d63610569e37d49bc1c80737f77fb64c8c24b6d7a: Status 404 returned error can't find the container with id b1c2a5a8bc69862187245c1d63610569e37d49bc1c80737f77fb64c8c24b6d7a
Sep 08 04:14:27.853448 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:27.853416    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-workload-socket\") pod \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\" (UID: \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\") "
Sep 08 04:14:27.853619 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:27.853455    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-istio-envoy\") pod \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\" (UID: \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\") "
Sep 08 04:14:27.853619 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:27.853481    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-workload-certs\") pod \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\" (UID: \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\") "
Sep 08 04:14:27.853619 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:27.853544    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9gfh4\" (UniqueName: \"kubernetes.io/projected/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-kube-api-access-9gfh4\") pod \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\" (UID: \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\") "
Sep 08 04:14:27.853812 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:27.853698    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-istio-data\") pod \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\" (UID: \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\") "
Sep 08 04:14:27.853812 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:27.853721    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3cf9ce6d-918d-4f62-82ed-3dec68c0f956" (UID: "3cf9ce6d-918d-4f62-82ed-3dec68c0f956"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:14:27.853812 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:27.853772    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3cf9ce6d-918d-4f62-82ed-3dec68c0f956" (UID: "3cf9ce6d-918d-4f62-82ed-3dec68c0f956"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:14:27.853983 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:27.853951    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-istio-data" (OuterVolumeSpecName: "istio-data") pod "3cf9ce6d-918d-4f62-82ed-3dec68c0f956" (UID: "3cf9ce6d-918d-4f62-82ed-3dec68c0f956"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:14:27.853983 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:27.853729    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-istio-token\") pod \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\" (UID: \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\") "
Sep 08 04:14:27.854083 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:27.854058    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-istiod-ca-cert\") pod \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\" (UID: \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\") "
Sep 08 04:14:27.854203 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:27.854183    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-istio-podinfo\") pod \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\" (UID: \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\") "
Sep 08 04:14:27.854278 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:27.854219    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-credential-socket\") pod \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\" (UID: \"3cf9ce6d-918d-4f62-82ed-3dec68c0f956\") "
Sep 08 04:14:27.854644 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:27.854602    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3cf9ce6d-918d-4f62-82ed-3dec68c0f956" (UID: "3cf9ce6d-918d-4f62-82ed-3dec68c0f956"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:14:27.854738 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:27.854649    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3cf9ce6d-918d-4f62-82ed-3dec68c0f956" (UID: "3cf9ce6d-918d-4f62-82ed-3dec68c0f956"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 04:14:27.855142 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:27.855122    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-istiod-ca-cert\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:14:27.855223 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:27.855146    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-credential-socket\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:14:27.855223 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:27.855161    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-workload-socket\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:14:27.855223 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:27.855172    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-workload-certs\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:14:27.855223 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:27.855187    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-istio-data\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:14:27.856674 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:27.856487    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-kube-api-access-9gfh4" (OuterVolumeSpecName: "kube-api-access-9gfh4") pod "3cf9ce6d-918d-4f62-82ed-3dec68c0f956" (UID: "3cf9ce6d-918d-4f62-82ed-3dec68c0f956"). InnerVolumeSpecName "kube-api-access-9gfh4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:14:27.856674 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:27.856531    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3cf9ce6d-918d-4f62-82ed-3dec68c0f956" (UID: "3cf9ce6d-918d-4f62-82ed-3dec68c0f956"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:14:27.856875 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:27.856805    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3cf9ce6d-918d-4f62-82ed-3dec68c0f956" (UID: "3cf9ce6d-918d-4f62-82ed-3dec68c0f956"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 04:14:27.856875 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:27.856814    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-istio-token" (OuterVolumeSpecName: "istio-token") pod "3cf9ce6d-918d-4f62-82ed-3dec68c0f956" (UID: "3cf9ce6d-918d-4f62-82ed-3dec68c0f956"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:14:27.956012 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:27.955938    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-istio-podinfo\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:14:27.956012 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:27.955966    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-istio-envoy\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:14:27.956012 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:27.955977    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9gfh4\" (UniqueName: \"kubernetes.io/projected/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-kube-api-access-9gfh4\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:14:27.956012 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:27.955987    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cf9ce6d-918d-4f62-82ed-3dec68c0f956-istio-token\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:14:28.000383 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:28.000349    2573 generic.go:356] "Generic (PLEG): container finished" podID="3cf9ce6d-918d-4f62-82ed-3dec68c0f956" containerID="e334c800dac0519cb9986a36b443b1511890f6f6313792c6145fe49708e614d4" exitCode=0
Sep 08 04:14:28.000534 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:28.000399    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"
Sep 08 04:14:28.000534 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:28.000434    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x" event={"ID":"3cf9ce6d-918d-4f62-82ed-3dec68c0f956","Type":"ContainerDied","Data":"e334c800dac0519cb9986a36b443b1511890f6f6313792c6145fe49708e614d4"}
Sep 08 04:14:28.000534 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:28.000486    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x" event={"ID":"3cf9ce6d-918d-4f62-82ed-3dec68c0f956","Type":"ContainerDied","Data":"94dcd71ed1cc23cc3840e97293ccd8ac4a9aef0f771e869a1aa93f3022988985"}
Sep 08 04:14:28.000534 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:28.000516    2573 scope.go:117] "RemoveContainer" containerID="e334c800dac0519cb9986a36b443b1511890f6f6313792c6145fe49708e614d4"
Sep 08 04:14:28.002050 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:28.002018    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4" event={"ID":"7fda5949-b6df-4617-830c-cf8f339e32b1","Type":"ContainerStarted","Data":"b1c2a5a8bc69862187245c1d63610569e37d49bc1c80737f77fb64c8c24b6d7a"}
Sep 08 04:14:28.010462 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:28.010439    2573 scope.go:117] "RemoveContainer" containerID="59cf60cb0d0bdd3be2d045597dec7bf1a9aec78d40d3e6010b85cdcbec67ca01"
Sep 08 04:14:28.019480 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:28.019458    2573 scope.go:117] "RemoveContainer" containerID="e334c800dac0519cb9986a36b443b1511890f6f6313792c6145fe49708e614d4"
Sep 08 04:14:28.019861 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:14:28.019833    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e334c800dac0519cb9986a36b443b1511890f6f6313792c6145fe49708e614d4\": container with ID starting with e334c800dac0519cb9986a36b443b1511890f6f6313792c6145fe49708e614d4 not found: ID does not exist" containerID="e334c800dac0519cb9986a36b443b1511890f6f6313792c6145fe49708e614d4"
Sep 08 04:14:28.019961 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:28.019858    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e334c800dac0519cb9986a36b443b1511890f6f6313792c6145fe49708e614d4"} err="failed to get container status \"e334c800dac0519cb9986a36b443b1511890f6f6313792c6145fe49708e614d4\": rpc error: code = NotFound desc = could not find container \"e334c800dac0519cb9986a36b443b1511890f6f6313792c6145fe49708e614d4\": container with ID starting with e334c800dac0519cb9986a36b443b1511890f6f6313792c6145fe49708e614d4 not found: ID does not exist"
Sep 08 04:14:28.019961 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:28.019875    2573 scope.go:117] "RemoveContainer" containerID="59cf60cb0d0bdd3be2d045597dec7bf1a9aec78d40d3e6010b85cdcbec67ca01"
Sep 08 04:14:28.020112 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:14:28.020095    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59cf60cb0d0bdd3be2d045597dec7bf1a9aec78d40d3e6010b85cdcbec67ca01\": container with ID starting with 59cf60cb0d0bdd3be2d045597dec7bf1a9aec78d40d3e6010b85cdcbec67ca01 not found: ID does not exist" containerID="59cf60cb0d0bdd3be2d045597dec7bf1a9aec78d40d3e6010b85cdcbec67ca01"
Sep 08 04:14:28.020176 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:28.020115    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59cf60cb0d0bdd3be2d045597dec7bf1a9aec78d40d3e6010b85cdcbec67ca01"} err="failed to get container status \"59cf60cb0d0bdd3be2d045597dec7bf1a9aec78d40d3e6010b85cdcbec67ca01\": rpc error: code = NotFound desc = could not find container \"59cf60cb0d0bdd3be2d045597dec7bf1a9aec78d40d3e6010b85cdcbec67ca01\": container with ID starting with 59cf60cb0d0bdd3be2d045597dec7bf1a9aec78d40d3e6010b85cdcbec67ca01 not found: ID does not exist"
Sep 08 04:14:28.026675 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:28.026640    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"]
Sep 08 04:14:28.033812 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:28.033788    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x"]
Sep 08 04:14:28.675778 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:28.675749    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cf9ce6d-918d-4f62-82ed-3dec68c0f956" path="/var/lib/kubelet/pods/3cf9ce6d-918d-4f62-82ed-3dec68c0f956/volumes"
Sep 08 04:14:29.010345 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:29.010307    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4" event={"ID":"7fda5949-b6df-4617-830c-cf8f339e32b1","Type":"ContainerStarted","Data":"d44bb21b4197902885e03cc0071683a215c1c5df4651c4d37040171753c3db64"}
Sep 08 04:14:29.010741 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:29.010372    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4"
Sep 08 04:14:29.028166 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:29.028125    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4" podStartSLOduration=2.718556558 podStartE2EDuration="3.028108991s" totalImagesPullingTime="309.552433ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:14:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:14:29.026396912 +0000 UTC m=+828.811688149" watchObservedRunningTime="2026-09-08 04:14:29.028108991 +0000 UTC m=+828.813400227"
Sep 08 04:14:35.021526 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:35.021498    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4"
Sep 08 04:14:45.106869 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:45.106833    2573 generic.go:356] "Generic (PLEG): container finished" podID="66a3cb3b-a642-40b7-aa73-555034586d62" containerID="cd24f90beabe817d9f4ef7868eae5da25a080b4df66b4a9247ce63eadcf0f584" exitCode=0
Sep 08 04:14:45.107381 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:45.106903    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4" event={"ID":"66a3cb3b-a642-40b7-aa73-555034586d62","Type":"ContainerDied","Data":"cd24f90beabe817d9f4ef7868eae5da25a080b4df66b4a9247ce63eadcf0f584"}
Sep 08 04:14:45.107447 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:45.107414    2573 scope.go:117] "RemoveContainer" containerID="cd24f90beabe817d9f4ef7868eae5da25a080b4df66b4a9247ce63eadcf0f584"
Sep 08 04:14:45.108664 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:45.108628    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:14:45.108758 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:45.108703    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:14:45.108758 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:45.108741    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:14:46.118611 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:46.118547    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4" event={"ID":"66a3cb3b-a642-40b7-aa73-555034586d62","Type":"ContainerStarted","Data":"f80f5b1fec61879f7a7d346271d2a153fa7bab5926b549aa2ba8369bf9baa595"}
Sep 08 04:14:46.729482 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:46.729436    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"
Sep 08 04:14:46.729722 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:46.729701    2573 patch_prober.go:28] interesting pod/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 08 04:14:46.729774 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:46.729758    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4" podUID="66a3cb3b-a642-40b7-aa73-555034586d62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 08 04:14:47.729881 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:47.729847    2573 patch_prober.go:28] interesting pod/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 08 04:14:47.730276 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:47.729913    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4" podUID="66a3cb3b-a642-40b7-aa73-555034586d62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 08 04:14:48.730501 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:48.730461    2573 patch_prober.go:28] interesting pod/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 08 04:14:48.730934 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:48.730539    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4" podUID="66a3cb3b-a642-40b7-aa73-555034586d62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 08 04:14:49.730149 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:49.730113    2573 patch_prober.go:28] interesting pod/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 08 04:14:49.730333 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:49.730169    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4" podUID="66a3cb3b-a642-40b7-aa73-555034586d62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 08 04:14:50.729523 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:50.729488    2573 patch_prober.go:28] interesting pod/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 08 04:14:50.729930 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:50.729576    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4" podUID="66a3cb3b-a642-40b7-aa73-555034586d62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 08 04:14:51.733949 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:51.733922    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"
Sep 08 04:14:51.734350 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:51.734159    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"
Sep 08 04:14:51.734938 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:51.734921    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"
Sep 08 04:14:57.892475 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:57.892434    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4"]
Sep 08 04:14:57.893571 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:57.893525    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4" podUID="7fda5949-b6df-4617-830c-cf8f339e32b1" containerName="maas-api" containerID="cri-o://d44bb21b4197902885e03cc0071683a215c1c5df4651c4d37040171753c3db64" gracePeriod=30
Sep 08 04:14:58.175891 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:58.175868    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4"
Sep 08 04:14:58.215608 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:58.215428    2573 generic.go:356] "Generic (PLEG): container finished" podID="7fda5949-b6df-4617-830c-cf8f339e32b1" containerID="d44bb21b4197902885e03cc0071683a215c1c5df4651c4d37040171753c3db64" exitCode=0
Sep 08 04:14:58.215608 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:58.215602    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4" event={"ID":"7fda5949-b6df-4617-830c-cf8f339e32b1","Type":"ContainerDied","Data":"d44bb21b4197902885e03cc0071683a215c1c5df4651c4d37040171753c3db64"}
Sep 08 04:14:58.215852 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:58.215709    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4" event={"ID":"7fda5949-b6df-4617-830c-cf8f339e32b1","Type":"ContainerDied","Data":"b1c2a5a8bc69862187245c1d63610569e37d49bc1c80737f77fb64c8c24b6d7a"}
Sep 08 04:14:58.215852 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:58.215757    2573 scope.go:117] "RemoveContainer" containerID="d44bb21b4197902885e03cc0071683a215c1c5df4651c4d37040171753c3db64"
Sep 08 04:14:58.225654 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:58.215979    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4"
Sep 08 04:14:58.230180 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:58.230152    2573 scope.go:117] "RemoveContainer" containerID="d44bb21b4197902885e03cc0071683a215c1c5df4651c4d37040171753c3db64"
Sep 08 04:14:58.230587 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:14:58.230545    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d44bb21b4197902885e03cc0071683a215c1c5df4651c4d37040171753c3db64\": container with ID starting with d44bb21b4197902885e03cc0071683a215c1c5df4651c4d37040171753c3db64 not found: ID does not exist" containerID="d44bb21b4197902885e03cc0071683a215c1c5df4651c4d37040171753c3db64"
Sep 08 04:14:58.230798 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:58.230761    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d44bb21b4197902885e03cc0071683a215c1c5df4651c4d37040171753c3db64"} err="failed to get container status \"d44bb21b4197902885e03cc0071683a215c1c5df4651c4d37040171753c3db64\": rpc error: code = NotFound desc = could not find container \"d44bb21b4197902885e03cc0071683a215c1c5df4651c4d37040171753c3db64\": container with ID starting with d44bb21b4197902885e03cc0071683a215c1c5df4651c4d37040171753c3db64 not found: ID does not exist"
Sep 08 04:14:58.270875 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:58.270839    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"]
Sep 08 04:14:58.271259 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:58.271208    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4" podUID="66a3cb3b-a642-40b7-aa73-555034586d62" containerName="istio-proxy" containerID="cri-o://f80f5b1fec61879f7a7d346271d2a153fa7bab5926b549aa2ba8369bf9baa595" gracePeriod=30
Sep 08 04:14:58.299233 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:58.299199    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7fda5949-b6df-4617-830c-cf8f339e32b1-maas-api-tls\") pod \"7fda5949-b6df-4617-830c-cf8f339e32b1\" (UID: \"7fda5949-b6df-4617-830c-cf8f339e32b1\") "
Sep 08 04:14:58.299494 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:58.299477    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mp5cm\" (UniqueName: \"kubernetes.io/projected/7fda5949-b6df-4617-830c-cf8f339e32b1-kube-api-access-mp5cm\") pod \"7fda5949-b6df-4617-830c-cf8f339e32b1\" (UID: \"7fda5949-b6df-4617-830c-cf8f339e32b1\") "
Sep 08 04:14:58.299669 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:58.299653    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fda5949-b6df-4617-830c-cf8f339e32b1-openshift-service-ca\") pod \"7fda5949-b6df-4617-830c-cf8f339e32b1\" (UID: \"7fda5949-b6df-4617-830c-cf8f339e32b1\") "
Sep 08 04:14:58.299853 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:58.299840    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fda5949-b6df-4617-830c-cf8f339e32b1-metrics-certs\") pod \"7fda5949-b6df-4617-830c-cf8f339e32b1\" (UID: \"7fda5949-b6df-4617-830c-cf8f339e32b1\") "
Sep 08 04:14:58.301059 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:58.301025    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7fda5949-b6df-4617-830c-cf8f339e32b1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7fda5949-b6df-4617-830c-cf8f339e32b1" (UID: "7fda5949-b6df-4617-830c-cf8f339e32b1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 04:14:58.307688 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:58.307660    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7fda5949-b6df-4617-830c-cf8f339e32b1-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7fda5949-b6df-4617-830c-cf8f339e32b1" (UID: "7fda5949-b6df-4617-830c-cf8f339e32b1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:14:58.315006 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:58.314760    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fda5949-b6df-4617-830c-cf8f339e32b1-kube-api-access-mp5cm" (OuterVolumeSpecName: "kube-api-access-mp5cm") pod "7fda5949-b6df-4617-830c-cf8f339e32b1" (UID: "7fda5949-b6df-4617-830c-cf8f339e32b1"). InnerVolumeSpecName "kube-api-access-mp5cm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:14:58.315464 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:58.315182    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7fda5949-b6df-4617-830c-cf8f339e32b1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7fda5949-b6df-4617-830c-cf8f339e32b1" (UID: "7fda5949-b6df-4617-830c-cf8f339e32b1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:14:58.401257 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:58.401180    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7fda5949-b6df-4617-830c-cf8f339e32b1-maas-api-tls\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:14:58.401257 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:58.401210    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mp5cm\" (UniqueName: \"kubernetes.io/projected/7fda5949-b6df-4617-830c-cf8f339e32b1-kube-api-access-mp5cm\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:14:58.401257 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:58.401219    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fda5949-b6df-4617-830c-cf8f339e32b1-openshift-service-ca\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:14:58.401257 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:58.401227    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fda5949-b6df-4617-830c-cf8f339e32b1-metrics-certs\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:14:58.543766 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:58.543714    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4"]
Sep 08 04:14:58.547586 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:58.547538    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-4cc32bbe-6f765f44bd-d9pp4"]
Sep 08 04:14:58.675519 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:58.675443    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fda5949-b6df-4617-830c-cf8f339e32b1" path="/var/lib/kubelet/pods/7fda5949-b6df-4617-830c-cf8f339e32b1/volumes"
Sep 08 04:14:59.083868 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.083834    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"]
Sep 08 04:14:59.084509 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.084487    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fda5949-b6df-4617-830c-cf8f339e32b1" containerName="maas-api"
Sep 08 04:14:59.084626 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.084511    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fda5949-b6df-4617-830c-cf8f339e32b1" containerName="maas-api"
Sep 08 04:14:59.084626 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.084537    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cf9ce6d-918d-4f62-82ed-3dec68c0f956" containerName="istio-proxy"
Sep 08 04:14:59.084626 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.084546    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cf9ce6d-918d-4f62-82ed-3dec68c0f956" containerName="istio-proxy"
Sep 08 04:14:59.084626 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.084606    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cf9ce6d-918d-4f62-82ed-3dec68c0f956" containerName="istio-proxy"
Sep 08 04:14:59.084626 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.084615    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cf9ce6d-918d-4f62-82ed-3dec68c0f956" containerName="istio-proxy"
Sep 08 04:14:59.084882 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.084759    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cf9ce6d-918d-4f62-82ed-3dec68c0f956" containerName="istio-proxy"
Sep 08 04:14:59.084882 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.084774    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cf9ce6d-918d-4f62-82ed-3dec68c0f956" containerName="istio-proxy"
Sep 08 04:14:59.084882 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.084784    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fda5949-b6df-4617-830c-cf8f339e32b1" containerName="maas-api"
Sep 08 04:14:59.089758 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.089733    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"
Sep 08 04:14:59.097375 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.097175    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-4001bd59-openshift-default-dockercfg-tp278\""
Sep 08 04:14:59.115475 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.115445    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"]
Sep 08 04:14:59.210447 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.210415    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dec747fc-2d76-440c-939d-59efa97b0206-istio-envoy\") pod \"e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47\" (UID: \"dec747fc-2d76-440c-939d-59efa97b0206\") " pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"
Sep 08 04:14:59.210652 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.210476    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dec747fc-2d76-440c-939d-59efa97b0206-istiod-ca-cert\") pod \"e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47\" (UID: \"dec747fc-2d76-440c-939d-59efa97b0206\") " pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"
Sep 08 04:14:59.210652 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.210613    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgfzj\" (UniqueName: \"kubernetes.io/projected/dec747fc-2d76-440c-939d-59efa97b0206-kube-api-access-vgfzj\") pod \"e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47\" (UID: \"dec747fc-2d76-440c-939d-59efa97b0206\") " pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"
Sep 08 04:14:59.210792 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.210661    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dec747fc-2d76-440c-939d-59efa97b0206-workload-certs\") pod \"e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47\" (UID: \"dec747fc-2d76-440c-939d-59efa97b0206\") " pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"
Sep 08 04:14:59.210792 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.210718    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dec747fc-2d76-440c-939d-59efa97b0206-istio-podinfo\") pod \"e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47\" (UID: \"dec747fc-2d76-440c-939d-59efa97b0206\") " pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"
Sep 08 04:14:59.210792 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.210764    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dec747fc-2d76-440c-939d-59efa97b0206-workload-socket\") pod \"e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47\" (UID: \"dec747fc-2d76-440c-939d-59efa97b0206\") " pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"
Sep 08 04:14:59.210913 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.210796    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dec747fc-2d76-440c-939d-59efa97b0206-credential-socket\") pod \"e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47\" (UID: \"dec747fc-2d76-440c-939d-59efa97b0206\") " pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"
Sep 08 04:14:59.210913 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.210827    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dec747fc-2d76-440c-939d-59efa97b0206-istio-token\") pod \"e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47\" (UID: \"dec747fc-2d76-440c-939d-59efa97b0206\") " pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"
Sep 08 04:14:59.210913 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.210874    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dec747fc-2d76-440c-939d-59efa97b0206-istio-data\") pod \"e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47\" (UID: \"dec747fc-2d76-440c-939d-59efa97b0206\") " pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"
Sep 08 04:14:59.311455 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.311415    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgfzj\" (UniqueName: \"kubernetes.io/projected/dec747fc-2d76-440c-939d-59efa97b0206-kube-api-access-vgfzj\") pod \"e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47\" (UID: \"dec747fc-2d76-440c-939d-59efa97b0206\") " pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"
Sep 08 04:14:59.311455 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.311456    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dec747fc-2d76-440c-939d-59efa97b0206-workload-certs\") pod \"e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47\" (UID: \"dec747fc-2d76-440c-939d-59efa97b0206\") " pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"
Sep 08 04:14:59.311710 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.311477    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dec747fc-2d76-440c-939d-59efa97b0206-istio-podinfo\") pod \"e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47\" (UID: \"dec747fc-2d76-440c-939d-59efa97b0206\") " pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"
Sep 08 04:14:59.311710 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.311606    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dec747fc-2d76-440c-939d-59efa97b0206-workload-socket\") pod \"e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47\" (UID: \"dec747fc-2d76-440c-939d-59efa97b0206\") " pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"
Sep 08 04:14:59.311710 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.311651    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dec747fc-2d76-440c-939d-59efa97b0206-credential-socket\") pod \"e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47\" (UID: \"dec747fc-2d76-440c-939d-59efa97b0206\") " pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"
Sep 08 04:14:59.311710 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.311685    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dec747fc-2d76-440c-939d-59efa97b0206-istio-token\") pod \"e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47\" (UID: \"dec747fc-2d76-440c-939d-59efa97b0206\") " pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"
Sep 08 04:14:59.311928 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.311716    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dec747fc-2d76-440c-939d-59efa97b0206-istio-data\") pod \"e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47\" (UID: \"dec747fc-2d76-440c-939d-59efa97b0206\") " pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"
Sep 08 04:14:59.311928 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.311785    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dec747fc-2d76-440c-939d-59efa97b0206-istio-envoy\") pod \"e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47\" (UID: \"dec747fc-2d76-440c-939d-59efa97b0206\") " pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"
Sep 08 04:14:59.311928 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.311824    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dec747fc-2d76-440c-939d-59efa97b0206-workload-certs\") pod \"e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47\" (UID: \"dec747fc-2d76-440c-939d-59efa97b0206\") " pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"
Sep 08 04:14:59.311928 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.311885    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dec747fc-2d76-440c-939d-59efa97b0206-istiod-ca-cert\") pod \"e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47\" (UID: \"dec747fc-2d76-440c-939d-59efa97b0206\") " pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"
Sep 08 04:14:59.312089 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.311956    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dec747fc-2d76-440c-939d-59efa97b0206-workload-socket\") pod \"e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47\" (UID: \"dec747fc-2d76-440c-939d-59efa97b0206\") " pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"
Sep 08 04:14:59.312089 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.312031    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dec747fc-2d76-440c-939d-59efa97b0206-credential-socket\") pod \"e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47\" (UID: \"dec747fc-2d76-440c-939d-59efa97b0206\") " pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"
Sep 08 04:14:59.312322 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.312301    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dec747fc-2d76-440c-939d-59efa97b0206-istio-data\") pod \"e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47\" (UID: \"dec747fc-2d76-440c-939d-59efa97b0206\") " pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"
Sep 08 04:14:59.312550 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.312532    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dec747fc-2d76-440c-939d-59efa97b0206-istiod-ca-cert\") pod \"e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47\" (UID: \"dec747fc-2d76-440c-939d-59efa97b0206\") " pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"
Sep 08 04:14:59.314138 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.314115    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dec747fc-2d76-440c-939d-59efa97b0206-istio-podinfo\") pod \"e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47\" (UID: \"dec747fc-2d76-440c-939d-59efa97b0206\") " pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"
Sep 08 04:14:59.314267 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.314191    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dec747fc-2d76-440c-939d-59efa97b0206-istio-envoy\") pod \"e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47\" (UID: \"dec747fc-2d76-440c-939d-59efa97b0206\") " pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"
Sep 08 04:14:59.319195 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.319170    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgfzj\" (UniqueName: \"kubernetes.io/projected/dec747fc-2d76-440c-939d-59efa97b0206-kube-api-access-vgfzj\") pod \"e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47\" (UID: \"dec747fc-2d76-440c-939d-59efa97b0206\") " pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"
Sep 08 04:14:59.319288 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.319255    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dec747fc-2d76-440c-939d-59efa97b0206-istio-token\") pod \"e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47\" (UID: \"dec747fc-2d76-440c-939d-59efa97b0206\") " pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"
Sep 08 04:14:59.400658 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.400552    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"
Sep 08 04:14:59.681291 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.681265    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"]
Sep 08 04:14:59.682809 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:14:59.682775    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddec747fc_2d76_440c_939d_59efa97b0206.slice/crio-80e38653fdbe32b439153bef7d69de1257f585f374e0120b2f2881637f302234 WatchSource:0}: Error finding container 80e38653fdbe32b439153bef7d69de1257f585f374e0120b2f2881637f302234: Status 404 returned error can't find the container with id 80e38653fdbe32b439153bef7d69de1257f585f374e0120b2f2881637f302234
Sep 08 04:14:59.685468 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.685439    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:14:59.685546 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.685501    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:14:59.685546 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:14:59.685526    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:15:00.229900 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:00.229860    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47" event={"ID":"dec747fc-2d76-440c-939d-59efa97b0206","Type":"ContainerStarted","Data":"25fdc6fe1f8b99758055cac11b7e19357afd9ab7deee6e9758b468a505e1422e"}
Sep 08 04:15:00.230272 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:00.229908    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47" event={"ID":"dec747fc-2d76-440c-939d-59efa97b0206","Type":"ContainerStarted","Data":"80e38653fdbe32b439153bef7d69de1257f585f374e0120b2f2881637f302234"}
Sep 08 04:15:00.249543 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:00.249495    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47" podStartSLOduration=1.249479981 podStartE2EDuration="1.249479981s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:14:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:15:00.248893704 +0000 UTC m=+860.034184952" watchObservedRunningTime="2026-09-08 04:15:00.249479981 +0000 UTC m=+860.034771217"
Sep 08 04:15:00.401101 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:00.401071    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"
Sep 08 04:15:00.406470 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:00.406449    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"
Sep 08 04:15:01.235717 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:01.235686    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"
Sep 08 04:15:01.236749 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:01.236726    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"
Sep 08 04:15:02.698578 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:02.698528    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4001bd59-5b96d88488-nmt55"]
Sep 08 04:15:02.703337 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:02.703314    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4001bd59-5b96d88488-nmt55"
Sep 08 04:15:02.705683 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:02.705654    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-4001bd59-serving-cert\""
Sep 08 04:15:02.712947 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:02.712919    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4001bd59-5b96d88488-nmt55"]
Sep 08 04:15:02.848623 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:02.848587    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6lxt\" (UniqueName: \"kubernetes.io/projected/923d75ce-efb6-4613-bd6d-e4a362d3dc68-kube-api-access-p6lxt\") pod \"maas-api-e2e-ait-4001bd59-5b96d88488-nmt55\" (UID: \"923d75ce-efb6-4613-bd6d-e4a362d3dc68\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4001bd59-5b96d88488-nmt55"
Sep 08 04:15:02.848796 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:02.848649    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/923d75ce-efb6-4613-bd6d-e4a362d3dc68-openshift-service-ca\") pod \"maas-api-e2e-ait-4001bd59-5b96d88488-nmt55\" (UID: \"923d75ce-efb6-4613-bd6d-e4a362d3dc68\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4001bd59-5b96d88488-nmt55"
Sep 08 04:15:02.848796 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:02.848778    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/923d75ce-efb6-4613-bd6d-e4a362d3dc68-metrics-certs\") pod \"maas-api-e2e-ait-4001bd59-5b96d88488-nmt55\" (UID: \"923d75ce-efb6-4613-bd6d-e4a362d3dc68\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4001bd59-5b96d88488-nmt55"
Sep 08 04:15:02.848881 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:02.848831    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/923d75ce-efb6-4613-bd6d-e4a362d3dc68-maas-api-tls\") pod \"maas-api-e2e-ait-4001bd59-5b96d88488-nmt55\" (UID: \"923d75ce-efb6-4613-bd6d-e4a362d3dc68\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4001bd59-5b96d88488-nmt55"
Sep 08 04:15:02.950453 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:02.950369    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6lxt\" (UniqueName: \"kubernetes.io/projected/923d75ce-efb6-4613-bd6d-e4a362d3dc68-kube-api-access-p6lxt\") pod \"maas-api-e2e-ait-4001bd59-5b96d88488-nmt55\" (UID: \"923d75ce-efb6-4613-bd6d-e4a362d3dc68\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4001bd59-5b96d88488-nmt55"
Sep 08 04:15:02.950453 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:02.950419    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/923d75ce-efb6-4613-bd6d-e4a362d3dc68-openshift-service-ca\") pod \"maas-api-e2e-ait-4001bd59-5b96d88488-nmt55\" (UID: \"923d75ce-efb6-4613-bd6d-e4a362d3dc68\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4001bd59-5b96d88488-nmt55"
Sep 08 04:15:02.950731 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:02.950462    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/923d75ce-efb6-4613-bd6d-e4a362d3dc68-metrics-certs\") pod \"maas-api-e2e-ait-4001bd59-5b96d88488-nmt55\" (UID: \"923d75ce-efb6-4613-bd6d-e4a362d3dc68\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4001bd59-5b96d88488-nmt55"
Sep 08 04:15:02.950731 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:02.950495    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/923d75ce-efb6-4613-bd6d-e4a362d3dc68-maas-api-tls\") pod \"maas-api-e2e-ait-4001bd59-5b96d88488-nmt55\" (UID: \"923d75ce-efb6-4613-bd6d-e4a362d3dc68\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4001bd59-5b96d88488-nmt55"
Sep 08 04:15:02.951168 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:02.951140    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/923d75ce-efb6-4613-bd6d-e4a362d3dc68-openshift-service-ca\") pod \"maas-api-e2e-ait-4001bd59-5b96d88488-nmt55\" (UID: \"923d75ce-efb6-4613-bd6d-e4a362d3dc68\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4001bd59-5b96d88488-nmt55"
Sep 08 04:15:02.953131 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:02.953107    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/923d75ce-efb6-4613-bd6d-e4a362d3dc68-maas-api-tls\") pod \"maas-api-e2e-ait-4001bd59-5b96d88488-nmt55\" (UID: \"923d75ce-efb6-4613-bd6d-e4a362d3dc68\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4001bd59-5b96d88488-nmt55"
Sep 08 04:15:02.953209 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:02.953112    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/923d75ce-efb6-4613-bd6d-e4a362d3dc68-metrics-certs\") pod \"maas-api-e2e-ait-4001bd59-5b96d88488-nmt55\" (UID: \"923d75ce-efb6-4613-bd6d-e4a362d3dc68\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4001bd59-5b96d88488-nmt55"
Sep 08 04:15:02.958126 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:02.958107    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6lxt\" (UniqueName: \"kubernetes.io/projected/923d75ce-efb6-4613-bd6d-e4a362d3dc68-kube-api-access-p6lxt\") pod \"maas-api-e2e-ait-4001bd59-5b96d88488-nmt55\" (UID: \"923d75ce-efb6-4613-bd6d-e4a362d3dc68\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4001bd59-5b96d88488-nmt55"
Sep 08 04:15:03.017549 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:03.017514    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4001bd59-5b96d88488-nmt55"
Sep 08 04:15:03.294840 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:03.294810    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4001bd59-5b96d88488-nmt55"]
Sep 08 04:15:03.298179 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:15:03.298154    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod923d75ce_efb6_4613_bd6d_e4a362d3dc68.slice/crio-ee195e8af00504faaf89b3baa0d78a2d353152e098dff972fbe0e3f6f62416ce WatchSource:0}: Error finding container ee195e8af00504faaf89b3baa0d78a2d353152e098dff972fbe0e3f6f62416ce: Status 404 returned error can't find the container with id ee195e8af00504faaf89b3baa0d78a2d353152e098dff972fbe0e3f6f62416ce
Sep 08 04:15:03.533545 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:03.533520    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"
Sep 08 04:15:03.658599 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:03.658503    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66a3cb3b-a642-40b7-aa73-555034586d62-istiod-ca-cert\") pod \"66a3cb3b-a642-40b7-aa73-555034586d62\" (UID: \"66a3cb3b-a642-40b7-aa73-555034586d62\") "
Sep 08 04:15:03.658599 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:03.658593    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66a3cb3b-a642-40b7-aa73-555034586d62-istio-podinfo\") pod \"66a3cb3b-a642-40b7-aa73-555034586d62\" (UID: \"66a3cb3b-a642-40b7-aa73-555034586d62\") "
Sep 08 04:15:03.658798 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:03.658619    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66a3cb3b-a642-40b7-aa73-555034586d62-istio-data\") pod \"66a3cb3b-a642-40b7-aa73-555034586d62\" (UID: \"66a3cb3b-a642-40b7-aa73-555034586d62\") "
Sep 08 04:15:03.658798 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:03.658643    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66a3cb3b-a642-40b7-aa73-555034586d62-workload-socket\") pod \"66a3cb3b-a642-40b7-aa73-555034586d62\" (UID: \"66a3cb3b-a642-40b7-aa73-555034586d62\") "
Sep 08 04:15:03.658904 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:03.658792    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66a3cb3b-a642-40b7-aa73-555034586d62-istio-token\") pod \"66a3cb3b-a642-40b7-aa73-555034586d62\" (UID: \"66a3cb3b-a642-40b7-aa73-555034586d62\") "
Sep 08 04:15:03.658904 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:03.658840    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66a3cb3b-a642-40b7-aa73-555034586d62-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "66a3cb3b-a642-40b7-aa73-555034586d62" (UID: "66a3cb3b-a642-40b7-aa73-555034586d62"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 04:15:03.658904 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:03.658898    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66a3cb3b-a642-40b7-aa73-555034586d62-credential-socket\") pod \"66a3cb3b-a642-40b7-aa73-555034586d62\" (UID: \"66a3cb3b-a642-40b7-aa73-555034586d62\") "
Sep 08 04:15:03.659069 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:03.658946    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66a3cb3b-a642-40b7-aa73-555034586d62-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "66a3cb3b-a642-40b7-aa73-555034586d62" (UID: "66a3cb3b-a642-40b7-aa73-555034586d62"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:15:03.659069 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:03.658960    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66a3cb3b-a642-40b7-aa73-555034586d62-istio-data" (OuterVolumeSpecName: "istio-data") pod "66a3cb3b-a642-40b7-aa73-555034586d62" (UID: "66a3cb3b-a642-40b7-aa73-555034586d62"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:15:03.659069 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:03.658954    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ms7bz\" (UniqueName: \"kubernetes.io/projected/66a3cb3b-a642-40b7-aa73-555034586d62-kube-api-access-ms7bz\") pod \"66a3cb3b-a642-40b7-aa73-555034586d62\" (UID: \"66a3cb3b-a642-40b7-aa73-555034586d62\") "
Sep 08 04:15:03.659069 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:03.659043    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66a3cb3b-a642-40b7-aa73-555034586d62-workload-certs\") pod \"66a3cb3b-a642-40b7-aa73-555034586d62\" (UID: \"66a3cb3b-a642-40b7-aa73-555034586d62\") "
Sep 08 04:15:03.659279 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:03.659108    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66a3cb3b-a642-40b7-aa73-555034586d62-istio-envoy\") pod \"66a3cb3b-a642-40b7-aa73-555034586d62\" (UID: \"66a3cb3b-a642-40b7-aa73-555034586d62\") "
Sep 08 04:15:03.659279 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:03.659144    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66a3cb3b-a642-40b7-aa73-555034586d62-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "66a3cb3b-a642-40b7-aa73-555034586d62" (UID: "66a3cb3b-a642-40b7-aa73-555034586d62"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:15:03.659279 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:03.659252    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66a3cb3b-a642-40b7-aa73-555034586d62-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "66a3cb3b-a642-40b7-aa73-555034586d62" (UID: "66a3cb3b-a642-40b7-aa73-555034586d62"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:15:03.659477 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:03.659461    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66a3cb3b-a642-40b7-aa73-555034586d62-istio-data\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:15:03.659725 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:03.659479    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66a3cb3b-a642-40b7-aa73-555034586d62-workload-socket\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:15:03.659725 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:03.659487    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66a3cb3b-a642-40b7-aa73-555034586d62-credential-socket\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:15:03.659725 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:03.659496    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66a3cb3b-a642-40b7-aa73-555034586d62-workload-certs\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:15:03.659725 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:03.659505    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66a3cb3b-a642-40b7-aa73-555034586d62-istiod-ca-cert\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:15:03.661084 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:03.661062    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66a3cb3b-a642-40b7-aa73-555034586d62-istio-token" (OuterVolumeSpecName: "istio-token") pod "66a3cb3b-a642-40b7-aa73-555034586d62" (UID: "66a3cb3b-a642-40b7-aa73-555034586d62"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:15:03.661183 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:03.661086    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/66a3cb3b-a642-40b7-aa73-555034586d62-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "66a3cb3b-a642-40b7-aa73-555034586d62" (UID: "66a3cb3b-a642-40b7-aa73-555034586d62"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 04:15:03.661183 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:03.661098    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66a3cb3b-a642-40b7-aa73-555034586d62-kube-api-access-ms7bz" (OuterVolumeSpecName: "kube-api-access-ms7bz") pod "66a3cb3b-a642-40b7-aa73-555034586d62" (UID: "66a3cb3b-a642-40b7-aa73-555034586d62"). InnerVolumeSpecName "kube-api-access-ms7bz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:15:03.661326 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:03.661309    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66a3cb3b-a642-40b7-aa73-555034586d62-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "66a3cb3b-a642-40b7-aa73-555034586d62" (UID: "66a3cb3b-a642-40b7-aa73-555034586d62"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:15:03.760664 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:03.760632    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ms7bz\" (UniqueName: \"kubernetes.io/projected/66a3cb3b-a642-40b7-aa73-555034586d62-kube-api-access-ms7bz\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:15:03.760664 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:03.760655    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66a3cb3b-a642-40b7-aa73-555034586d62-istio-envoy\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:15:03.760664 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:03.760665    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66a3cb3b-a642-40b7-aa73-555034586d62-istio-podinfo\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:15:03.760664 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:03.760672    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66a3cb3b-a642-40b7-aa73-555034586d62-istio-token\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:15:04.254525 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:04.254491    2573 generic.go:356] "Generic (PLEG): container finished" podID="66a3cb3b-a642-40b7-aa73-555034586d62" containerID="f80f5b1fec61879f7a7d346271d2a153fa7bab5926b549aa2ba8369bf9baa595" exitCode=0
Sep 08 04:15:04.254714 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:04.254536    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"
Sep 08 04:15:04.254714 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:04.254597    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4" event={"ID":"66a3cb3b-a642-40b7-aa73-555034586d62","Type":"ContainerDied","Data":"f80f5b1fec61879f7a7d346271d2a153fa7bab5926b549aa2ba8369bf9baa595"}
Sep 08 04:15:04.254714 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:04.254655    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4" event={"ID":"66a3cb3b-a642-40b7-aa73-555034586d62","Type":"ContainerDied","Data":"75c6ca5815e89daa76d7e59c24486568ae4e815c977b936f3a8a0f662436f649"}
Sep 08 04:15:04.254714 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:04.254684    2573 scope.go:117] "RemoveContainer" containerID="f80f5b1fec61879f7a7d346271d2a153fa7bab5926b549aa2ba8369bf9baa595"
Sep 08 04:15:04.256643 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:04.256617    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4001bd59-5b96d88488-nmt55" event={"ID":"923d75ce-efb6-4613-bd6d-e4a362d3dc68","Type":"ContainerStarted","Data":"7b58ecc7d6d2044a4ca42af0eabfddb85b2e7c7a8c2b24fb59cfe5d23b8efbc8"}
Sep 08 04:15:04.256761 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:04.256668    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4001bd59-5b96d88488-nmt55" event={"ID":"923d75ce-efb6-4613-bd6d-e4a362d3dc68","Type":"ContainerStarted","Data":"ee195e8af00504faaf89b3baa0d78a2d353152e098dff972fbe0e3f6f62416ce"}
Sep 08 04:15:04.256818 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:04.256757    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4001bd59-5b96d88488-nmt55"
Sep 08 04:15:04.265170 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:04.265147    2573 scope.go:117] "RemoveContainer" containerID="cd24f90beabe817d9f4ef7868eae5da25a080b4df66b4a9247ce63eadcf0f584"
Sep 08 04:15:04.273730 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:04.273695    2573 scope.go:117] "RemoveContainer" containerID="f80f5b1fec61879f7a7d346271d2a153fa7bab5926b549aa2ba8369bf9baa595"
Sep 08 04:15:04.274017 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:15:04.273996    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f80f5b1fec61879f7a7d346271d2a153fa7bab5926b549aa2ba8369bf9baa595\": container with ID starting with f80f5b1fec61879f7a7d346271d2a153fa7bab5926b549aa2ba8369bf9baa595 not found: ID does not exist" containerID="f80f5b1fec61879f7a7d346271d2a153fa7bab5926b549aa2ba8369bf9baa595"
Sep 08 04:15:04.274345 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:04.274025    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f80f5b1fec61879f7a7d346271d2a153fa7bab5926b549aa2ba8369bf9baa595"} err="failed to get container status \"f80f5b1fec61879f7a7d346271d2a153fa7bab5926b549aa2ba8369bf9baa595\": rpc error: code = NotFound desc = could not find container \"f80f5b1fec61879f7a7d346271d2a153fa7bab5926b549aa2ba8369bf9baa595\": container with ID starting with f80f5b1fec61879f7a7d346271d2a153fa7bab5926b549aa2ba8369bf9baa595 not found: ID does not exist"
Sep 08 04:15:04.274345 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:04.274040    2573 scope.go:117] "RemoveContainer" containerID="cd24f90beabe817d9f4ef7868eae5da25a080b4df66b4a9247ce63eadcf0f584"
Sep 08 04:15:04.274457 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:15:04.274355    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd24f90beabe817d9f4ef7868eae5da25a080b4df66b4a9247ce63eadcf0f584\": container with ID starting with cd24f90beabe817d9f4ef7868eae5da25a080b4df66b4a9247ce63eadcf0f584 not found: ID does not exist" containerID="cd24f90beabe817d9f4ef7868eae5da25a080b4df66b4a9247ce63eadcf0f584"
Sep 08 04:15:04.274457 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:04.274385    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd24f90beabe817d9f4ef7868eae5da25a080b4df66b4a9247ce63eadcf0f584"} err="failed to get container status \"cd24f90beabe817d9f4ef7868eae5da25a080b4df66b4a9247ce63eadcf0f584\": rpc error: code = NotFound desc = could not find container \"cd24f90beabe817d9f4ef7868eae5da25a080b4df66b4a9247ce63eadcf0f584\": container with ID starting with cd24f90beabe817d9f4ef7868eae5da25a080b4df66b4a9247ce63eadcf0f584 not found: ID does not exist"
Sep 08 04:15:04.276490 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:04.276454    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4001bd59-5b96d88488-nmt55" podStartSLOduration=1.693752227 podStartE2EDuration="2.27644141s" totalImagesPullingTime="582.689183ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:15:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:15:04.273375785 +0000 UTC m=+864.058667033" watchObservedRunningTime="2026-09-08 04:15:04.27644141 +0000 UTC m=+864.061732646"
Sep 08 04:15:04.288845 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:04.288813    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"]
Sep 08 04:15:04.293213 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:04.293189    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4"]
Sep 08 04:15:04.679095 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:04.679013    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66a3cb3b-a642-40b7-aa73-555034586d62" path="/var/lib/kubelet/pods/66a3cb3b-a642-40b7-aa73-555034586d62/volumes"
Sep 08 04:15:10.269135 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:10.269106    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4001bd59-5b96d88488-nmt55"
Sep 08 04:15:16.604170 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:16.604139    2573 patch_prober.go:28] interesting pod/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": read tcp 10.134.0.2:54516->10.134.0.56:15021: read: connection reset by peer" start-of-body=
Sep 08 04:15:16.604478 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:16.604209    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47" podUID="dec747fc-2d76-440c-939d-59efa97b0206" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": read tcp 10.134.0.2:54516->10.134.0.56:15021: read: connection reset by peer"
Sep 08 04:15:17.349731 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:17.349697    2573 generic.go:356] "Generic (PLEG): container finished" podID="dec747fc-2d76-440c-939d-59efa97b0206" containerID="25fdc6fe1f8b99758055cac11b7e19357afd9ab7deee6e9758b468a505e1422e" exitCode=0
Sep 08 04:15:17.349925 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:17.349760    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47" event={"ID":"dec747fc-2d76-440c-939d-59efa97b0206","Type":"ContainerDied","Data":"25fdc6fe1f8b99758055cac11b7e19357afd9ab7deee6e9758b468a505e1422e"}
Sep 08 04:15:17.350191 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:17.350176    2573 scope.go:117] "RemoveContainer" containerID="25fdc6fe1f8b99758055cac11b7e19357afd9ab7deee6e9758b468a505e1422e"
Sep 08 04:15:17.351339 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:17.351306    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:15:17.351405 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:17.351394    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:15:17.351462 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:17.351427    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:15:18.358103 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:18.358065    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47" event={"ID":"dec747fc-2d76-440c-939d-59efa97b0206","Type":"ContainerStarted","Data":"66c2efeb8616e8fae4d52a2168a7ae20052b11aac1632cdd311e8d4f5a8bf37b"}
Sep 08 04:15:18.401348 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:18.401313    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"
Sep 08 04:15:18.401573 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:18.401532    2573 patch_prober.go:28] interesting pod/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 08 04:15:18.401656 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:18.401599    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47" podUID="dec747fc-2d76-440c-939d-59efa97b0206" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 08 04:15:19.401520 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:19.401058    2573 patch_prober.go:28] interesting pod/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 08 04:15:19.401520 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:19.401123    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47" podUID="dec747fc-2d76-440c-939d-59efa97b0206" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 08 04:15:20.401943 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:20.401903    2573 patch_prober.go:28] interesting pod/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 08 04:15:20.402957 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:20.402524    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47" podUID="dec747fc-2d76-440c-939d-59efa97b0206" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 08 04:15:21.401810 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:21.401773    2573 patch_prober.go:28] interesting pod/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 08 04:15:21.402525 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:21.402121    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47" podUID="dec747fc-2d76-440c-939d-59efa97b0206" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 08 04:15:22.402920 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:22.402886    2573 patch_prober.go:28] interesting pod/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 08 04:15:22.404025 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:22.403992    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47" podUID="dec747fc-2d76-440c-939d-59efa97b0206" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 08 04:15:23.401183 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:23.401142    2573 patch_prober.go:28] interesting pod/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 08 04:15:23.401363 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:23.401223    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47" podUID="dec747fc-2d76-440c-939d-59efa97b0206" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 08 04:15:24.405998 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:24.405963    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"
Sep 08 04:15:24.406393 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:24.406363    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"
Sep 08 04:15:24.407081 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:24.407061    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"
Sep 08 04:15:33.201129 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:33.201041    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4001bd59-5b96d88488-nmt55"]
Sep 08 04:15:33.201527 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:33.201322    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4001bd59-5b96d88488-nmt55" podUID="923d75ce-efb6-4613-bd6d-e4a362d3dc68" containerName="maas-api" containerID="cri-o://7b58ecc7d6d2044a4ca42af0eabfddb85b2e7c7a8c2b24fb59cfe5d23b8efbc8" gracePeriod=30
Sep 08 04:15:33.457978 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:33.457904    2573 generic.go:356] "Generic (PLEG): container finished" podID="923d75ce-efb6-4613-bd6d-e4a362d3dc68" containerID="7b58ecc7d6d2044a4ca42af0eabfddb85b2e7c7a8c2b24fb59cfe5d23b8efbc8" exitCode=0
Sep 08 04:15:33.457978 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:33.457968    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4001bd59-5b96d88488-nmt55" event={"ID":"923d75ce-efb6-4613-bd6d-e4a362d3dc68","Type":"ContainerDied","Data":"7b58ecc7d6d2044a4ca42af0eabfddb85b2e7c7a8c2b24fb59cfe5d23b8efbc8"}
Sep 08 04:15:33.458138 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:33.458020    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4001bd59-5b96d88488-nmt55" event={"ID":"923d75ce-efb6-4613-bd6d-e4a362d3dc68","Type":"ContainerDied","Data":"ee195e8af00504faaf89b3baa0d78a2d353152e098dff972fbe0e3f6f62416ce"}
Sep 08 04:15:33.458138 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:33.458043    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ee195e8af00504faaf89b3baa0d78a2d353152e098dff972fbe0e3f6f62416ce"
Sep 08 04:15:33.474258 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:33.474169    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4001bd59-5b96d88488-nmt55"
Sep 08 04:15:33.576443 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:33.576411    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/923d75ce-efb6-4613-bd6d-e4a362d3dc68-maas-api-tls\") pod \"923d75ce-efb6-4613-bd6d-e4a362d3dc68\" (UID: \"923d75ce-efb6-4613-bd6d-e4a362d3dc68\") "
Sep 08 04:15:33.576643 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:33.576455    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/923d75ce-efb6-4613-bd6d-e4a362d3dc68-openshift-service-ca\") pod \"923d75ce-efb6-4613-bd6d-e4a362d3dc68\" (UID: \"923d75ce-efb6-4613-bd6d-e4a362d3dc68\") "
Sep 08 04:15:33.576643 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:33.576517    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/923d75ce-efb6-4613-bd6d-e4a362d3dc68-metrics-certs\") pod \"923d75ce-efb6-4613-bd6d-e4a362d3dc68\" (UID: \"923d75ce-efb6-4613-bd6d-e4a362d3dc68\") "
Sep 08 04:15:33.576843 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:33.576666    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6lxt\" (UniqueName: \"kubernetes.io/projected/923d75ce-efb6-4613-bd6d-e4a362d3dc68-kube-api-access-p6lxt\") pod \"923d75ce-efb6-4613-bd6d-e4a362d3dc68\" (UID: \"923d75ce-efb6-4613-bd6d-e4a362d3dc68\") "
Sep 08 04:15:33.576943 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:33.576911    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/923d75ce-efb6-4613-bd6d-e4a362d3dc68-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "923d75ce-efb6-4613-bd6d-e4a362d3dc68" (UID: "923d75ce-efb6-4613-bd6d-e4a362d3dc68"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 04:15:33.577169 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:33.577144    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/923d75ce-efb6-4613-bd6d-e4a362d3dc68-openshift-service-ca\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:15:33.578819 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:33.578791    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/923d75ce-efb6-4613-bd6d-e4a362d3dc68-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "923d75ce-efb6-4613-bd6d-e4a362d3dc68" (UID: "923d75ce-efb6-4613-bd6d-e4a362d3dc68"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:15:33.579262 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:33.579244    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/923d75ce-efb6-4613-bd6d-e4a362d3dc68-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "923d75ce-efb6-4613-bd6d-e4a362d3dc68" (UID: "923d75ce-efb6-4613-bd6d-e4a362d3dc68"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:15:33.579316 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:33.579273    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/923d75ce-efb6-4613-bd6d-e4a362d3dc68-kube-api-access-p6lxt" (OuterVolumeSpecName: "kube-api-access-p6lxt") pod "923d75ce-efb6-4613-bd6d-e4a362d3dc68" (UID: "923d75ce-efb6-4613-bd6d-e4a362d3dc68"). InnerVolumeSpecName "kube-api-access-p6lxt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:15:33.678128 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:33.678097    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6lxt\" (UniqueName: \"kubernetes.io/projected/923d75ce-efb6-4613-bd6d-e4a362d3dc68-kube-api-access-p6lxt\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:15:33.678128 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:33.678124    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/923d75ce-efb6-4613-bd6d-e4a362d3dc68-maas-api-tls\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:15:33.678128 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:33.678133    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/923d75ce-efb6-4613-bd6d-e4a362d3dc68-metrics-certs\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:15:34.463682 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:34.463649    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4001bd59-5b96d88488-nmt55"
Sep 08 04:15:34.484592 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:34.484539    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4001bd59-5b96d88488-nmt55"]
Sep 08 04:15:34.487364 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:34.487334    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4001bd59-5b96d88488-nmt55"]
Sep 08 04:15:34.639953 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:34.639915    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"]
Sep 08 04:15:34.640187 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:34.640157    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47" podUID="dec747fc-2d76-440c-939d-59efa97b0206" containerName="istio-proxy" containerID="cri-o://66c2efeb8616e8fae4d52a2168a7ae20052b11aac1632cdd311e8d4f5a8bf37b" gracePeriod=30
Sep 08 04:15:34.675628 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:34.675599    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="923d75ce-efb6-4613-bd6d-e4a362d3dc68" path="/var/lib/kubelet/pods/923d75ce-efb6-4613-bd6d-e4a362d3dc68/volumes"
Sep 08 04:15:35.357337 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.357308    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"]
Sep 08 04:15:35.357848 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.357833    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="923d75ce-efb6-4613-bd6d-e4a362d3dc68" containerName="maas-api"
Sep 08 04:15:35.357903 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.357850    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="923d75ce-efb6-4613-bd6d-e4a362d3dc68" containerName="maas-api"
Sep 08 04:15:35.357903 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.357860    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66a3cb3b-a642-40b7-aa73-555034586d62" containerName="istio-proxy"
Sep 08 04:15:35.357903 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.357866    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="66a3cb3b-a642-40b7-aa73-555034586d62" containerName="istio-proxy"
Sep 08 04:15:35.357995 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.357945    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="66a3cb3b-a642-40b7-aa73-555034586d62" containerName="istio-proxy"
Sep 08 04:15:35.357995 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.357956    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="66a3cb3b-a642-40b7-aa73-555034586d62" containerName="istio-proxy"
Sep 08 04:15:35.357995 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.357963    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="923d75ce-efb6-4613-bd6d-e4a362d3dc68" containerName="maas-api"
Sep 08 04:15:35.362232 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.361075    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"
Sep 08 04:15:35.365120 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.365090    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-efa641f8-openshift-default-dockercfg-qjkpc\""
Sep 08 04:15:35.372966 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.372939    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"]
Sep 08 04:15:35.498009 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.497970    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-workload-certs\") pod \"e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r\" (UID: \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\") " pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"
Sep 08 04:15:35.498487 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.498031    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-istiod-ca-cert\") pod \"e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r\" (UID: \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\") " pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"
Sep 08 04:15:35.498487 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.498114    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-workload-socket\") pod \"e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r\" (UID: \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\") " pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"
Sep 08 04:15:35.498487 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.498171    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-istio-data\") pod \"e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r\" (UID: \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\") " pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"
Sep 08 04:15:35.498487 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.498235    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-credential-socket\") pod \"e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r\" (UID: \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\") " pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"
Sep 08 04:15:35.498487 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.498284    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-istio-podinfo\") pod \"e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r\" (UID: \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\") " pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"
Sep 08 04:15:35.498487 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.498348    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mts64\" (UniqueName: \"kubernetes.io/projected/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-kube-api-access-mts64\") pod \"e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r\" (UID: \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\") " pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"
Sep 08 04:15:35.498487 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.498397    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-istio-token\") pod \"e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r\" (UID: \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\") " pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"
Sep 08 04:15:35.498487 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.498424    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-istio-envoy\") pod \"e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r\" (UID: \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\") " pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"
Sep 08 04:15:35.599494 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.599458    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-istiod-ca-cert\") pod \"e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r\" (UID: \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\") " pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"
Sep 08 04:15:35.599705 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.599503    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-workload-socket\") pod \"e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r\" (UID: \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\") " pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"
Sep 08 04:15:35.599705 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.599528    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-istio-data\") pod \"e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r\" (UID: \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\") " pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"
Sep 08 04:15:35.599705 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.599548    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-credential-socket\") pod \"e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r\" (UID: \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\") " pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"
Sep 08 04:15:35.599705 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.599617    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-istio-podinfo\") pod \"e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r\" (UID: \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\") " pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"
Sep 08 04:15:35.599705 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.599651    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mts64\" (UniqueName: \"kubernetes.io/projected/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-kube-api-access-mts64\") pod \"e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r\" (UID: \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\") " pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"
Sep 08 04:15:35.599705 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.599690    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-istio-token\") pod \"e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r\" (UID: \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\") " pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"
Sep 08 04:15:35.600021 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.599726    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-istio-envoy\") pod \"e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r\" (UID: \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\") " pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"
Sep 08 04:15:35.600021 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.599785    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-workload-certs\") pod \"e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r\" (UID: \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\") " pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"
Sep 08 04:15:35.600021 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.599968    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-credential-socket\") pod \"e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r\" (UID: \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\") " pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"
Sep 08 04:15:35.600202 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.600033    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-workload-socket\") pod \"e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r\" (UID: \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\") " pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"
Sep 08 04:15:35.600266 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.600201    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-workload-certs\") pod \"e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r\" (UID: \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\") " pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"
Sep 08 04:15:35.600319 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.600272    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-istio-data\") pod \"e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r\" (UID: \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\") " pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"
Sep 08 04:15:35.600366 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.600334    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-istiod-ca-cert\") pod \"e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r\" (UID: \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\") " pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"
Sep 08 04:15:35.602286 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.602259    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-istio-envoy\") pod \"e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r\" (UID: \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\") " pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"
Sep 08 04:15:35.602609 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.602589    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-istio-podinfo\") pod \"e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r\" (UID: \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\") " pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"
Sep 08 04:15:35.607626 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.607540    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-istio-token\") pod \"e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r\" (UID: \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\") " pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"
Sep 08 04:15:35.607732 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.607665    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mts64\" (UniqueName: \"kubernetes.io/projected/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-kube-api-access-mts64\") pod \"e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r\" (UID: \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\") " pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"
Sep 08 04:15:35.679984 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.679951    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"
Sep 08 04:15:35.957277 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.957245    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"]
Sep 08 04:15:35.958788 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:15:35.958762    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0aa6bdd0_a827_40a1_bb3b_9bd2be0b7b27.slice/crio-561c3e77ad18631910b32ec43b63e62ff9648fe8c8894b8bac61087a15115d54 WatchSource:0}: Error finding container 561c3e77ad18631910b32ec43b63e62ff9648fe8c8894b8bac61087a15115d54: Status 404 returned error can't find the container with id 561c3e77ad18631910b32ec43b63e62ff9648fe8c8894b8bac61087a15115d54
Sep 08 04:15:35.961456 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.961428    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:15:35.961520 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.961492    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:15:35.961586 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:35.961518    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:15:36.481665 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:36.481629    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r" event={"ID":"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27","Type":"ContainerStarted","Data":"0c69ba895f08cf83967993ba3953844a99c95fb7aeaa9e1c44d0857bd884fa5d"}
Sep 08 04:15:36.481883 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:36.481687    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r" event={"ID":"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27","Type":"ContainerStarted","Data":"561c3e77ad18631910b32ec43b63e62ff9648fe8c8894b8bac61087a15115d54"}
Sep 08 04:15:36.502371 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:36.502315    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r" podStartSLOduration=1.502297639 podStartE2EDuration="1.502297639s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:15:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:15:36.500023052 +0000 UTC m=+896.285314289" watchObservedRunningTime="2026-09-08 04:15:36.502297639 +0000 UTC m=+896.287588935"
Sep 08 04:15:36.680618 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:36.680590    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"
Sep 08 04:15:37.685911 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:37.685884    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"
Sep 08 04:15:38.495232 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:38.495198    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"
Sep 08 04:15:38.496275 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:38.496253    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"
Sep 08 04:15:39.049899 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:39.049858    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-efa641f8-7945956d55-r8vmz"]
Sep 08 04:15:39.050701 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:39.050634    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66a3cb3b-a642-40b7-aa73-555034586d62" containerName="istio-proxy"
Sep 08 04:15:39.050701 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:39.050657    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="66a3cb3b-a642-40b7-aa73-555034586d62" containerName="istio-proxy"
Sep 08 04:15:39.053215 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:39.053197    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-efa641f8-7945956d55-r8vmz"
Sep 08 04:15:39.055818 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:39.055794    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-efa641f8-serving-cert\""
Sep 08 04:15:39.064335 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:39.064229    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-efa641f8-7945956d55-r8vmz"]
Sep 08 04:15:39.135457 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:39.135425    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06593306-50cd-48b1-9998-87a79c653b6a-maas-api-tls\") pod \"maas-api-e2e-derive-efa641f8-7945956d55-r8vmz\" (UID: \"06593306-50cd-48b1-9998-87a79c653b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-efa641f8-7945956d55-r8vmz"
Sep 08 04:15:39.135457 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:39.135459    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06593306-50cd-48b1-9998-87a79c653b6a-metrics-certs\") pod \"maas-api-e2e-derive-efa641f8-7945956d55-r8vmz\" (UID: \"06593306-50cd-48b1-9998-87a79c653b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-efa641f8-7945956d55-r8vmz"
Sep 08 04:15:39.135680 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:39.135479    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpcjq\" (UniqueName: \"kubernetes.io/projected/06593306-50cd-48b1-9998-87a79c653b6a-kube-api-access-lpcjq\") pod \"maas-api-e2e-derive-efa641f8-7945956d55-r8vmz\" (UID: \"06593306-50cd-48b1-9998-87a79c653b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-efa641f8-7945956d55-r8vmz"
Sep 08 04:15:39.135680 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:39.135542    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06593306-50cd-48b1-9998-87a79c653b6a-openshift-service-ca\") pod \"maas-api-e2e-derive-efa641f8-7945956d55-r8vmz\" (UID: \"06593306-50cd-48b1-9998-87a79c653b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-efa641f8-7945956d55-r8vmz"
Sep 08 04:15:39.236160 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:39.236128    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06593306-50cd-48b1-9998-87a79c653b6a-maas-api-tls\") pod \"maas-api-e2e-derive-efa641f8-7945956d55-r8vmz\" (UID: \"06593306-50cd-48b1-9998-87a79c653b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-efa641f8-7945956d55-r8vmz"
Sep 08 04:15:39.236160 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:39.236168    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06593306-50cd-48b1-9998-87a79c653b6a-metrics-certs\") pod \"maas-api-e2e-derive-efa641f8-7945956d55-r8vmz\" (UID: \"06593306-50cd-48b1-9998-87a79c653b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-efa641f8-7945956d55-r8vmz"
Sep 08 04:15:39.236409 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:39.236198    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpcjq\" (UniqueName: \"kubernetes.io/projected/06593306-50cd-48b1-9998-87a79c653b6a-kube-api-access-lpcjq\") pod \"maas-api-e2e-derive-efa641f8-7945956d55-r8vmz\" (UID: \"06593306-50cd-48b1-9998-87a79c653b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-efa641f8-7945956d55-r8vmz"
Sep 08 04:15:39.236409 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:39.236267    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06593306-50cd-48b1-9998-87a79c653b6a-openshift-service-ca\") pod \"maas-api-e2e-derive-efa641f8-7945956d55-r8vmz\" (UID: \"06593306-50cd-48b1-9998-87a79c653b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-efa641f8-7945956d55-r8vmz"
Sep 08 04:15:39.237054 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:39.237009    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06593306-50cd-48b1-9998-87a79c653b6a-openshift-service-ca\") pod \"maas-api-e2e-derive-efa641f8-7945956d55-r8vmz\" (UID: \"06593306-50cd-48b1-9998-87a79c653b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-efa641f8-7945956d55-r8vmz"
Sep 08 04:15:39.238881 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:39.238864    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06593306-50cd-48b1-9998-87a79c653b6a-metrics-certs\") pod \"maas-api-e2e-derive-efa641f8-7945956d55-r8vmz\" (UID: \"06593306-50cd-48b1-9998-87a79c653b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-efa641f8-7945956d55-r8vmz"
Sep 08 04:15:39.238965 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:39.238903    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06593306-50cd-48b1-9998-87a79c653b6a-maas-api-tls\") pod \"maas-api-e2e-derive-efa641f8-7945956d55-r8vmz\" (UID: \"06593306-50cd-48b1-9998-87a79c653b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-efa641f8-7945956d55-r8vmz"
Sep 08 04:15:39.246260 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:39.246236    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpcjq\" (UniqueName: \"kubernetes.io/projected/06593306-50cd-48b1-9998-87a79c653b6a-kube-api-access-lpcjq\") pod \"maas-api-e2e-derive-efa641f8-7945956d55-r8vmz\" (UID: \"06593306-50cd-48b1-9998-87a79c653b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-efa641f8-7945956d55-r8vmz"
Sep 08 04:15:39.368117 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:39.368043    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-efa641f8-7945956d55-r8vmz"
Sep 08 04:15:39.409716 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:39.409679    2573 patch_prober.go:28] interesting pod/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 04:15:39.409880 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:39.409746    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47" podUID="dec747fc-2d76-440c-939d-59efa97b0206" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 04:15:39.646761 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:39.646721    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-efa641f8-7945956d55-r8vmz"]
Sep 08 04:15:39.647645 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:15:39.647614    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06593306_50cd_48b1_9998_87a79c653b6a.slice/crio-c14f469d1e39e7c1998ffb8ebdd4ed1dafca0fad9581fbbab1b4af2fa8451a2b WatchSource:0}: Error finding container c14f469d1e39e7c1998ffb8ebdd4ed1dafca0fad9581fbbab1b4af2fa8451a2b: Status 404 returned error can't find the container with id c14f469d1e39e7c1998ffb8ebdd4ed1dafca0fad9581fbbab1b4af2fa8451a2b
Sep 08 04:15:39.894811 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:39.894735    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"
Sep 08 04:15:39.944033 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:39.942535    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dec747fc-2d76-440c-939d-59efa97b0206-workload-certs\") pod \"dec747fc-2d76-440c-939d-59efa97b0206\" (UID: \"dec747fc-2d76-440c-939d-59efa97b0206\") "
Sep 08 04:15:39.944033 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:39.942697    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dec747fc-2d76-440c-939d-59efa97b0206-istio-token\") pod \"dec747fc-2d76-440c-939d-59efa97b0206\" (UID: \"dec747fc-2d76-440c-939d-59efa97b0206\") "
Sep 08 04:15:39.944033 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:39.942736    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dec747fc-2d76-440c-939d-59efa97b0206-workload-socket\") pod \"dec747fc-2d76-440c-939d-59efa97b0206\" (UID: \"dec747fc-2d76-440c-939d-59efa97b0206\") "
Sep 08 04:15:39.944033 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:39.942778    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dec747fc-2d76-440c-939d-59efa97b0206-credential-socket\") pod \"dec747fc-2d76-440c-939d-59efa97b0206\" (UID: \"dec747fc-2d76-440c-939d-59efa97b0206\") "
Sep 08 04:15:39.944033 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:39.942832    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dec747fc-2d76-440c-939d-59efa97b0206-istio-podinfo\") pod \"dec747fc-2d76-440c-939d-59efa97b0206\" (UID: \"dec747fc-2d76-440c-939d-59efa97b0206\") "
Sep 08 04:15:39.944033 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:39.942883    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dec747fc-2d76-440c-939d-59efa97b0206-istio-data\") pod \"dec747fc-2d76-440c-939d-59efa97b0206\" (UID: \"dec747fc-2d76-440c-939d-59efa97b0206\") "
Sep 08 04:15:39.944033 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:39.942922    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgfzj\" (UniqueName: \"kubernetes.io/projected/dec747fc-2d76-440c-939d-59efa97b0206-kube-api-access-vgfzj\") pod \"dec747fc-2d76-440c-939d-59efa97b0206\" (UID: \"dec747fc-2d76-440c-939d-59efa97b0206\") "
Sep 08 04:15:39.944033 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:39.943006    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dec747fc-2d76-440c-939d-59efa97b0206-istiod-ca-cert\") pod \"dec747fc-2d76-440c-939d-59efa97b0206\" (UID: \"dec747fc-2d76-440c-939d-59efa97b0206\") "
Sep 08 04:15:39.944033 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:39.943056    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dec747fc-2d76-440c-939d-59efa97b0206-istio-envoy\") pod \"dec747fc-2d76-440c-939d-59efa97b0206\" (UID: \"dec747fc-2d76-440c-939d-59efa97b0206\") "
Sep 08 04:15:39.947456 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:39.947234    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dec747fc-2d76-440c-939d-59efa97b0206-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dec747fc-2d76-440c-939d-59efa97b0206" (UID: "dec747fc-2d76-440c-939d-59efa97b0206"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:15:39.947732 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:39.947692    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dec747fc-2d76-440c-939d-59efa97b0206-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dec747fc-2d76-440c-939d-59efa97b0206" (UID: "dec747fc-2d76-440c-939d-59efa97b0206"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:15:39.950668 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:39.950643    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dec747fc-2d76-440c-939d-59efa97b0206-istio-data" (OuterVolumeSpecName: "istio-data") pod "dec747fc-2d76-440c-939d-59efa97b0206" (UID: "dec747fc-2d76-440c-939d-59efa97b0206"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:15:39.950800 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:39.950699    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dec747fc-2d76-440c-939d-59efa97b0206-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dec747fc-2d76-440c-939d-59efa97b0206" (UID: "dec747fc-2d76-440c-939d-59efa97b0206"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 04:15:39.951114 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:39.951096    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dec747fc-2d76-440c-939d-59efa97b0206-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dec747fc-2d76-440c-939d-59efa97b0206" (UID: "dec747fc-2d76-440c-939d-59efa97b0206"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:15:39.951921 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:39.951393    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dec747fc-2d76-440c-939d-59efa97b0206-istio-token" (OuterVolumeSpecName: "istio-token") pod "dec747fc-2d76-440c-939d-59efa97b0206" (UID: "dec747fc-2d76-440c-939d-59efa97b0206"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:15:39.951921 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:39.951526    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dec747fc-2d76-440c-939d-59efa97b0206-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dec747fc-2d76-440c-939d-59efa97b0206" (UID: "dec747fc-2d76-440c-939d-59efa97b0206"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:15:39.952921 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:39.952899    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dec747fc-2d76-440c-939d-59efa97b0206-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dec747fc-2d76-440c-939d-59efa97b0206" (UID: "dec747fc-2d76-440c-939d-59efa97b0206"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 04:15:39.953123 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:39.953107    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dec747fc-2d76-440c-939d-59efa97b0206-kube-api-access-vgfzj" (OuterVolumeSpecName: "kube-api-access-vgfzj") pod "dec747fc-2d76-440c-939d-59efa97b0206" (UID: "dec747fc-2d76-440c-939d-59efa97b0206"). InnerVolumeSpecName "kube-api-access-vgfzj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:15:40.045113 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:40.045082    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dec747fc-2d76-440c-939d-59efa97b0206-istio-token\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:15:40.045113 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:40.045109    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dec747fc-2d76-440c-939d-59efa97b0206-workload-socket\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:15:40.045268 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:40.045122    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dec747fc-2d76-440c-939d-59efa97b0206-credential-socket\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:15:40.045268 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:40.045135    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dec747fc-2d76-440c-939d-59efa97b0206-istio-podinfo\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:15:40.045268 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:40.045146    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dec747fc-2d76-440c-939d-59efa97b0206-istio-data\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:15:40.045268 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:40.045157    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgfzj\" (UniqueName: \"kubernetes.io/projected/dec747fc-2d76-440c-939d-59efa97b0206-kube-api-access-vgfzj\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:15:40.045268 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:40.045169    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dec747fc-2d76-440c-939d-59efa97b0206-istiod-ca-cert\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:15:40.045268 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:40.045182    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dec747fc-2d76-440c-939d-59efa97b0206-istio-envoy\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:15:40.045268 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:40.045193    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dec747fc-2d76-440c-939d-59efa97b0206-workload-certs\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:15:40.507681 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:40.507647    2573 generic.go:356] "Generic (PLEG): container finished" podID="dec747fc-2d76-440c-939d-59efa97b0206" containerID="66c2efeb8616e8fae4d52a2168a7ae20052b11aac1632cdd311e8d4f5a8bf37b" exitCode=0
Sep 08 04:15:40.508116 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:40.507692    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47" event={"ID":"dec747fc-2d76-440c-939d-59efa97b0206","Type":"ContainerDied","Data":"66c2efeb8616e8fae4d52a2168a7ae20052b11aac1632cdd311e8d4f5a8bf37b"}
Sep 08 04:15:40.508116 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:40.507739    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"
Sep 08 04:15:40.508116 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:40.507796    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47" event={"ID":"dec747fc-2d76-440c-939d-59efa97b0206","Type":"ContainerDied","Data":"80e38653fdbe32b439153bef7d69de1257f585f374e0120b2f2881637f302234"}
Sep 08 04:15:40.508116 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:40.507845    2573 scope.go:117] "RemoveContainer" containerID="66c2efeb8616e8fae4d52a2168a7ae20052b11aac1632cdd311e8d4f5a8bf37b"
Sep 08 04:15:40.509633 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:40.509602    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-efa641f8-7945956d55-r8vmz" event={"ID":"06593306-50cd-48b1-9998-87a79c653b6a","Type":"ContainerStarted","Data":"3a1a42d9c20746b3c7e3729a4797dc81e4f8321051eddcf94c5af9a52417011f"}
Sep 08 04:15:40.509757 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:40.509660    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-efa641f8-7945956d55-r8vmz" event={"ID":"06593306-50cd-48b1-9998-87a79c653b6a","Type":"ContainerStarted","Data":"c14f469d1e39e7c1998ffb8ebdd4ed1dafca0fad9581fbbab1b4af2fa8451a2b"}
Sep 08 04:15:40.509940 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:40.509900    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-efa641f8-7945956d55-r8vmz"
Sep 08 04:15:40.518145 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:40.518129    2573 scope.go:117] "RemoveContainer" containerID="25fdc6fe1f8b99758055cac11b7e19357afd9ab7deee6e9758b468a505e1422e"
Sep 08 04:15:40.527171 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:40.527097    2573 scope.go:117] "RemoveContainer" containerID="66c2efeb8616e8fae4d52a2168a7ae20052b11aac1632cdd311e8d4f5a8bf37b"
Sep 08 04:15:40.527739 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:15:40.527716    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66c2efeb8616e8fae4d52a2168a7ae20052b11aac1632cdd311e8d4f5a8bf37b\": container with ID starting with 66c2efeb8616e8fae4d52a2168a7ae20052b11aac1632cdd311e8d4f5a8bf37b not found: ID does not exist" containerID="66c2efeb8616e8fae4d52a2168a7ae20052b11aac1632cdd311e8d4f5a8bf37b"
Sep 08 04:15:40.527835 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:40.527746    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66c2efeb8616e8fae4d52a2168a7ae20052b11aac1632cdd311e8d4f5a8bf37b"} err="failed to get container status \"66c2efeb8616e8fae4d52a2168a7ae20052b11aac1632cdd311e8d4f5a8bf37b\": rpc error: code = NotFound desc = could not find container \"66c2efeb8616e8fae4d52a2168a7ae20052b11aac1632cdd311e8d4f5a8bf37b\": container with ID starting with 66c2efeb8616e8fae4d52a2168a7ae20052b11aac1632cdd311e8d4f5a8bf37b not found: ID does not exist"
Sep 08 04:15:40.527835 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:40.527765    2573 scope.go:117] "RemoveContainer" containerID="25fdc6fe1f8b99758055cac11b7e19357afd9ab7deee6e9758b468a505e1422e"
Sep 08 04:15:40.528046 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:15:40.528027    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25fdc6fe1f8b99758055cac11b7e19357afd9ab7deee6e9758b468a505e1422e\": container with ID starting with 25fdc6fe1f8b99758055cac11b7e19357afd9ab7deee6e9758b468a505e1422e not found: ID does not exist" containerID="25fdc6fe1f8b99758055cac11b7e19357afd9ab7deee6e9758b468a505e1422e"
Sep 08 04:15:40.528092 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:40.528051    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25fdc6fe1f8b99758055cac11b7e19357afd9ab7deee6e9758b468a505e1422e"} err="failed to get container status \"25fdc6fe1f8b99758055cac11b7e19357afd9ab7deee6e9758b468a505e1422e\": rpc error: code = NotFound desc = could not find container \"25fdc6fe1f8b99758055cac11b7e19357afd9ab7deee6e9758b468a505e1422e\": container with ID starting with 25fdc6fe1f8b99758055cac11b7e19357afd9ab7deee6e9758b468a505e1422e not found: ID does not exist"
Sep 08 04:15:40.529632 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:40.529593    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-efa641f8-7945956d55-r8vmz" podStartSLOduration=1.160958727 podStartE2EDuration="1.529580348s" totalImagesPullingTime="368.621621ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:15:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:15:40.526817885 +0000 UTC m=+900.312109124" watchObservedRunningTime="2026-09-08 04:15:40.529580348 +0000 UTC m=+900.314871581"
Sep 08 04:15:40.543143 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:40.543123    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"]
Sep 08 04:15:40.546659 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:40.546634    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47"]
Sep 08 04:15:40.675429 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:40.675397    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dec747fc-2d76-440c-939d-59efa97b0206" path="/var/lib/kubelet/pods/dec747fc-2d76-440c-939d-59efa97b0206/volumes"
Sep 08 04:15:46.522571 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:46.522525    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-efa641f8-7945956d55-r8vmz"
Sep 08 04:15:53.970848 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:53.970814    2573 patch_prober.go:28] interesting pod/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": read tcp 10.134.0.2:36516->10.134.0.58:15021: read: connection reset by peer" start-of-body=
Sep 08 04:15:53.971465 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:53.970899    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r" podUID="0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": read tcp 10.134.0.2:36516->10.134.0.58:15021: read: connection reset by peer"
Sep 08 04:15:54.593380 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:54.593347    2573 generic.go:356] "Generic (PLEG): container finished" podID="0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27" containerID="0c69ba895f08cf83967993ba3953844a99c95fb7aeaa9e1c44d0857bd884fa5d" exitCode=0
Sep 08 04:15:54.593596 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:54.593428    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r" event={"ID":"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27","Type":"ContainerDied","Data":"0c69ba895f08cf83967993ba3953844a99c95fb7aeaa9e1c44d0857bd884fa5d"}
Sep 08 04:15:54.593939 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:54.593923    2573 scope.go:117] "RemoveContainer" containerID="0c69ba895f08cf83967993ba3953844a99c95fb7aeaa9e1c44d0857bd884fa5d"
Sep 08 04:15:54.595067 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:54.595040    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:15:54.595170 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:54.595127    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:15:54.595237 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:54.595177    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:15:55.608299 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:55.608250    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r" event={"ID":"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27","Type":"ContainerStarted","Data":"8030e62d416c692305d96161574130ce823a1c9e593fb21ba03a6ff7dc901d3c"}
Sep 08 04:15:55.681071 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:55.681035    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"
Sep 08 04:15:55.681239 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:55.681219    2573 patch_prober.go:28] interesting pod/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 08 04:15:55.681290 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:55.681268    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r" podUID="0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 08 04:15:56.680393 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:56.680359    2573 patch_prober.go:28] interesting pod/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 08 04:15:56.680810 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:56.680410    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r" podUID="0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 08 04:15:57.680681 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:57.680648    2573 patch_prober.go:28] interesting pod/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 08 04:15:57.681038 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:57.680703    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r" podUID="0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 08 04:15:58.680973 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:58.680944    2573 patch_prober.go:28] interesting pod/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 08 04:15:58.681362 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:58.680993    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r" podUID="0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 08 04:15:59.680646 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:59.680608    2573 patch_prober.go:28] interesting pod/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 08 04:15:59.680821 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:15:59.680669    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r" podUID="0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 08 04:16:00.951318 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:00.951287    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"
Sep 08 04:16:00.951876 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:00.951848    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"
Sep 08 04:16:00.952995 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:00.952973    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"
Sep 08 04:16:09.857082 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:09.857050    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-efa641f8-7945956d55-r8vmz"]
Sep 08 04:16:09.857470 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:09.857255    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-efa641f8-7945956d55-r8vmz" podUID="06593306-50cd-48b1-9998-87a79c653b6a" containerName="maas-api" containerID="cri-o://3a1a42d9c20746b3c7e3729a4797dc81e4f8321051eddcf94c5af9a52417011f" gracePeriod=30
Sep 08 04:16:10.125178 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:10.125154    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-efa641f8-7945956d55-r8vmz"
Sep 08 04:16:10.176254 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:10.176212    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06593306-50cd-48b1-9998-87a79c653b6a-openshift-service-ca\") pod \"06593306-50cd-48b1-9998-87a79c653b6a\" (UID: \"06593306-50cd-48b1-9998-87a79c653b6a\") "
Sep 08 04:16:10.176451 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:10.176297    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06593306-50cd-48b1-9998-87a79c653b6a-maas-api-tls\") pod \"06593306-50cd-48b1-9998-87a79c653b6a\" (UID: \"06593306-50cd-48b1-9998-87a79c653b6a\") "
Sep 08 04:16:10.176451 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:10.176324    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpcjq\" (UniqueName: \"kubernetes.io/projected/06593306-50cd-48b1-9998-87a79c653b6a-kube-api-access-lpcjq\") pod \"06593306-50cd-48b1-9998-87a79c653b6a\" (UID: \"06593306-50cd-48b1-9998-87a79c653b6a\") "
Sep 08 04:16:10.176451 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:10.176400    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06593306-50cd-48b1-9998-87a79c653b6a-metrics-certs\") pod \"06593306-50cd-48b1-9998-87a79c653b6a\" (UID: \"06593306-50cd-48b1-9998-87a79c653b6a\") "
Sep 08 04:16:10.177580 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:10.177510    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06593306-50cd-48b1-9998-87a79c653b6a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "06593306-50cd-48b1-9998-87a79c653b6a" (UID: "06593306-50cd-48b1-9998-87a79c653b6a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 04:16:10.179120 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:10.179091    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06593306-50cd-48b1-9998-87a79c653b6a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "06593306-50cd-48b1-9998-87a79c653b6a" (UID: "06593306-50cd-48b1-9998-87a79c653b6a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:16:10.179120 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:10.179109    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06593306-50cd-48b1-9998-87a79c653b6a-kube-api-access-lpcjq" (OuterVolumeSpecName: "kube-api-access-lpcjq") pod "06593306-50cd-48b1-9998-87a79c653b6a" (UID: "06593306-50cd-48b1-9998-87a79c653b6a"). InnerVolumeSpecName "kube-api-access-lpcjq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:16:10.179265 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:10.179216    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06593306-50cd-48b1-9998-87a79c653b6a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "06593306-50cd-48b1-9998-87a79c653b6a" (UID: "06593306-50cd-48b1-9998-87a79c653b6a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:16:10.223630 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:10.223597    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"]
Sep 08 04:16:10.223859 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:10.223833    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r" podUID="0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27" containerName="istio-proxy" containerID="cri-o://8030e62d416c692305d96161574130ce823a1c9e593fb21ba03a6ff7dc901d3c" gracePeriod=30
Sep 08 04:16:10.278388 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:10.278357    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06593306-50cd-48b1-9998-87a79c653b6a-metrics-certs\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:16:10.278388 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:10.278383    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06593306-50cd-48b1-9998-87a79c653b6a-openshift-service-ca\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:16:10.278388 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:10.278392    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06593306-50cd-48b1-9998-87a79c653b6a-maas-api-tls\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:16:10.278640 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:10.278401    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpcjq\" (UniqueName: \"kubernetes.io/projected/06593306-50cd-48b1-9998-87a79c653b6a-kube-api-access-lpcjq\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:16:10.707517 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:10.707483    2573 generic.go:356] "Generic (PLEG): container finished" podID="06593306-50cd-48b1-9998-87a79c653b6a" containerID="3a1a42d9c20746b3c7e3729a4797dc81e4f8321051eddcf94c5af9a52417011f" exitCode=0
Sep 08 04:16:10.707698 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:10.707534    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-efa641f8-7945956d55-r8vmz"
Sep 08 04:16:10.707698 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:10.707585    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-efa641f8-7945956d55-r8vmz" event={"ID":"06593306-50cd-48b1-9998-87a79c653b6a","Type":"ContainerDied","Data":"3a1a42d9c20746b3c7e3729a4797dc81e4f8321051eddcf94c5af9a52417011f"}
Sep 08 04:16:10.707698 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:10.707669    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-efa641f8-7945956d55-r8vmz" event={"ID":"06593306-50cd-48b1-9998-87a79c653b6a","Type":"ContainerDied","Data":"c14f469d1e39e7c1998ffb8ebdd4ed1dafca0fad9581fbbab1b4af2fa8451a2b"}
Sep 08 04:16:10.707698 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:10.707697    2573 scope.go:117] "RemoveContainer" containerID="3a1a42d9c20746b3c7e3729a4797dc81e4f8321051eddcf94c5af9a52417011f"
Sep 08 04:16:10.719177 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:10.719159    2573 scope.go:117] "RemoveContainer" containerID="3a1a42d9c20746b3c7e3729a4797dc81e4f8321051eddcf94c5af9a52417011f"
Sep 08 04:16:10.719601 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:16:10.719550    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a1a42d9c20746b3c7e3729a4797dc81e4f8321051eddcf94c5af9a52417011f\": container with ID starting with 3a1a42d9c20746b3c7e3729a4797dc81e4f8321051eddcf94c5af9a52417011f not found: ID does not exist" containerID="3a1a42d9c20746b3c7e3729a4797dc81e4f8321051eddcf94c5af9a52417011f"
Sep 08 04:16:10.719684 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:10.719613    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a1a42d9c20746b3c7e3729a4797dc81e4f8321051eddcf94c5af9a52417011f"} err="failed to get container status \"3a1a42d9c20746b3c7e3729a4797dc81e4f8321051eddcf94c5af9a52417011f\": rpc error: code = NotFound desc = could not find container \"3a1a42d9c20746b3c7e3729a4797dc81e4f8321051eddcf94c5af9a52417011f\": container with ID starting with 3a1a42d9c20746b3c7e3729a4797dc81e4f8321051eddcf94c5af9a52417011f not found: ID does not exist"
Sep 08 04:16:10.723812 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:10.723790    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-efa641f8-7945956d55-r8vmz"]
Sep 08 04:16:10.728801 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:10.728779    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-efa641f8-7945956d55-r8vmz"]
Sep 08 04:16:12.676091 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:12.676061    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06593306-50cd-48b1-9998-87a79c653b6a" path="/var/lib/kubelet/pods/06593306-50cd-48b1-9998-87a79c653b6a/volumes"
Sep 08 04:16:15.483042 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:15.483019    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"
Sep 08 04:16:15.534758 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:15.534727    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-workload-socket\") pod \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\" (UID: \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\") "
Sep 08 04:16:15.534932 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:15.534815    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mts64\" (UniqueName: \"kubernetes.io/projected/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-kube-api-access-mts64\") pod \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\" (UID: \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\") "
Sep 08 04:16:15.534932 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:15.534844    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-istio-podinfo\") pod \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\" (UID: \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\") "
Sep 08 04:16:15.534932 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:15.534878    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-workload-certs\") pod \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\" (UID: \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\") "
Sep 08 04:16:15.534932 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:15.534902    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-istiod-ca-cert\") pod \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\" (UID: \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\") "
Sep 08 04:16:15.535157 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:15.534958    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-istio-data\") pod \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\" (UID: \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\") "
Sep 08 04:16:15.535157 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:15.534999    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-credential-socket\") pod \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\" (UID: \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\") "
Sep 08 04:16:15.535157 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:15.535032    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-istio-envoy\") pod \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\" (UID: \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\") "
Sep 08 04:16:15.535157 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:15.535033    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27" (UID: "0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:16:15.535157 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:15.535068    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-istio-token\") pod \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\" (UID: \"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27\") "
Sep 08 04:16:15.535413 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:15.535242    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-istio-data" (OuterVolumeSpecName: "istio-data") pod "0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27" (UID: "0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:16:15.535516 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:15.535491    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27" (UID: "0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:16:15.535604 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:15.535501    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-workload-socket\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:16:15.535604 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:15.535541    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-istio-data\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:16:15.535727 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:15.535697    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27" (UID: "0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:16:15.535820 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:15.535801    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27" (UID: "0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 04:16:15.537453 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:15.537425    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27" (UID: "0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 04:16:15.537601 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:15.537535    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27" (UID: "0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:16:15.537745 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:15.537730    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-kube-api-access-mts64" (OuterVolumeSpecName: "kube-api-access-mts64") pod "0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27" (UID: "0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27"). InnerVolumeSpecName "kube-api-access-mts64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:16:15.537791 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:15.537771    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-istio-token" (OuterVolumeSpecName: "istio-token") pod "0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27" (UID: "0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:16:15.636459 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:15.636435    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-credential-socket\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:16:15.636459 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:15.636458    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-istio-envoy\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:16:15.636649 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:15.636468    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-istio-token\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:16:15.636649 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:15.636476    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mts64\" (UniqueName: \"kubernetes.io/projected/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-kube-api-access-mts64\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:16:15.636649 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:15.636485    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-istio-podinfo\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:16:15.636649 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:15.636492    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-workload-certs\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:16:15.636649 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:15.636499    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27-istiod-ca-cert\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:16:15.741696 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:15.741659    2573 generic.go:356] "Generic (PLEG): container finished" podID="0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27" containerID="8030e62d416c692305d96161574130ce823a1c9e593fb21ba03a6ff7dc901d3c" exitCode=0
Sep 08 04:16:15.741827 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:15.741702    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r" event={"ID":"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27","Type":"ContainerDied","Data":"8030e62d416c692305d96161574130ce823a1c9e593fb21ba03a6ff7dc901d3c"}
Sep 08 04:16:15.741827 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:15.741721    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"
Sep 08 04:16:15.741827 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:15.741745    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r" event={"ID":"0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27","Type":"ContainerDied","Data":"561c3e77ad18631910b32ec43b63e62ff9648fe8c8894b8bac61087a15115d54"}
Sep 08 04:16:15.741827 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:15.741766    2573 scope.go:117] "RemoveContainer" containerID="8030e62d416c692305d96161574130ce823a1c9e593fb21ba03a6ff7dc901d3c"
Sep 08 04:16:15.751403 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:15.751383    2573 scope.go:117] "RemoveContainer" containerID="0c69ba895f08cf83967993ba3953844a99c95fb7aeaa9e1c44d0857bd884fa5d"
Sep 08 04:16:15.759961 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:15.759946    2573 scope.go:117] "RemoveContainer" containerID="8030e62d416c692305d96161574130ce823a1c9e593fb21ba03a6ff7dc901d3c"
Sep 08 04:16:15.760373 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:16:15.760274    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8030e62d416c692305d96161574130ce823a1c9e593fb21ba03a6ff7dc901d3c\": container with ID starting with 8030e62d416c692305d96161574130ce823a1c9e593fb21ba03a6ff7dc901d3c not found: ID does not exist" containerID="8030e62d416c692305d96161574130ce823a1c9e593fb21ba03a6ff7dc901d3c"
Sep 08 04:16:15.760523 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:15.760463    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8030e62d416c692305d96161574130ce823a1c9e593fb21ba03a6ff7dc901d3c"} err="failed to get container status \"8030e62d416c692305d96161574130ce823a1c9e593fb21ba03a6ff7dc901d3c\": rpc error: code = NotFound desc = could not find container \"8030e62d416c692305d96161574130ce823a1c9e593fb21ba03a6ff7dc901d3c\": container with ID starting with 8030e62d416c692305d96161574130ce823a1c9e593fb21ba03a6ff7dc901d3c not found: ID does not exist"
Sep 08 04:16:15.760523 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:15.760492    2573 scope.go:117] "RemoveContainer" containerID="0c69ba895f08cf83967993ba3953844a99c95fb7aeaa9e1c44d0857bd884fa5d"
Sep 08 04:16:15.760902 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:16:15.760880    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c69ba895f08cf83967993ba3953844a99c95fb7aeaa9e1c44d0857bd884fa5d\": container with ID starting with 0c69ba895f08cf83967993ba3953844a99c95fb7aeaa9e1c44d0857bd884fa5d not found: ID does not exist" containerID="0c69ba895f08cf83967993ba3953844a99c95fb7aeaa9e1c44d0857bd884fa5d"
Sep 08 04:16:15.761004 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:15.760905    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c69ba895f08cf83967993ba3953844a99c95fb7aeaa9e1c44d0857bd884fa5d"} err="failed to get container status \"0c69ba895f08cf83967993ba3953844a99c95fb7aeaa9e1c44d0857bd884fa5d\": rpc error: code = NotFound desc = could not find container \"0c69ba895f08cf83967993ba3953844a99c95fb7aeaa9e1c44d0857bd884fa5d\": container with ID starting with 0c69ba895f08cf83967993ba3953844a99c95fb7aeaa9e1c44d0857bd884fa5d not found: ID does not exist"
Sep 08 04:16:15.763465 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:15.763445    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"]
Sep 08 04:16:15.766804 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:15.766775    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r"]
Sep 08 04:16:16.676477 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:16.676446    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27" path="/var/lib/kubelet/pods/0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27/volumes"
Sep 08 04:16:53.337938 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:53.337898    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59"]
Sep 08 04:16:53.338538 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:53.338519    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dec747fc-2d76-440c-939d-59efa97b0206" containerName="istio-proxy"
Sep 08 04:16:53.338614 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:53.338542    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="dec747fc-2d76-440c-939d-59efa97b0206" containerName="istio-proxy"
Sep 08 04:16:53.338614 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:53.338575    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06593306-50cd-48b1-9998-87a79c653b6a" containerName="maas-api"
Sep 08 04:16:53.338614 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:53.338585    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="06593306-50cd-48b1-9998-87a79c653b6a" containerName="maas-api"
Sep 08 04:16:53.338614 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:53.338607    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27" containerName="istio-proxy"
Sep 08 04:16:53.338743 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:53.338616    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27" containerName="istio-proxy"
Sep 08 04:16:53.338743 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:53.338649    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27" containerName="istio-proxy"
Sep 08 04:16:53.338743 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:53.338657    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27" containerName="istio-proxy"
Sep 08 04:16:53.338834 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:53.338763    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="dec747fc-2d76-440c-939d-59efa97b0206" containerName="istio-proxy"
Sep 08 04:16:53.338834 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:53.338773    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27" containerName="istio-proxy"
Sep 08 04:16:53.338834 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:53.338783    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="06593306-50cd-48b1-9998-87a79c653b6a" containerName="maas-api"
Sep 08 04:16:53.344455 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:53.343991    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59"
Sep 08 04:16:53.347073 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:53.346917    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-cb3759-serving-cert\""
Sep 08 04:16:53.350920 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:53.350898    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59"]
Sep 08 04:16:53.408029 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:53.407996    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wfjl\" (UniqueName: \"kubernetes.io/projected/7df721b7-55ba-46d9-aae1-3b8d62451674-kube-api-access-2wfjl\") pod \"maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59\" (UID: \"7df721b7-55ba-46d9-aae1-3b8d62451674\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59"
Sep 08 04:16:53.408164 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:53.408077    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7df721b7-55ba-46d9-aae1-3b8d62451674-metrics-certs\") pod \"maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59\" (UID: \"7df721b7-55ba-46d9-aae1-3b8d62451674\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59"
Sep 08 04:16:53.408164 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:53.408119    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7df721b7-55ba-46d9-aae1-3b8d62451674-maas-api-tls\") pod \"maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59\" (UID: \"7df721b7-55ba-46d9-aae1-3b8d62451674\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59"
Sep 08 04:16:53.408238 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:53.408178    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7df721b7-55ba-46d9-aae1-3b8d62451674-openshift-service-ca\") pod \"maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59\" (UID: \"7df721b7-55ba-46d9-aae1-3b8d62451674\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59"
Sep 08 04:16:53.509529 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:53.509495    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7df721b7-55ba-46d9-aae1-3b8d62451674-openshift-service-ca\") pod \"maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59\" (UID: \"7df721b7-55ba-46d9-aae1-3b8d62451674\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59"
Sep 08 04:16:53.509706 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:53.509613    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wfjl\" (UniqueName: \"kubernetes.io/projected/7df721b7-55ba-46d9-aae1-3b8d62451674-kube-api-access-2wfjl\") pod \"maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59\" (UID: \"7df721b7-55ba-46d9-aae1-3b8d62451674\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59"
Sep 08 04:16:53.509706 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:53.509677    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7df721b7-55ba-46d9-aae1-3b8d62451674-metrics-certs\") pod \"maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59\" (UID: \"7df721b7-55ba-46d9-aae1-3b8d62451674\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59"
Sep 08 04:16:53.509706 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:53.509696    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7df721b7-55ba-46d9-aae1-3b8d62451674-maas-api-tls\") pod \"maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59\" (UID: \"7df721b7-55ba-46d9-aae1-3b8d62451674\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59"
Sep 08 04:16:53.509812 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:16:53.509798    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-cb3759-serving-cert: secret "maas-api-e2e-explicit-cb3759-serving-cert" not found
Sep 08 04:16:53.509871 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:16:53.509861    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7df721b7-55ba-46d9-aae1-3b8d62451674-maas-api-tls podName:7df721b7-55ba-46d9-aae1-3b8d62451674 nodeName:}" failed. No retries permitted until 2026-09-08 04:16:54.009846208 +0000 UTC m=+973.795137422 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7df721b7-55ba-46d9-aae1-3b8d62451674-maas-api-tls") pod "maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59" (UID: "7df721b7-55ba-46d9-aae1-3b8d62451674") : secret "maas-api-e2e-explicit-cb3759-serving-cert" not found
Sep 08 04:16:53.510291 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:53.510270    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7df721b7-55ba-46d9-aae1-3b8d62451674-openshift-service-ca\") pod \"maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59\" (UID: \"7df721b7-55ba-46d9-aae1-3b8d62451674\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59"
Sep 08 04:16:53.512382 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:53.512361    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7df721b7-55ba-46d9-aae1-3b8d62451674-metrics-certs\") pod \"maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59\" (UID: \"7df721b7-55ba-46d9-aae1-3b8d62451674\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59"
Sep 08 04:16:53.518417 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:53.518391    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wfjl\" (UniqueName: \"kubernetes.io/projected/7df721b7-55ba-46d9-aae1-3b8d62451674-kube-api-access-2wfjl\") pod \"maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59\" (UID: \"7df721b7-55ba-46d9-aae1-3b8d62451674\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59"
Sep 08 04:16:54.015034 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:54.015000    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7df721b7-55ba-46d9-aae1-3b8d62451674-maas-api-tls\") pod \"maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59\" (UID: \"7df721b7-55ba-46d9-aae1-3b8d62451674\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59"
Sep 08 04:16:54.017508 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:54.017476    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7df721b7-55ba-46d9-aae1-3b8d62451674-maas-api-tls\") pod \"maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59\" (UID: \"7df721b7-55ba-46d9-aae1-3b8d62451674\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59"
Sep 08 04:16:54.258116 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:54.258075    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59"
Sep 08 04:16:54.539806 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:54.539773    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59"]
Sep 08 04:16:54.541120 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:16:54.541095    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7df721b7_55ba_46d9_aae1_3b8d62451674.slice/crio-c0aaccc759f6e7b30d5b23c1dbc2691f4fc05a8e41cc630d3d8b9a07049bf58b WatchSource:0}: Error finding container c0aaccc759f6e7b30d5b23c1dbc2691f4fc05a8e41cc630d3d8b9a07049bf58b: Status 404 returned error can't find the container with id c0aaccc759f6e7b30d5b23c1dbc2691f4fc05a8e41cc630d3d8b9a07049bf58b
Sep 08 04:16:54.543045 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:54.543024    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 04:16:54.979472 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:54.979441    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59" event={"ID":"7df721b7-55ba-46d9-aae1-3b8d62451674","Type":"ContainerStarted","Data":"c0aaccc759f6e7b30d5b23c1dbc2691f4fc05a8e41cc630d3d8b9a07049bf58b"}
Sep 08 04:16:55.987381 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:55.987331    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59" event={"ID":"7df721b7-55ba-46d9-aae1-3b8d62451674","Type":"ContainerStarted","Data":"e2bd3cc1cef6432fc5b1af89049c32f9bae152825c8a7af0effde7c412ab6fd4"}
Sep 08 04:16:55.988242 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:55.988216    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59"
Sep 08 04:16:56.008165 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:16:56.008116    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59" podStartSLOduration=2.622023305 podStartE2EDuration="3.008092483s" totalImagesPullingTime="386.069178ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:16:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:16:56.005863774 +0000 UTC m=+975.791155011" watchObservedRunningTime="2026-09-08 04:16:56.008092483 +0000 UTC m=+975.793383718"
Sep 08 04:17:03.006724 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:03.006649    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59"
Sep 08 04:17:56.695263 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:56.695226    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"]
Sep 08 04:17:56.695879 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:56.695759    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dec747fc-2d76-440c-939d-59efa97b0206" containerName="istio-proxy"
Sep 08 04:17:56.695879 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:56.695773    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="dec747fc-2d76-440c-939d-59efa97b0206" containerName="istio-proxy"
Sep 08 04:17:56.695879 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:56.695862    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="dec747fc-2d76-440c-939d-59efa97b0206" containerName="istio-proxy"
Sep 08 04:17:56.695879 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:56.695871    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0aa6bdd0-a827-40a1-bb3b-9bd2be0b7b27" containerName="istio-proxy"
Sep 08 04:17:56.699346 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:56.699326    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"
Sep 08 04:17:56.704236 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:56.704217    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-7c5e63de-openshift-default-dockercfg-8fkpx\""
Sep 08 04:17:56.715357 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:56.715333    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"]
Sep 08 04:17:56.736950 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:56.736925    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5c08a6b-dc4f-4956-a873-3595633aa6fb-istio-data\") pod \"e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g\" (UID: \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\") " pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"
Sep 08 04:17:56.737084 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:56.737014    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl8zm\" (UniqueName: \"kubernetes.io/projected/d5c08a6b-dc4f-4956-a873-3595633aa6fb-kube-api-access-gl8zm\") pod \"e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g\" (UID: \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\") " pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"
Sep 08 04:17:56.737084 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:56.737050    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5c08a6b-dc4f-4956-a873-3595633aa6fb-workload-certs\") pod \"e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g\" (UID: \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\") " pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"
Sep 08 04:17:56.737084 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:56.737077    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5c08a6b-dc4f-4956-a873-3595633aa6fb-istio-envoy\") pod \"e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g\" (UID: \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\") " pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"
Sep 08 04:17:56.737258 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:56.737142    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5c08a6b-dc4f-4956-a873-3595633aa6fb-istio-token\") pod \"e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g\" (UID: \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\") " pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"
Sep 08 04:17:56.737258 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:56.737212    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5c08a6b-dc4f-4956-a873-3595633aa6fb-istio-podinfo\") pod \"e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g\" (UID: \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\") " pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"
Sep 08 04:17:56.737258 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:56.737244    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5c08a6b-dc4f-4956-a873-3595633aa6fb-workload-socket\") pod \"e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g\" (UID: \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\") " pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"
Sep 08 04:17:56.737418 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:56.737286    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5c08a6b-dc4f-4956-a873-3595633aa6fb-istiod-ca-cert\") pod \"e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g\" (UID: \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\") " pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"
Sep 08 04:17:56.737418 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:56.737339    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5c08a6b-dc4f-4956-a873-3595633aa6fb-credential-socket\") pod \"e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g\" (UID: \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\") " pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"
Sep 08 04:17:56.837909 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:56.837872    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5c08a6b-dc4f-4956-a873-3595633aa6fb-istiod-ca-cert\") pod \"e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g\" (UID: \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\") " pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"
Sep 08 04:17:56.837909 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:56.837916    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5c08a6b-dc4f-4956-a873-3595633aa6fb-credential-socket\") pod \"e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g\" (UID: \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\") " pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"
Sep 08 04:17:56.838151 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:56.837952    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5c08a6b-dc4f-4956-a873-3595633aa6fb-istio-data\") pod \"e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g\" (UID: \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\") " pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"
Sep 08 04:17:56.838151 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:56.837998    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl8zm\" (UniqueName: \"kubernetes.io/projected/d5c08a6b-dc4f-4956-a873-3595633aa6fb-kube-api-access-gl8zm\") pod \"e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g\" (UID: \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\") " pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"
Sep 08 04:17:56.838151 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:56.838022    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5c08a6b-dc4f-4956-a873-3595633aa6fb-workload-certs\") pod \"e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g\" (UID: \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\") " pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"
Sep 08 04:17:56.838151 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:56.838044    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5c08a6b-dc4f-4956-a873-3595633aa6fb-istio-envoy\") pod \"e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g\" (UID: \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\") " pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"
Sep 08 04:17:56.838151 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:56.838075    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5c08a6b-dc4f-4956-a873-3595633aa6fb-istio-token\") pod \"e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g\" (UID: \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\") " pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"
Sep 08 04:17:56.838151 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:56.838134    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5c08a6b-dc4f-4956-a873-3595633aa6fb-istio-podinfo\") pod \"e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g\" (UID: \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\") " pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"
Sep 08 04:17:56.838475 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:56.838164    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5c08a6b-dc4f-4956-a873-3595633aa6fb-workload-socket\") pod \"e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g\" (UID: \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\") " pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"
Sep 08 04:17:56.838475 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:56.838376    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5c08a6b-dc4f-4956-a873-3595633aa6fb-credential-socket\") pod \"e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g\" (UID: \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\") " pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"
Sep 08 04:17:56.838475 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:56.838464    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5c08a6b-dc4f-4956-a873-3595633aa6fb-workload-certs\") pod \"e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g\" (UID: \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\") " pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"
Sep 08 04:17:56.838671 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:56.838529    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5c08a6b-dc4f-4956-a873-3595633aa6fb-istio-data\") pod \"e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g\" (UID: \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\") " pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"
Sep 08 04:17:56.838671 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:56.838659    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5c08a6b-dc4f-4956-a873-3595633aa6fb-istiod-ca-cert\") pod \"e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g\" (UID: \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\") " pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"
Sep 08 04:17:56.838789 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:56.838693    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5c08a6b-dc4f-4956-a873-3595633aa6fb-workload-socket\") pod \"e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g\" (UID: \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\") " pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"
Sep 08 04:17:56.840753 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:56.840729    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5c08a6b-dc4f-4956-a873-3595633aa6fb-istio-envoy\") pod \"e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g\" (UID: \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\") " pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"
Sep 08 04:17:56.840835 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:56.840817    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5c08a6b-dc4f-4956-a873-3595633aa6fb-istio-podinfo\") pod \"e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g\" (UID: \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\") " pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"
Sep 08 04:17:56.846122 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:56.846096    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl8zm\" (UniqueName: \"kubernetes.io/projected/d5c08a6b-dc4f-4956-a873-3595633aa6fb-kube-api-access-gl8zm\") pod \"e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g\" (UID: \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\") " pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"
Sep 08 04:17:56.846224 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:56.846199    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5c08a6b-dc4f-4956-a873-3595633aa6fb-istio-token\") pod \"e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g\" (UID: \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\") " pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"
Sep 08 04:17:57.010131 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:57.010097    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"
Sep 08 04:17:57.290793 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:57.290763    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"]
Sep 08 04:17:57.291876 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:17:57.291849    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5c08a6b_dc4f_4956_a873_3595633aa6fb.slice/crio-0138f34c456661619039eeadbc7f3d9999d43052b229fdaecff1b4f1d70e821a WatchSource:0}: Error finding container 0138f34c456661619039eeadbc7f3d9999d43052b229fdaecff1b4f1d70e821a: Status 404 returned error can't find the container with id 0138f34c456661619039eeadbc7f3d9999d43052b229fdaecff1b4f1d70e821a
Sep 08 04:17:57.294170 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:57.294134    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:17:57.294265 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:57.294202    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:17:57.294265 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:57.294238    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:17:57.343899 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:57.343871    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g" event={"ID":"d5c08a6b-dc4f-4956-a873-3595633aa6fb","Type":"ContainerStarted","Data":"0138f34c456661619039eeadbc7f3d9999d43052b229fdaecff1b4f1d70e821a"}
Sep 08 04:17:58.106061 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:58.106023    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59"]
Sep 08 04:17:58.106956 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:58.106918    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59" podUID="7df721b7-55ba-46d9-aae1-3b8d62451674" containerName="maas-api" containerID="cri-o://e2bd3cc1cef6432fc5b1af89049c32f9bae152825c8a7af0effde7c412ab6fd4" gracePeriod=30
Sep 08 04:17:58.352380 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:58.352326    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g" event={"ID":"d5c08a6b-dc4f-4956-a873-3595633aa6fb","Type":"ContainerStarted","Data":"0dbf1c918d351079126af3612c31bb55f2990e0332b70143738318071b92cf58"}
Sep 08 04:17:58.354359 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:58.354332    2573 generic.go:356] "Generic (PLEG): container finished" podID="7df721b7-55ba-46d9-aae1-3b8d62451674" containerID="e2bd3cc1cef6432fc5b1af89049c32f9bae152825c8a7af0effde7c412ab6fd4" exitCode=0
Sep 08 04:17:58.354614 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:58.354366    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59" event={"ID":"7df721b7-55ba-46d9-aae1-3b8d62451674","Type":"ContainerDied","Data":"e2bd3cc1cef6432fc5b1af89049c32f9bae152825c8a7af0effde7c412ab6fd4"}
Sep 08 04:17:58.378399 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:58.378372    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59"
Sep 08 04:17:58.394581 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:58.393518    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g" podStartSLOduration=2.393497814 podStartE2EDuration="2.393497814s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:17:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:17:58.390336942 +0000 UTC m=+1038.175628179" watchObservedRunningTime="2026-09-08 04:17:58.393497814 +0000 UTC m=+1038.178789041"
Sep 08 04:17:58.454921 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:58.454892    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7df721b7-55ba-46d9-aae1-3b8d62451674-openshift-service-ca\") pod \"7df721b7-55ba-46d9-aae1-3b8d62451674\" (UID: \"7df721b7-55ba-46d9-aae1-3b8d62451674\") "
Sep 08 04:17:58.454921 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:58.454927    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7df721b7-55ba-46d9-aae1-3b8d62451674-maas-api-tls\") pod \"7df721b7-55ba-46d9-aae1-3b8d62451674\" (UID: \"7df721b7-55ba-46d9-aae1-3b8d62451674\") "
Sep 08 04:17:58.455171 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:58.454967    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7df721b7-55ba-46d9-aae1-3b8d62451674-metrics-certs\") pod \"7df721b7-55ba-46d9-aae1-3b8d62451674\" (UID: \"7df721b7-55ba-46d9-aae1-3b8d62451674\") "
Sep 08 04:17:58.455171 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:58.455079    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wfjl\" (UniqueName: \"kubernetes.io/projected/7df721b7-55ba-46d9-aae1-3b8d62451674-kube-api-access-2wfjl\") pod \"7df721b7-55ba-46d9-aae1-3b8d62451674\" (UID: \"7df721b7-55ba-46d9-aae1-3b8d62451674\") "
Sep 08 04:17:58.455321 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:58.455294    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7df721b7-55ba-46d9-aae1-3b8d62451674-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7df721b7-55ba-46d9-aae1-3b8d62451674" (UID: "7df721b7-55ba-46d9-aae1-3b8d62451674"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 04:17:58.455505 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:58.455482    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7df721b7-55ba-46d9-aae1-3b8d62451674-openshift-service-ca\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:17:58.457271 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:58.457244    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7df721b7-55ba-46d9-aae1-3b8d62451674-kube-api-access-2wfjl" (OuterVolumeSpecName: "kube-api-access-2wfjl") pod "7df721b7-55ba-46d9-aae1-3b8d62451674" (UID: "7df721b7-55ba-46d9-aae1-3b8d62451674"). InnerVolumeSpecName "kube-api-access-2wfjl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:17:58.457583 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:58.457543    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7df721b7-55ba-46d9-aae1-3b8d62451674-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7df721b7-55ba-46d9-aae1-3b8d62451674" (UID: "7df721b7-55ba-46d9-aae1-3b8d62451674"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:17:58.457658 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:58.457636    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7df721b7-55ba-46d9-aae1-3b8d62451674-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7df721b7-55ba-46d9-aae1-3b8d62451674" (UID: "7df721b7-55ba-46d9-aae1-3b8d62451674"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:17:58.557160 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:58.557124    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7df721b7-55ba-46d9-aae1-3b8d62451674-maas-api-tls\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:17:58.557160 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:58.557162    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7df721b7-55ba-46d9-aae1-3b8d62451674-metrics-certs\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:17:58.557409 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:58.557177    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wfjl\" (UniqueName: \"kubernetes.io/projected/7df721b7-55ba-46d9-aae1-3b8d62451674-kube-api-access-2wfjl\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:17:59.010986 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:59.010958    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"
Sep 08 04:17:59.015954 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:59.015929    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"
Sep 08 04:17:59.361595 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:59.361500    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59"
Sep 08 04:17:59.361595 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:59.361495    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59" event={"ID":"7df721b7-55ba-46d9-aae1-3b8d62451674","Type":"ContainerDied","Data":"c0aaccc759f6e7b30d5b23c1dbc2691f4fc05a8e41cc630d3d8b9a07049bf58b"}
Sep 08 04:17:59.362097 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:59.361629    2573 scope.go:117] "RemoveContainer" containerID="e2bd3cc1cef6432fc5b1af89049c32f9bae152825c8a7af0effde7c412ab6fd4"
Sep 08 04:17:59.362167 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:59.362126    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"
Sep 08 04:17:59.363344 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:59.363321    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"
Sep 08 04:17:59.388847 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:59.388811    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59"]
Sep 08 04:17:59.394166 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:17:59.394143    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-cb3759-6468bd8f6d-78k59"]
Sep 08 04:18:00.675624 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:00.675588    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7df721b7-55ba-46d9-aae1-3b8d62451674" path="/var/lib/kubelet/pods/7df721b7-55ba-46d9-aae1-3b8d62451674/volumes"
Sep 08 04:18:01.561349 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:01.561320    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb"]
Sep 08 04:18:01.561893 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:01.561875    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7df721b7-55ba-46d9-aae1-3b8d62451674" containerName="maas-api"
Sep 08 04:18:01.561893 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:01.561892    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7df721b7-55ba-46d9-aae1-3b8d62451674" containerName="maas-api"
Sep 08 04:18:01.562062 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:01.561998    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="7df721b7-55ba-46d9-aae1-3b8d62451674" containerName="maas-api"
Sep 08 04:18:01.566882 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:01.566859    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb"
Sep 08 04:18:01.569289 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:01.569269    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-7c5e63de-serving-cert\""
Sep 08 04:18:01.577119 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:01.577096    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb"]
Sep 08 04:18:01.689030 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:01.688996    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dstmg\" (UniqueName: \"kubernetes.io/projected/5b20cdd7-d400-40d7-a357-30aa97ec6113-kube-api-access-dstmg\") pod \"maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb\" (UID: \"5b20cdd7-d400-40d7-a357-30aa97ec6113\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb"
Sep 08 04:18:01.689500 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:01.689100    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b20cdd7-d400-40d7-a357-30aa97ec6113-maas-api-tls\") pod \"maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb\" (UID: \"5b20cdd7-d400-40d7-a357-30aa97ec6113\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb"
Sep 08 04:18:01.689500 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:01.689187    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b20cdd7-d400-40d7-a357-30aa97ec6113-metrics-certs\") pod \"maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb\" (UID: \"5b20cdd7-d400-40d7-a357-30aa97ec6113\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb"
Sep 08 04:18:01.689500 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:01.689253    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b20cdd7-d400-40d7-a357-30aa97ec6113-openshift-service-ca\") pod \"maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb\" (UID: \"5b20cdd7-d400-40d7-a357-30aa97ec6113\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb"
Sep 08 04:18:01.790176 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:01.790142    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b20cdd7-d400-40d7-a357-30aa97ec6113-maas-api-tls\") pod \"maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb\" (UID: \"5b20cdd7-d400-40d7-a357-30aa97ec6113\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb"
Sep 08 04:18:01.790357 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:01.790253    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b20cdd7-d400-40d7-a357-30aa97ec6113-metrics-certs\") pod \"maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb\" (UID: \"5b20cdd7-d400-40d7-a357-30aa97ec6113\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb"
Sep 08 04:18:01.790357 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:18:01.790296    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-7c5e63de-serving-cert: secret "maas-api-e2e-mt-7c5e63de-serving-cert" not found
Sep 08 04:18:01.790357 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:01.790324    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b20cdd7-d400-40d7-a357-30aa97ec6113-openshift-service-ca\") pod \"maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb\" (UID: \"5b20cdd7-d400-40d7-a357-30aa97ec6113\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb"
Sep 08 04:18:01.790357 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:18:01.790353    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b20cdd7-d400-40d7-a357-30aa97ec6113-maas-api-tls podName:5b20cdd7-d400-40d7-a357-30aa97ec6113 nodeName:}" failed. No retries permitted until 2026-09-08 04:18:02.29033803 +0000 UTC m=+1042.075629244 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5b20cdd7-d400-40d7-a357-30aa97ec6113-maas-api-tls") pod "maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb" (UID: "5b20cdd7-d400-40d7-a357-30aa97ec6113") : secret "maas-api-e2e-mt-7c5e63de-serving-cert" not found
Sep 08 04:18:01.790632 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:01.790405    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dstmg\" (UniqueName: \"kubernetes.io/projected/5b20cdd7-d400-40d7-a357-30aa97ec6113-kube-api-access-dstmg\") pod \"maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb\" (UID: \"5b20cdd7-d400-40d7-a357-30aa97ec6113\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb"
Sep 08 04:18:01.791183 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:01.791160    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b20cdd7-d400-40d7-a357-30aa97ec6113-openshift-service-ca\") pod \"maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb\" (UID: \"5b20cdd7-d400-40d7-a357-30aa97ec6113\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb"
Sep 08 04:18:01.792954 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:01.792933    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b20cdd7-d400-40d7-a357-30aa97ec6113-metrics-certs\") pod \"maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb\" (UID: \"5b20cdd7-d400-40d7-a357-30aa97ec6113\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb"
Sep 08 04:18:01.809015 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:01.808986    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dstmg\" (UniqueName: \"kubernetes.io/projected/5b20cdd7-d400-40d7-a357-30aa97ec6113-kube-api-access-dstmg\") pod \"maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb\" (UID: \"5b20cdd7-d400-40d7-a357-30aa97ec6113\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb"
Sep 08 04:18:02.296198 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:02.296164    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b20cdd7-d400-40d7-a357-30aa97ec6113-maas-api-tls\") pod \"maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb\" (UID: \"5b20cdd7-d400-40d7-a357-30aa97ec6113\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb"
Sep 08 04:18:02.298784 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:02.298749    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b20cdd7-d400-40d7-a357-30aa97ec6113-maas-api-tls\") pod \"maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb\" (UID: \"5b20cdd7-d400-40d7-a357-30aa97ec6113\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb"
Sep 08 04:18:02.479915 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:02.479878    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb"
Sep 08 04:18:02.759970 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:02.759947    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb"]
Sep 08 04:18:02.762233 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:18:02.762196    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b20cdd7_d400_40d7_a357_30aa97ec6113.slice/crio-68f876115239dc0d7449e4c6ff4e229004cf6057a41e04ac385b0f82093fbf7c WatchSource:0}: Error finding container 68f876115239dc0d7449e4c6ff4e229004cf6057a41e04ac385b0f82093fbf7c: Status 404 returned error can't find the container with id 68f876115239dc0d7449e4c6ff4e229004cf6057a41e04ac385b0f82093fbf7c
Sep 08 04:18:03.386830 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:03.386797    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb" event={"ID":"5b20cdd7-d400-40d7-a357-30aa97ec6113","Type":"ContainerStarted","Data":"e837b3738a80a2da12c8d82419296ef7666706bdc6ee0d09565d291f3cd32294"}
Sep 08 04:18:03.387022 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:03.386859    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb" event={"ID":"5b20cdd7-d400-40d7-a357-30aa97ec6113","Type":"ContainerStarted","Data":"68f876115239dc0d7449e4c6ff4e229004cf6057a41e04ac385b0f82093fbf7c"}
Sep 08 04:18:03.387022 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:03.386964    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb"
Sep 08 04:18:03.403357 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:03.403306    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb" podStartSLOduration=1.959090914 podStartE2EDuration="2.403291852s" totalImagesPullingTime="444.200938ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:18:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:18:03.402112502 +0000 UTC m=+1043.187403740" watchObservedRunningTime="2026-09-08 04:18:03.403291852 +0000 UTC m=+1043.188583129"
Sep 08 04:18:05.912824 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:05.912795    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp"]
Sep 08 04:18:05.916693 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:05.916668    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp"
Sep 08 04:18:05.920977 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:05.920955    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-cbda8a-openshift-default-dockercfg-mkttb\""
Sep 08 04:18:05.934332 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:05.934309    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp"]
Sep 08 04:18:06.035048 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:06.035007    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-istio-data\") pod \"e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp\" (UID: \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\") " pod="openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp"
Sep 08 04:18:06.035226 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:06.035092    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-istio-envoy\") pod \"e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp\" (UID: \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\") " pod="openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp"
Sep 08 04:18:06.035226 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:06.035147    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-workload-certs\") pod \"e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp\" (UID: \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\") " pod="openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp"
Sep 08 04:18:06.035326 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:06.035218    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-credential-socket\") pod \"e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp\" (UID: \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\") " pod="openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp"
Sep 08 04:18:06.035326 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:06.035257    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-istio-podinfo\") pod \"e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp\" (UID: \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\") " pod="openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp"
Sep 08 04:18:06.035326 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:06.035282    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-workload-socket\") pod \"e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp\" (UID: \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\") " pod="openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp"
Sep 08 04:18:06.035427 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:06.035342    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-istiod-ca-cert\") pod \"e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp\" (UID: \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\") " pod="openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp"
Sep 08 04:18:06.035427 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:06.035386    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-istio-token\") pod \"e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp\" (UID: \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\") " pod="openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp"
Sep 08 04:18:06.035495 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:06.035464    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6s45\" (UniqueName: \"kubernetes.io/projected/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-kube-api-access-g6s45\") pod \"e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp\" (UID: \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\") " pod="openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp"
Sep 08 04:18:06.136575 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:06.136532    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-istiod-ca-cert\") pod \"e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp\" (UID: \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\") " pod="openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp"
Sep 08 04:18:06.136754 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:06.136601    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-istio-token\") pod \"e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp\" (UID: \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\") " pod="openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp"
Sep 08 04:18:06.136754 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:06.136634    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6s45\" (UniqueName: \"kubernetes.io/projected/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-kube-api-access-g6s45\") pod \"e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp\" (UID: \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\") " pod="openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp"
Sep 08 04:18:06.136754 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:06.136658    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-istio-data\") pod \"e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp\" (UID: \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\") " pod="openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp"
Sep 08 04:18:06.136754 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:06.136712    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-istio-envoy\") pod \"e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp\" (UID: \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\") " pod="openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp"
Sep 08 04:18:06.136921 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:06.136763    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-workload-certs\") pod \"e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp\" (UID: \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\") " pod="openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp"
Sep 08 04:18:06.136921 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:06.136815    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-credential-socket\") pod \"e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp\" (UID: \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\") " pod="openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp"
Sep 08 04:18:06.136921 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:06.136839    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-istio-podinfo\") pod \"e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp\" (UID: \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\") " pod="openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp"
Sep 08 04:18:06.136921 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:06.136871    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-workload-socket\") pod \"e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp\" (UID: \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\") " pod="openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp"
Sep 08 04:18:06.137092 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:06.137042    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-istio-data\") pod \"e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp\" (UID: \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\") " pod="openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp"
Sep 08 04:18:06.137286 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:06.137267    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-istiod-ca-cert\") pod \"e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp\" (UID: \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\") " pod="openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp"
Sep 08 04:18:06.137377 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:06.137284    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-workload-certs\") pod \"e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp\" (UID: \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\") " pod="openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp"
Sep 08 04:18:06.137377 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:06.137349    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-credential-socket\") pod \"e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp\" (UID: \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\") " pod="openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp"
Sep 08 04:18:06.137449 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:06.137405    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-workload-socket\") pod \"e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp\" (UID: \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\") " pod="openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp"
Sep 08 04:18:06.139385 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:06.139366    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-istio-envoy\") pod \"e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp\" (UID: \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\") " pod="openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp"
Sep 08 04:18:06.139629 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:06.139608    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-istio-podinfo\") pod \"e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp\" (UID: \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\") " pod="openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp"
Sep 08 04:18:06.145802 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:06.145774    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6s45\" (UniqueName: \"kubernetes.io/projected/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-kube-api-access-g6s45\") pod \"e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp\" (UID: \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\") " pod="openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp"
Sep 08 04:18:06.145994 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:06.145972    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-istio-token\") pod \"e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp\" (UID: \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\") " pod="openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp"
Sep 08 04:18:06.227295 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:06.227207    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp"
Sep 08 04:18:06.513082 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:06.513053    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp"]
Sep 08 04:18:06.514131 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:18:06.514105    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4122710_0fc7_41ce_b2c3_e2600aa76f2e.slice/crio-cd86f9da00f65de30865e61b0e8a49fb6fbfeae0c4ecf1c7198b80cd9dcf38e8 WatchSource:0}: Error finding container cd86f9da00f65de30865e61b0e8a49fb6fbfeae0c4ecf1c7198b80cd9dcf38e8: Status 404 returned error can't find the container with id cd86f9da00f65de30865e61b0e8a49fb6fbfeae0c4ecf1c7198b80cd9dcf38e8
Sep 08 04:18:06.516684 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:06.516644    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:18:06.516757 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:06.516730    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:18:06.516795 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:06.516769    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:18:07.418973 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:07.418936    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp" event={"ID":"d4122710-0fc7-41ce-b2c3-e2600aa76f2e","Type":"ContainerStarted","Data":"f0f7cb3a02b8c2501fa45e6680c14bc4d10c9955c49f79e114bb7edc519d26b6"}
Sep 08 04:18:07.419534 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:07.419499    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp" event={"ID":"d4122710-0fc7-41ce-b2c3-e2600aa76f2e","Type":"ContainerStarted","Data":"cd86f9da00f65de30865e61b0e8a49fb6fbfeae0c4ecf1c7198b80cd9dcf38e8"}
Sep 08 04:18:07.444973 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:07.444925    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp" podStartSLOduration=2.444909104 podStartE2EDuration="2.444909104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:18:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:18:07.443848221 +0000 UTC m=+1047.229139458" watchObservedRunningTime="2026-09-08 04:18:07.444909104 +0000 UTC m=+1047.230200340"
Sep 08 04:18:08.228124 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:08.228093    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp"
Sep 08 04:18:08.233303 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:08.233275    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp"
Sep 08 04:18:08.424877 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:08.424836    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp"
Sep 08 04:18:08.425931 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:08.425911    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp"
Sep 08 04:18:09.398987 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:09.398959    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb"
Sep 08 04:18:23.523737 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:23.523703    2573 generic.go:356] "Generic (PLEG): container finished" podID="d5c08a6b-dc4f-4956-a873-3595633aa6fb" containerID="0dbf1c918d351079126af3612c31bb55f2990e0332b70143738318071b92cf58" exitCode=0
Sep 08 04:18:23.524133 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:23.523776    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g" event={"ID":"d5c08a6b-dc4f-4956-a873-3595633aa6fb","Type":"ContainerDied","Data":"0dbf1c918d351079126af3612c31bb55f2990e0332b70143738318071b92cf58"}
Sep 08 04:18:23.524212 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:23.524198    2573 scope.go:117] "RemoveContainer" containerID="0dbf1c918d351079126af3612c31bb55f2990e0332b70143738318071b92cf58"
Sep 08 04:18:23.525271 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:23.525246    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:18:23.525329 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:23.525312    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:18:23.525365 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:23.525346    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:18:24.532313 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:24.532281    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g" event={"ID":"d5c08a6b-dc4f-4956-a873-3595633aa6fb","Type":"ContainerStarted","Data":"d5a724cfe51dad57a2e766b12c15f89698c052f602682621372610322c225341"}
Sep 08 04:18:25.011500 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:25.011458    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"
Sep 08 04:18:25.011705 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:25.011644    2573 patch_prober.go:28] interesting pod/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 08 04:18:25.011705 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:25.011689    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g" podUID="d5c08a6b-dc4f-4956-a873-3595633aa6fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 08 04:18:25.253099 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:25.252918    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp"]
Sep 08 04:18:25.253256 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:25.253156    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp" podUID="d4122710-0fc7-41ce-b2c3-e2600aa76f2e" containerName="istio-proxy" containerID="cri-o://f0f7cb3a02b8c2501fa45e6680c14bc4d10c9955c49f79e114bb7edc519d26b6" gracePeriod=30
Sep 08 04:18:26.010793 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:26.010753    2573 patch_prober.go:28] interesting pod/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 08 04:18:26.011377 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:26.011345    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g" podUID="d5c08a6b-dc4f-4956-a873-3595633aa6fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 08 04:18:27.011164 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:27.011128    2573 patch_prober.go:28] interesting pod/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 08 04:18:27.011812 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:27.011782    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g" podUID="d5c08a6b-dc4f-4956-a873-3595633aa6fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 08 04:18:28.010955 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:28.010910    2573 patch_prober.go:28] interesting pod/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 08 04:18:28.011168 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:28.010977    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g" podUID="d5c08a6b-dc4f-4956-a873-3595633aa6fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 08 04:18:29.010542 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:29.010493    2573 patch_prober.go:28] interesting pod/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 08 04:18:29.011049 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:29.010591    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g" podUID="d5c08a6b-dc4f-4956-a873-3595633aa6fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 08 04:18:29.363090 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:29.362995    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"
Sep 08 04:18:30.014888 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:30.014853    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"
Sep 08 04:18:30.015815 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:30.015797    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"
Sep 08 04:18:30.515272 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:30.515246    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp"
Sep 08 04:18:30.572028 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:30.571930    2573 generic.go:356] "Generic (PLEG): container finished" podID="d4122710-0fc7-41ce-b2c3-e2600aa76f2e" containerID="f0f7cb3a02b8c2501fa45e6680c14bc4d10c9955c49f79e114bb7edc519d26b6" exitCode=0
Sep 08 04:18:30.572247 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:30.572142    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp"
Sep 08 04:18:30.572247 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:30.572221    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp" event={"ID":"d4122710-0fc7-41ce-b2c3-e2600aa76f2e","Type":"ContainerDied","Data":"f0f7cb3a02b8c2501fa45e6680c14bc4d10c9955c49f79e114bb7edc519d26b6"}
Sep 08 04:18:30.572443 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:30.572289    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp" event={"ID":"d4122710-0fc7-41ce-b2c3-e2600aa76f2e","Type":"ContainerDied","Data":"cd86f9da00f65de30865e61b0e8a49fb6fbfeae0c4ecf1c7198b80cd9dcf38e8"}
Sep 08 04:18:30.572443 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:30.572346    2573 scope.go:117] "RemoveContainer" containerID="f0f7cb3a02b8c2501fa45e6680c14bc4d10c9955c49f79e114bb7edc519d26b6"
Sep 08 04:18:30.585763 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:30.585625    2573 scope.go:117] "RemoveContainer" containerID="f0f7cb3a02b8c2501fa45e6680c14bc4d10c9955c49f79e114bb7edc519d26b6"
Sep 08 04:18:30.586076 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:18:30.586043    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0f7cb3a02b8c2501fa45e6680c14bc4d10c9955c49f79e114bb7edc519d26b6\": container with ID starting with f0f7cb3a02b8c2501fa45e6680c14bc4d10c9955c49f79e114bb7edc519d26b6 not found: ID does not exist" containerID="f0f7cb3a02b8c2501fa45e6680c14bc4d10c9955c49f79e114bb7edc519d26b6"
Sep 08 04:18:30.586189 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:30.586089    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0f7cb3a02b8c2501fa45e6680c14bc4d10c9955c49f79e114bb7edc519d26b6"} err="failed to get container status \"f0f7cb3a02b8c2501fa45e6680c14bc4d10c9955c49f79e114bb7edc519d26b6\": rpc error: code = NotFound desc = could not find container \"f0f7cb3a02b8c2501fa45e6680c14bc4d10c9955c49f79e114bb7edc519d26b6\": container with ID starting with f0f7cb3a02b8c2501fa45e6680c14bc4d10c9955c49f79e114bb7edc519d26b6 not found: ID does not exist"
Sep 08 04:18:30.608474 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:30.608445    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-istio-data\") pod \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\" (UID: \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\") "
Sep 08 04:18:30.608669 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:30.608514    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-istio-envoy\") pod \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\" (UID: \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\") "
Sep 08 04:18:30.608669 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:30.608549    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-istiod-ca-cert\") pod \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\" (UID: \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\") "
Sep 08 04:18:30.608669 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:30.608613    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-istio-token\") pod \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\" (UID: \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\") "
Sep 08 04:18:30.608860 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:30.608673    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-workload-socket\") pod \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\" (UID: \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\") "
Sep 08 04:18:30.608860 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:30.608704    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6s45\" (UniqueName: \"kubernetes.io/projected/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-kube-api-access-g6s45\") pod \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\" (UID: \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\") "
Sep 08 04:18:30.608860 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:30.608737    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-credential-socket\") pod \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\" (UID: \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\") "
Sep 08 04:18:30.608860 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:30.608762    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-istio-podinfo\") pod \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\" (UID: \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\") "
Sep 08 04:18:30.608860 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:30.608777    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-istio-data" (OuterVolumeSpecName: "istio-data") pod "d4122710-0fc7-41ce-b2c3-e2600aa76f2e" (UID: "d4122710-0fc7-41ce-b2c3-e2600aa76f2e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:18:30.608860 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:30.608813    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-workload-certs\") pod \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\" (UID: \"d4122710-0fc7-41ce-b2c3-e2600aa76f2e\") "
Sep 08 04:18:30.609282 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:30.609258    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d4122710-0fc7-41ce-b2c3-e2600aa76f2e" (UID: "d4122710-0fc7-41ce-b2c3-e2600aa76f2e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:18:30.610153 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:30.609618    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d4122710-0fc7-41ce-b2c3-e2600aa76f2e" (UID: "d4122710-0fc7-41ce-b2c3-e2600aa76f2e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:18:30.610153 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:30.609694    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d4122710-0fc7-41ce-b2c3-e2600aa76f2e" (UID: "d4122710-0fc7-41ce-b2c3-e2600aa76f2e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:18:30.610153 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:30.609901    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-istio-data\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:18:30.610153 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:30.610061    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d4122710-0fc7-41ce-b2c3-e2600aa76f2e" (UID: "d4122710-0fc7-41ce-b2c3-e2600aa76f2e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 04:18:30.611287 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:30.611225    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d4122710-0fc7-41ce-b2c3-e2600aa76f2e" (UID: "d4122710-0fc7-41ce-b2c3-e2600aa76f2e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:18:30.611502 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:30.611471    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d4122710-0fc7-41ce-b2c3-e2600aa76f2e" (UID: "d4122710-0fc7-41ce-b2c3-e2600aa76f2e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 04:18:30.612318 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:30.612236    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-istio-token" (OuterVolumeSpecName: "istio-token") pod "d4122710-0fc7-41ce-b2c3-e2600aa76f2e" (UID: "d4122710-0fc7-41ce-b2c3-e2600aa76f2e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:18:30.612416 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:30.612325    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-kube-api-access-g6s45" (OuterVolumeSpecName: "kube-api-access-g6s45") pod "d4122710-0fc7-41ce-b2c3-e2600aa76f2e" (UID: "d4122710-0fc7-41ce-b2c3-e2600aa76f2e"). InnerVolumeSpecName "kube-api-access-g6s45". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:18:30.711411 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:30.711375    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-istio-envoy\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:18:30.711411 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:30.711399    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-istiod-ca-cert\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:18:30.711411 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:30.711408    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-istio-token\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:18:30.711411 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:30.711415    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-workload-socket\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:18:30.711715 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:30.711424    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6s45\" (UniqueName: \"kubernetes.io/projected/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-kube-api-access-g6s45\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:18:30.711715 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:30.711434    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-credential-socket\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:18:30.711715 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:30.711441    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-istio-podinfo\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:18:30.711715 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:30.711449    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4122710-0fc7-41ce-b2c3-e2600aa76f2e-workload-certs\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:18:30.895132 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:30.895050    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp"]
Sep 08 04:18:30.898682 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:30.898656    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp"]
Sep 08 04:18:32.676015 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:32.675941    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4122710-0fc7-41ce-b2c3-e2600aa76f2e" path="/var/lib/kubelet/pods/d4122710-0fc7-41ce-b2c3-e2600aa76f2e/volumes"
Sep 08 04:18:45.546270 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:45.546233    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb"]
Sep 08 04:18:45.546703 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:45.546512    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb" podUID="5b20cdd7-d400-40d7-a357-30aa97ec6113" containerName="maas-api" containerID="cri-o://e837b3738a80a2da12c8d82419296ef7666706bdc6ee0d09565d291f3cd32294" gracePeriod=30
Sep 08 04:18:45.665775 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:45.665743    2573 generic.go:356] "Generic (PLEG): container finished" podID="5b20cdd7-d400-40d7-a357-30aa97ec6113" containerID="e837b3738a80a2da12c8d82419296ef7666706bdc6ee0d09565d291f3cd32294" exitCode=0
Sep 08 04:18:45.665913 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:45.665818    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb" event={"ID":"5b20cdd7-d400-40d7-a357-30aa97ec6113","Type":"ContainerDied","Data":"e837b3738a80a2da12c8d82419296ef7666706bdc6ee0d09565d291f3cd32294"}
Sep 08 04:18:45.802423 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:45.802367    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb"
Sep 08 04:18:45.869278 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:45.869240    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dstmg\" (UniqueName: \"kubernetes.io/projected/5b20cdd7-d400-40d7-a357-30aa97ec6113-kube-api-access-dstmg\") pod \"5b20cdd7-d400-40d7-a357-30aa97ec6113\" (UID: \"5b20cdd7-d400-40d7-a357-30aa97ec6113\") "
Sep 08 04:18:45.869593 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:45.869287    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b20cdd7-d400-40d7-a357-30aa97ec6113-maas-api-tls\") pod \"5b20cdd7-d400-40d7-a357-30aa97ec6113\" (UID: \"5b20cdd7-d400-40d7-a357-30aa97ec6113\") "
Sep 08 04:18:45.869593 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:45.869404    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b20cdd7-d400-40d7-a357-30aa97ec6113-openshift-service-ca\") pod \"5b20cdd7-d400-40d7-a357-30aa97ec6113\" (UID: \"5b20cdd7-d400-40d7-a357-30aa97ec6113\") "
Sep 08 04:18:45.869593 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:45.869474    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b20cdd7-d400-40d7-a357-30aa97ec6113-metrics-certs\") pod \"5b20cdd7-d400-40d7-a357-30aa97ec6113\" (UID: \"5b20cdd7-d400-40d7-a357-30aa97ec6113\") "
Sep 08 04:18:45.870278 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:45.870250    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b20cdd7-d400-40d7-a357-30aa97ec6113-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5b20cdd7-d400-40d7-a357-30aa97ec6113" (UID: "5b20cdd7-d400-40d7-a357-30aa97ec6113"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 04:18:45.871790 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:45.871764    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b20cdd7-d400-40d7-a357-30aa97ec6113-kube-api-access-dstmg" (OuterVolumeSpecName: "kube-api-access-dstmg") pod "5b20cdd7-d400-40d7-a357-30aa97ec6113" (UID: "5b20cdd7-d400-40d7-a357-30aa97ec6113"). InnerVolumeSpecName "kube-api-access-dstmg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:18:45.872407 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:45.872374    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b20cdd7-d400-40d7-a357-30aa97ec6113-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5b20cdd7-d400-40d7-a357-30aa97ec6113" (UID: "5b20cdd7-d400-40d7-a357-30aa97ec6113"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:18:45.872407 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:45.872393    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b20cdd7-d400-40d7-a357-30aa97ec6113-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5b20cdd7-d400-40d7-a357-30aa97ec6113" (UID: "5b20cdd7-d400-40d7-a357-30aa97ec6113"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:18:45.971191 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:45.971156    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b20cdd7-d400-40d7-a357-30aa97ec6113-metrics-certs\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:18:45.971339 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:45.971206    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dstmg\" (UniqueName: \"kubernetes.io/projected/5b20cdd7-d400-40d7-a357-30aa97ec6113-kube-api-access-dstmg\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:18:45.971339 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:45.971218    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b20cdd7-d400-40d7-a357-30aa97ec6113-maas-api-tls\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:18:45.971339 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:45.971226    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b20cdd7-d400-40d7-a357-30aa97ec6113-openshift-service-ca\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:18:46.672381 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:46.672346    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb"
Sep 08 04:18:46.676050 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:46.676017    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb" event={"ID":"5b20cdd7-d400-40d7-a357-30aa97ec6113","Type":"ContainerDied","Data":"68f876115239dc0d7449e4c6ff4e229004cf6057a41e04ac385b0f82093fbf7c"}
Sep 08 04:18:46.676244 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:46.676074    2573 scope.go:117] "RemoveContainer" containerID="e837b3738a80a2da12c8d82419296ef7666706bdc6ee0d09565d291f3cd32294"
Sep 08 04:18:46.729474 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:46.729449    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb"]
Sep 08 04:18:46.745959 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:46.745930    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7c5e63de-5d88ff8cd6-gzdqb"]
Sep 08 04:18:48.675796 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:48.675766    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b20cdd7-d400-40d7-a357-30aa97ec6113" path="/var/lib/kubelet/pods/5b20cdd7-d400-40d7-a357-30aa97ec6113/volumes"
Sep 08 04:18:50.461527 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:50.461494    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx"]
Sep 08 04:18:50.461887 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:50.461719    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx" podUID="c26b6a29-57eb-40b5-81e7-acba8e12a666" containerName="maas-api" containerID="cri-o://9ce79f9d04de1dce50d05d771bbbe62e344d6a735d1b19617870b895aca642e8" gracePeriod=30
Sep 08 04:18:50.699711 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:50.699676    2573 generic.go:356] "Generic (PLEG): container finished" podID="c26b6a29-57eb-40b5-81e7-acba8e12a666" containerID="9ce79f9d04de1dce50d05d771bbbe62e344d6a735d1b19617870b895aca642e8" exitCode=0
Sep 08 04:18:50.699861 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:50.699760    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx" event={"ID":"c26b6a29-57eb-40b5-81e7-acba8e12a666","Type":"ContainerDied","Data":"9ce79f9d04de1dce50d05d771bbbe62e344d6a735d1b19617870b895aca642e8"}
Sep 08 04:18:50.735272 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:50.735251    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx"
Sep 08 04:18:50.822745 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:50.822711    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c26b6a29-57eb-40b5-81e7-acba8e12a666-metrics-certs\") pod \"c26b6a29-57eb-40b5-81e7-acba8e12a666\" (UID: \"c26b6a29-57eb-40b5-81e7-acba8e12a666\") "
Sep 08 04:18:50.822921 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:50.822752    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c26b6a29-57eb-40b5-81e7-acba8e12a666-maas-api-tls\") pod \"c26b6a29-57eb-40b5-81e7-acba8e12a666\" (UID: \"c26b6a29-57eb-40b5-81e7-acba8e12a666\") "
Sep 08 04:18:50.822921 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:50.822841    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s79v5\" (UniqueName: \"kubernetes.io/projected/c26b6a29-57eb-40b5-81e7-acba8e12a666-kube-api-access-s79v5\") pod \"c26b6a29-57eb-40b5-81e7-acba8e12a666\" (UID: \"c26b6a29-57eb-40b5-81e7-acba8e12a666\") "
Sep 08 04:18:50.822921 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:50.822900    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c26b6a29-57eb-40b5-81e7-acba8e12a666-openshift-service-ca\") pod \"c26b6a29-57eb-40b5-81e7-acba8e12a666\" (UID: \"c26b6a29-57eb-40b5-81e7-acba8e12a666\") "
Sep 08 04:18:50.823367 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:50.823327    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c26b6a29-57eb-40b5-81e7-acba8e12a666-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c26b6a29-57eb-40b5-81e7-acba8e12a666" (UID: "c26b6a29-57eb-40b5-81e7-acba8e12a666"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 04:18:50.825071 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:50.825040    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c26b6a29-57eb-40b5-81e7-acba8e12a666-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c26b6a29-57eb-40b5-81e7-acba8e12a666" (UID: "c26b6a29-57eb-40b5-81e7-acba8e12a666"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:18:50.825071 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:50.825042    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c26b6a29-57eb-40b5-81e7-acba8e12a666-kube-api-access-s79v5" (OuterVolumeSpecName: "kube-api-access-s79v5") pod "c26b6a29-57eb-40b5-81e7-acba8e12a666" (UID: "c26b6a29-57eb-40b5-81e7-acba8e12a666"). InnerVolumeSpecName "kube-api-access-s79v5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:18:50.825071 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:50.825054    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c26b6a29-57eb-40b5-81e7-acba8e12a666-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c26b6a29-57eb-40b5-81e7-acba8e12a666" (UID: "c26b6a29-57eb-40b5-81e7-acba8e12a666"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:18:50.923967 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:50.923926    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s79v5\" (UniqueName: \"kubernetes.io/projected/c26b6a29-57eb-40b5-81e7-acba8e12a666-kube-api-access-s79v5\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:18:50.924197 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:50.924181    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c26b6a29-57eb-40b5-81e7-acba8e12a666-openshift-service-ca\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:18:50.924298 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:50.924287    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c26b6a29-57eb-40b5-81e7-acba8e12a666-metrics-certs\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:18:50.924375 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:50.924364    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c26b6a29-57eb-40b5-81e7-acba8e12a666-maas-api-tls\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:18:51.706500 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:51.706470    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx"
Sep 08 04:18:51.706971 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:51.706466    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx" event={"ID":"c26b6a29-57eb-40b5-81e7-acba8e12a666","Type":"ContainerDied","Data":"8a20a62ee1f3b9b02b74fa7156c9cb4dbaf2dc7f603e22b1d281573c30a52d6f"}
Sep 08 04:18:51.706971 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:51.706617    2573 scope.go:117] "RemoveContainer" containerID="9ce79f9d04de1dce50d05d771bbbe62e344d6a735d1b19617870b895aca642e8"
Sep 08 04:18:51.812936 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:51.812905    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx"]
Sep 08 04:18:51.827819 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:51.827787    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ff0f3e-7884f44964-dw2lx"]
Sep 08 04:18:52.675535 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:52.675504    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c26b6a29-57eb-40b5-81e7-acba8e12a666" path="/var/lib/kubelet/pods/c26b6a29-57eb-40b5-81e7-acba8e12a666/volumes"
Sep 08 04:18:55.613016 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:55.612981    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"]
Sep 08 04:18:55.613402 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:18:55.613176    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g" podUID="d5c08a6b-dc4f-4956-a873-3595633aa6fb" containerName="istio-proxy" containerID="cri-o://d5a724cfe51dad57a2e766b12c15f89698c052f602682621372610322c225341" gracePeriod=30
Sep 08 04:19:00.017544 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:00.017507    2573 patch_prober.go:28] interesting pod/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Sep 08 04:19:00.018041 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:00.017593    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g" podUID="d5c08a6b-dc4f-4956-a873-3595633aa6fb" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 04:19:00.760825 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:00.760790    2573 generic.go:356] "Generic (PLEG): container finished" podID="d5c08a6b-dc4f-4956-a873-3595633aa6fb" containerID="d5a724cfe51dad57a2e766b12c15f89698c052f602682621372610322c225341" exitCode=0
Sep 08 04:19:00.760990 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:00.760845    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g" event={"ID":"d5c08a6b-dc4f-4956-a873-3595633aa6fb","Type":"ContainerDied","Data":"d5a724cfe51dad57a2e766b12c15f89698c052f602682621372610322c225341"}
Sep 08 04:19:00.760990 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:00.760894    2573 scope.go:117] "RemoveContainer" containerID="0dbf1c918d351079126af3612c31bb55f2990e0332b70143738318071b92cf58"
Sep 08 04:19:00.876184 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:00.876129    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"
Sep 08 04:19:00.916931 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:00.916899    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5c08a6b-dc4f-4956-a873-3595633aa6fb-workload-socket\") pod \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\" (UID: \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\") "
Sep 08 04:19:00.917870 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:00.916981    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5c08a6b-dc4f-4956-a873-3595633aa6fb-credential-socket\") pod \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\" (UID: \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\") "
Sep 08 04:19:00.917870 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:00.917014    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5c08a6b-dc4f-4956-a873-3595633aa6fb-istio-podinfo\") pod \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\" (UID: \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\") "
Sep 08 04:19:00.917870 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:00.917055    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gl8zm\" (UniqueName: \"kubernetes.io/projected/d5c08a6b-dc4f-4956-a873-3595633aa6fb-kube-api-access-gl8zm\") pod \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\" (UID: \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\") "
Sep 08 04:19:00.917870 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:00.917104    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5c08a6b-dc4f-4956-a873-3595633aa6fb-istiod-ca-cert\") pod \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\" (UID: \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\") "
Sep 08 04:19:00.917870 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:00.917142    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5c08a6b-dc4f-4956-a873-3595633aa6fb-istio-token\") pod \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\" (UID: \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\") "
Sep 08 04:19:00.917870 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:00.917190    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5c08a6b-dc4f-4956-a873-3595633aa6fb-istio-envoy\") pod \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\" (UID: \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\") "
Sep 08 04:19:00.917870 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:00.917266    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5c08a6b-dc4f-4956-a873-3595633aa6fb-istio-data\") pod \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\" (UID: \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\") "
Sep 08 04:19:00.917870 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:00.917278    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5c08a6b-dc4f-4956-a873-3595633aa6fb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d5c08a6b-dc4f-4956-a873-3595633aa6fb" (UID: "d5c08a6b-dc4f-4956-a873-3595633aa6fb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:19:00.917870 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:00.917331    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5c08a6b-dc4f-4956-a873-3595633aa6fb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d5c08a6b-dc4f-4956-a873-3595633aa6fb" (UID: "d5c08a6b-dc4f-4956-a873-3595633aa6fb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:19:00.917870 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:00.917337    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5c08a6b-dc4f-4956-a873-3595633aa6fb-workload-certs\") pod \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\" (UID: \"d5c08a6b-dc4f-4956-a873-3595633aa6fb\") "
Sep 08 04:19:00.917870 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:00.917536    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5c08a6b-dc4f-4956-a873-3595633aa6fb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d5c08a6b-dc4f-4956-a873-3595633aa6fb" (UID: "d5c08a6b-dc4f-4956-a873-3595633aa6fb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:19:00.917870 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:00.917875    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5c08a6b-dc4f-4956-a873-3595633aa6fb-istio-data" (OuterVolumeSpecName: "istio-data") pod "d5c08a6b-dc4f-4956-a873-3595633aa6fb" (UID: "d5c08a6b-dc4f-4956-a873-3595633aa6fb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:19:00.918650 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:00.917940    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5c08a6b-dc4f-4956-a873-3595633aa6fb-workload-certs\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:19:00.918650 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:00.917961    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5c08a6b-dc4f-4956-a873-3595633aa6fb-workload-socket\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:19:00.918650 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:00.917974    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5c08a6b-dc4f-4956-a873-3595633aa6fb-credential-socket\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:19:00.918650 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:00.918005    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5c08a6b-dc4f-4956-a873-3595633aa6fb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d5c08a6b-dc4f-4956-a873-3595633aa6fb" (UID: "d5c08a6b-dc4f-4956-a873-3595633aa6fb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 04:19:00.921029 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:00.920988    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d5c08a6b-dc4f-4956-a873-3595633aa6fb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d5c08a6b-dc4f-4956-a873-3595633aa6fb" (UID: "d5c08a6b-dc4f-4956-a873-3595633aa6fb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 04:19:00.921156 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:00.921028    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5c08a6b-dc4f-4956-a873-3595633aa6fb-istio-token" (OuterVolumeSpecName: "istio-token") pod "d5c08a6b-dc4f-4956-a873-3595633aa6fb" (UID: "d5c08a6b-dc4f-4956-a873-3595633aa6fb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:19:00.921304 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:00.921277    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5c08a6b-dc4f-4956-a873-3595633aa6fb-kube-api-access-gl8zm" (OuterVolumeSpecName: "kube-api-access-gl8zm") pod "d5c08a6b-dc4f-4956-a873-3595633aa6fb" (UID: "d5c08a6b-dc4f-4956-a873-3595633aa6fb"). InnerVolumeSpecName "kube-api-access-gl8zm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:19:00.921480 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:00.921454    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5c08a6b-dc4f-4956-a873-3595633aa6fb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d5c08a6b-dc4f-4956-a873-3595633aa6fb" (UID: "d5c08a6b-dc4f-4956-a873-3595633aa6fb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:19:01.019274 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:01.019248    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5c08a6b-dc4f-4956-a873-3595633aa6fb-istio-data\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:19:01.019274 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:01.019272    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5c08a6b-dc4f-4956-a873-3595633aa6fb-istio-podinfo\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:19:01.019274 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:01.019280    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gl8zm\" (UniqueName: \"kubernetes.io/projected/d5c08a6b-dc4f-4956-a873-3595633aa6fb-kube-api-access-gl8zm\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:19:01.019714 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:01.019289    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5c08a6b-dc4f-4956-a873-3595633aa6fb-istiod-ca-cert\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:19:01.019714 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:01.019298    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5c08a6b-dc4f-4956-a873-3595633aa6fb-istio-token\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:19:01.019714 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:01.019306    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5c08a6b-dc4f-4956-a873-3595633aa6fb-istio-envoy\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:19:01.768419 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:01.768389    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"
Sep 08 04:19:01.768607 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:01.768391    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g" event={"ID":"d5c08a6b-dc4f-4956-a873-3595633aa6fb","Type":"ContainerDied","Data":"0138f34c456661619039eeadbc7f3d9999d43052b229fdaecff1b4f1d70e821a"}
Sep 08 04:19:01.768607 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:01.768521    2573 scope.go:117] "RemoveContainer" containerID="d5a724cfe51dad57a2e766b12c15f89698c052f602682621372610322c225341"
Sep 08 04:19:01.794405 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:01.794375    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"]
Sep 08 04:19:01.813698 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:01.809305    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g"]
Sep 08 04:19:02.675282 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:02.675249    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5c08a6b-dc4f-4956-a873-3595633aa6fb" path="/var/lib/kubelet/pods/d5c08a6b-dc4f-4956-a873-3595633aa6fb/volumes"
Sep 08 04:19:23.375965 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:23.375928    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"]
Sep 08 04:19:23.376401 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:23.376136    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds" podUID="de329c00-1862-45e1-9091-0a6f50f7d988" containerName="istio-proxy" containerID="cri-o://f4a4f38083c555aa4e694587919d7764c6420fc2a026770a5c87144f895a825f" gracePeriod=30
Sep 08 04:19:23.864865 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:23.864826    2573 patch_prober.go:28] interesting pod/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 04:19:23.865022 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:23.864919    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds" podUID="de329c00-1862-45e1-9091-0a6f50f7d988" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 04:19:28.648074 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.648014    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"
Sep 08 04:19:28.726829 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.726800    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c2a8bb-84b4b6f8f5-695gk"]
Sep 08 04:19:28.727256 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.727243    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b20cdd7-d400-40d7-a357-30aa97ec6113" containerName="maas-api"
Sep 08 04:19:28.727300 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.727259    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b20cdd7-d400-40d7-a357-30aa97ec6113" containerName="maas-api"
Sep 08 04:19:28.727300 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.727268    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de329c00-1862-45e1-9091-0a6f50f7d988" containerName="istio-proxy"
Sep 08 04:19:28.727300 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.727273    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="de329c00-1862-45e1-9091-0a6f50f7d988" containerName="istio-proxy"
Sep 08 04:19:28.727300 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.727286    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c26b6a29-57eb-40b5-81e7-acba8e12a666" containerName="maas-api"
Sep 08 04:19:28.727300 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.727292    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c26b6a29-57eb-40b5-81e7-acba8e12a666" containerName="maas-api"
Sep 08 04:19:28.727300 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.727299    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de329c00-1862-45e1-9091-0a6f50f7d988" containerName="istio-proxy"
Sep 08 04:19:28.727485 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.727304    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="de329c00-1862-45e1-9091-0a6f50f7d988" containerName="istio-proxy"
Sep 08 04:19:28.727485 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.727310    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5c08a6b-dc4f-4956-a873-3595633aa6fb" containerName="istio-proxy"
Sep 08 04:19:28.727485 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.727315    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5c08a6b-dc4f-4956-a873-3595633aa6fb" containerName="istio-proxy"
Sep 08 04:19:28.727485 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.727326    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5c08a6b-dc4f-4956-a873-3595633aa6fb" containerName="istio-proxy"
Sep 08 04:19:28.727485 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.727331    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5c08a6b-dc4f-4956-a873-3595633aa6fb" containerName="istio-proxy"
Sep 08 04:19:28.727485 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.727340    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4122710-0fc7-41ce-b2c3-e2600aa76f2e" containerName="istio-proxy"
Sep 08 04:19:28.727485 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.727345    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4122710-0fc7-41ce-b2c3-e2600aa76f2e" containerName="istio-proxy"
Sep 08 04:19:28.727485 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.727408    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4122710-0fc7-41ce-b2c3-e2600aa76f2e" containerName="istio-proxy"
Sep 08 04:19:28.727485 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.727417    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b20cdd7-d400-40d7-a357-30aa97ec6113" containerName="maas-api"
Sep 08 04:19:28.727485 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.727425    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="de329c00-1862-45e1-9091-0a6f50f7d988" containerName="istio-proxy"
Sep 08 04:19:28.727485 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.727430    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="de329c00-1862-45e1-9091-0a6f50f7d988" containerName="istio-proxy"
Sep 08 04:19:28.727485 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.727437    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c26b6a29-57eb-40b5-81e7-acba8e12a666" containerName="maas-api"
Sep 08 04:19:28.727485 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.727443    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5c08a6b-dc4f-4956-a873-3595633aa6fb" containerName="istio-proxy"
Sep 08 04:19:28.727485 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.727449    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5c08a6b-dc4f-4956-a873-3595633aa6fb" containerName="istio-proxy"
Sep 08 04:19:28.730600 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.730581    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c2a8bb-84b4b6f8f5-695gk"
Sep 08 04:19:28.741535 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.741515    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-c2a8bb-serving-cert\""
Sep 08 04:19:28.782601 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.782545    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de329c00-1862-45e1-9091-0a6f50f7d988-workload-certs\") pod \"de329c00-1862-45e1-9091-0a6f50f7d988\" (UID: \"de329c00-1862-45e1-9091-0a6f50f7d988\") "
Sep 08 04:19:28.782757 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.782640    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de329c00-1862-45e1-9091-0a6f50f7d988-istiod-ca-cert\") pod \"de329c00-1862-45e1-9091-0a6f50f7d988\" (UID: \"de329c00-1862-45e1-9091-0a6f50f7d988\") "
Sep 08 04:19:28.782757 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.782667    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de329c00-1862-45e1-9091-0a6f50f7d988-istio-podinfo\") pod \"de329c00-1862-45e1-9091-0a6f50f7d988\" (UID: \"de329c00-1862-45e1-9091-0a6f50f7d988\") "
Sep 08 04:19:28.782757 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.782722    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de329c00-1862-45e1-9091-0a6f50f7d988-istio-token\") pod \"de329c00-1862-45e1-9091-0a6f50f7d988\" (UID: \"de329c00-1862-45e1-9091-0a6f50f7d988\") "
Sep 08 04:19:28.782757 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.782755    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vr24w\" (UniqueName: \"kubernetes.io/projected/de329c00-1862-45e1-9091-0a6f50f7d988-kube-api-access-vr24w\") pod \"de329c00-1862-45e1-9091-0a6f50f7d988\" (UID: \"de329c00-1862-45e1-9091-0a6f50f7d988\") "
Sep 08 04:19:28.782950 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.782791    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de329c00-1862-45e1-9091-0a6f50f7d988-workload-socket\") pod \"de329c00-1862-45e1-9091-0a6f50f7d988\" (UID: \"de329c00-1862-45e1-9091-0a6f50f7d988\") "
Sep 08 04:19:28.782950 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.782843    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de329c00-1862-45e1-9091-0a6f50f7d988-istio-envoy\") pod \"de329c00-1862-45e1-9091-0a6f50f7d988\" (UID: \"de329c00-1862-45e1-9091-0a6f50f7d988\") "
Sep 08 04:19:28.782950 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.782880    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de329c00-1862-45e1-9091-0a6f50f7d988-credential-socket\") pod \"de329c00-1862-45e1-9091-0a6f50f7d988\" (UID: \"de329c00-1862-45e1-9091-0a6f50f7d988\") "
Sep 08 04:19:28.782950 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.782903    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de329c00-1862-45e1-9091-0a6f50f7d988-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "de329c00-1862-45e1-9091-0a6f50f7d988" (UID: "de329c00-1862-45e1-9091-0a6f50f7d988"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:19:28.782950 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.782915    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de329c00-1862-45e1-9091-0a6f50f7d988-istio-data\") pod \"de329c00-1862-45e1-9091-0a6f50f7d988\" (UID: \"de329c00-1862-45e1-9091-0a6f50f7d988\") "
Sep 08 04:19:28.783258 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.783087    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de329c00-1862-45e1-9091-0a6f50f7d988-istio-data" (OuterVolumeSpecName: "istio-data") pod "de329c00-1862-45e1-9091-0a6f50f7d988" (UID: "de329c00-1862-45e1-9091-0a6f50f7d988"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:19:28.783258 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.783248    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de329c00-1862-45e1-9091-0a6f50f7d988-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "de329c00-1862-45e1-9091-0a6f50f7d988" (UID: "de329c00-1862-45e1-9091-0a6f50f7d988"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:19:28.783487 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.783404    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de329c00-1862-45e1-9091-0a6f50f7d988-workload-socket\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:19:28.783487 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.783424    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de329c00-1862-45e1-9091-0a6f50f7d988-istio-data\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:19:28.783487 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.783437    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de329c00-1862-45e1-9091-0a6f50f7d988-workload-certs\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:19:28.783748 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.783631    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de329c00-1862-45e1-9091-0a6f50f7d988-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "de329c00-1862-45e1-9091-0a6f50f7d988" (UID: "de329c00-1862-45e1-9091-0a6f50f7d988"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:19:28.783748 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.783699    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de329c00-1862-45e1-9091-0a6f50f7d988-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "de329c00-1862-45e1-9091-0a6f50f7d988" (UID: "de329c00-1862-45e1-9091-0a6f50f7d988"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 04:19:28.785907 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.785868    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/de329c00-1862-45e1-9091-0a6f50f7d988-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "de329c00-1862-45e1-9091-0a6f50f7d988" (UID: "de329c00-1862-45e1-9091-0a6f50f7d988"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 04:19:28.785907 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.785887    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de329c00-1862-45e1-9091-0a6f50f7d988-kube-api-access-vr24w" (OuterVolumeSpecName: "kube-api-access-vr24w") pod "de329c00-1862-45e1-9091-0a6f50f7d988" (UID: "de329c00-1862-45e1-9091-0a6f50f7d988"). InnerVolumeSpecName "kube-api-access-vr24w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:19:28.786073 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.785940    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de329c00-1862-45e1-9091-0a6f50f7d988-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "de329c00-1862-45e1-9091-0a6f50f7d988" (UID: "de329c00-1862-45e1-9091-0a6f50f7d988"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:19:28.787267 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.787242    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de329c00-1862-45e1-9091-0a6f50f7d988-istio-token" (OuterVolumeSpecName: "istio-token") pod "de329c00-1862-45e1-9091-0a6f50f7d988" (UID: "de329c00-1862-45e1-9091-0a6f50f7d988"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:19:28.787834 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.787815    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c2a8bb-84b4b6f8f5-695gk"]
Sep 08 04:19:28.884195 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.884157    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d3f5a10-a752-4cbe-98ca-1012f225873a-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-c2a8bb-84b4b6f8f5-695gk\" (UID: \"6d3f5a10-a752-4cbe-98ca-1012f225873a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c2a8bb-84b4b6f8f5-695gk"
Sep 08 04:19:28.884357 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.884290    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d3f5a10-a752-4cbe-98ca-1012f225873a-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-c2a8bb-84b4b6f8f5-695gk\" (UID: \"6d3f5a10-a752-4cbe-98ca-1012f225873a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c2a8bb-84b4b6f8f5-695gk"
Sep 08 04:19:28.884357 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.884343    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d3f5a10-a752-4cbe-98ca-1012f225873a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-c2a8bb-84b4b6f8f5-695gk\" (UID: \"6d3f5a10-a752-4cbe-98ca-1012f225873a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c2a8bb-84b4b6f8f5-695gk"
Sep 08 04:19:28.884446 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.884371    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqgh4\" (UniqueName: \"kubernetes.io/projected/6d3f5a10-a752-4cbe-98ca-1012f225873a-kube-api-access-rqgh4\") pod \"maas-api-e2e-shared-a-w3-c2a8bb-84b4b6f8f5-695gk\" (UID: \"6d3f5a10-a752-4cbe-98ca-1012f225873a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c2a8bb-84b4b6f8f5-695gk"
Sep 08 04:19:28.884483 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.884445    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de329c00-1862-45e1-9091-0a6f50f7d988-istio-envoy\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:19:28.884483 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.884460    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de329c00-1862-45e1-9091-0a6f50f7d988-credential-socket\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:19:28.884483 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.884474    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de329c00-1862-45e1-9091-0a6f50f7d988-istiod-ca-cert\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:19:28.884605 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.884486    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de329c00-1862-45e1-9091-0a6f50f7d988-istio-podinfo\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:19:28.884605 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.884493    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de329c00-1862-45e1-9091-0a6f50f7d988-istio-token\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:19:28.884605 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.884502    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vr24w\" (UniqueName: \"kubernetes.io/projected/de329c00-1862-45e1-9091-0a6f50f7d988-kube-api-access-vr24w\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:19:28.927518 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.927440    2573 generic.go:356] "Generic (PLEG): container finished" podID="de329c00-1862-45e1-9091-0a6f50f7d988" containerID="f4a4f38083c555aa4e694587919d7764c6420fc2a026770a5c87144f895a825f" exitCode=0
Sep 08 04:19:28.927518 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.927481    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"
Sep 08 04:19:28.927760 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.927521    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds" event={"ID":"de329c00-1862-45e1-9091-0a6f50f7d988","Type":"ContainerDied","Data":"f4a4f38083c555aa4e694587919d7764c6420fc2a026770a5c87144f895a825f"}
Sep 08 04:19:28.927760 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.927598    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds" event={"ID":"de329c00-1862-45e1-9091-0a6f50f7d988","Type":"ContainerDied","Data":"89c3008162d69bbf08faf0ddc2dd729e5f0220249012c3c778484dd6351f7455"}
Sep 08 04:19:28.927760 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.927678    2573 scope.go:117] "RemoveContainer" containerID="f4a4f38083c555aa4e694587919d7764c6420fc2a026770a5c87144f895a825f"
Sep 08 04:19:28.937871 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.937849    2573 scope.go:117] "RemoveContainer" containerID="94627dc1b85bdd93c923da73c76671fb47df572789a094faf93e48721c0d3adc"
Sep 08 04:19:28.946157 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.946140    2573 scope.go:117] "RemoveContainer" containerID="f4a4f38083c555aa4e694587919d7764c6420fc2a026770a5c87144f895a825f"
Sep 08 04:19:28.946448 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:19:28.946424    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4a4f38083c555aa4e694587919d7764c6420fc2a026770a5c87144f895a825f\": container with ID starting with f4a4f38083c555aa4e694587919d7764c6420fc2a026770a5c87144f895a825f not found: ID does not exist" containerID="f4a4f38083c555aa4e694587919d7764c6420fc2a026770a5c87144f895a825f"
Sep 08 04:19:28.946524 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.946458    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4a4f38083c555aa4e694587919d7764c6420fc2a026770a5c87144f895a825f"} err="failed to get container status \"f4a4f38083c555aa4e694587919d7764c6420fc2a026770a5c87144f895a825f\": rpc error: code = NotFound desc = could not find container \"f4a4f38083c555aa4e694587919d7764c6420fc2a026770a5c87144f895a825f\": container with ID starting with f4a4f38083c555aa4e694587919d7764c6420fc2a026770a5c87144f895a825f not found: ID does not exist"
Sep 08 04:19:28.946524 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.946476    2573 scope.go:117] "RemoveContainer" containerID="94627dc1b85bdd93c923da73c76671fb47df572789a094faf93e48721c0d3adc"
Sep 08 04:19:28.946748 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:19:28.946732    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94627dc1b85bdd93c923da73c76671fb47df572789a094faf93e48721c0d3adc\": container with ID starting with 94627dc1b85bdd93c923da73c76671fb47df572789a094faf93e48721c0d3adc not found: ID does not exist" containerID="94627dc1b85bdd93c923da73c76671fb47df572789a094faf93e48721c0d3adc"
Sep 08 04:19:28.946788 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.946752    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94627dc1b85bdd93c923da73c76671fb47df572789a094faf93e48721c0d3adc"} err="failed to get container status \"94627dc1b85bdd93c923da73c76671fb47df572789a094faf93e48721c0d3adc\": rpc error: code = NotFound desc = could not find container \"94627dc1b85bdd93c923da73c76671fb47df572789a094faf93e48721c0d3adc\": container with ID starting with 94627dc1b85bdd93c923da73c76671fb47df572789a094faf93e48721c0d3adc not found: ID does not exist"
Sep 08 04:19:28.969499 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.969477    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"]
Sep 08 04:19:28.978798 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.978776    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds"]
Sep 08 04:19:28.985922 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.985899    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqgh4\" (UniqueName: \"kubernetes.io/projected/6d3f5a10-a752-4cbe-98ca-1012f225873a-kube-api-access-rqgh4\") pod \"maas-api-e2e-shared-a-w3-c2a8bb-84b4b6f8f5-695gk\" (UID: \"6d3f5a10-a752-4cbe-98ca-1012f225873a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c2a8bb-84b4b6f8f5-695gk"
Sep 08 04:19:28.986008 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.985963    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d3f5a10-a752-4cbe-98ca-1012f225873a-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-c2a8bb-84b4b6f8f5-695gk\" (UID: \"6d3f5a10-a752-4cbe-98ca-1012f225873a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c2a8bb-84b4b6f8f5-695gk"
Sep 08 04:19:28.986050 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.986021    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d3f5a10-a752-4cbe-98ca-1012f225873a-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-c2a8bb-84b4b6f8f5-695gk\" (UID: \"6d3f5a10-a752-4cbe-98ca-1012f225873a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c2a8bb-84b4b6f8f5-695gk"
Sep 08 04:19:28.986085 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.986054    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d3f5a10-a752-4cbe-98ca-1012f225873a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-c2a8bb-84b4b6f8f5-695gk\" (UID: \"6d3f5a10-a752-4cbe-98ca-1012f225873a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c2a8bb-84b4b6f8f5-695gk"
Sep 08 04:19:28.986716 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.986700    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d3f5a10-a752-4cbe-98ca-1012f225873a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-c2a8bb-84b4b6f8f5-695gk\" (UID: \"6d3f5a10-a752-4cbe-98ca-1012f225873a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c2a8bb-84b4b6f8f5-695gk"
Sep 08 04:19:28.988362 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.988341    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d3f5a10-a752-4cbe-98ca-1012f225873a-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-c2a8bb-84b4b6f8f5-695gk\" (UID: \"6d3f5a10-a752-4cbe-98ca-1012f225873a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c2a8bb-84b4b6f8f5-695gk"
Sep 08 04:19:28.988451 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:28.988420    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d3f5a10-a752-4cbe-98ca-1012f225873a-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-c2a8bb-84b4b6f8f5-695gk\" (UID: \"6d3f5a10-a752-4cbe-98ca-1012f225873a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c2a8bb-84b4b6f8f5-695gk"
Sep 08 04:19:29.006934 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:29.006911    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqgh4\" (UniqueName: \"kubernetes.io/projected/6d3f5a10-a752-4cbe-98ca-1012f225873a-kube-api-access-rqgh4\") pod \"maas-api-e2e-shared-a-w3-c2a8bb-84b4b6f8f5-695gk\" (UID: \"6d3f5a10-a752-4cbe-98ca-1012f225873a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c2a8bb-84b4b6f8f5-695gk"
Sep 08 04:19:29.041075 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:29.041052    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c2a8bb-84b4b6f8f5-695gk"
Sep 08 04:19:29.336158 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:29.336130    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c2a8bb-84b4b6f8f5-695gk"]
Sep 08 04:19:29.338833 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:19:29.338810    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d3f5a10_a752_4cbe_98ca_1012f225873a.slice/crio-417de1af7e91d2939b517f0fa45686e4bd72673743a13f01454b8af2d0d04ab7 WatchSource:0}: Error finding container 417de1af7e91d2939b517f0fa45686e4bd72673743a13f01454b8af2d0d04ab7: Status 404 returned error can't find the container with id 417de1af7e91d2939b517f0fa45686e4bd72673743a13f01454b8af2d0d04ab7
Sep 08 04:19:29.934762 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:29.934663    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c2a8bb-84b4b6f8f5-695gk" event={"ID":"6d3f5a10-a752-4cbe-98ca-1012f225873a","Type":"ContainerStarted","Data":"45e5f540ba78e900227d469d72d33e2448da41a536ea1bce6d2d6a824b00adb9"}
Sep 08 04:19:29.934762 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:29.934737    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c2a8bb-84b4b6f8f5-695gk" event={"ID":"6d3f5a10-a752-4cbe-98ca-1012f225873a","Type":"ContainerStarted","Data":"417de1af7e91d2939b517f0fa45686e4bd72673743a13f01454b8af2d0d04ab7"}
Sep 08 04:19:29.935208 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:29.934862    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c2a8bb-84b4b6f8f5-695gk"
Sep 08 04:19:29.984875 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:29.984823    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c2a8bb-84b4b6f8f5-695gk" podStartSLOduration=1.665550529 podStartE2EDuration="1.984808187s" totalImagesPullingTime="319.257658ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:19:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:19:29.9837786 +0000 UTC m=+1129.769069836" watchObservedRunningTime="2026-09-08 04:19:29.984808187 +0000 UTC m=+1129.770099423"
Sep 08 04:19:30.675364 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:30.675317    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de329c00-1862-45e1-9091-0a6f50f7d988" path="/var/lib/kubelet/pods/de329c00-1862-45e1-9091-0a6f50f7d988/volumes"
Sep 08 04:19:35.947020 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:35.946989    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c2a8bb-84b4b6f8f5-695gk"
Sep 08 04:19:44.307480 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:44.307447    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"]
Sep 08 04:19:44.312678 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:44.312659    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"
Sep 08 04:19:44.315918 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:44.315892    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-c2eafd-openshift-default-dockercfg-9thdd\""
Sep 08 04:19:44.339861 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:44.339836    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"]
Sep 08 04:19:44.340267 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:44.340241    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfa75482-045d-4f12-ae36-70f877cb348f-istio-envoy\") pod \"e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj\" (UID: \"bfa75482-045d-4f12-ae36-70f877cb348f\") " pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"
Sep 08 04:19:44.340326 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:44.340283    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfa75482-045d-4f12-ae36-70f877cb348f-istiod-ca-cert\") pod \"e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj\" (UID: \"bfa75482-045d-4f12-ae36-70f877cb348f\") " pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"
Sep 08 04:19:44.340418 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:44.340399    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfa75482-045d-4f12-ae36-70f877cb348f-workload-socket\") pod \"e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj\" (UID: \"bfa75482-045d-4f12-ae36-70f877cb348f\") " pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"
Sep 08 04:19:44.340457 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:44.340438    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfa75482-045d-4f12-ae36-70f877cb348f-istio-podinfo\") pod \"e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj\" (UID: \"bfa75482-045d-4f12-ae36-70f877cb348f\") " pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"
Sep 08 04:19:44.340512 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:44.340457    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfa75482-045d-4f12-ae36-70f877cb348f-istio-token\") pod \"e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj\" (UID: \"bfa75482-045d-4f12-ae36-70f877cb348f\") " pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"
Sep 08 04:19:44.340583 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:44.340526    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfa75482-045d-4f12-ae36-70f877cb348f-credential-socket\") pod \"e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj\" (UID: \"bfa75482-045d-4f12-ae36-70f877cb348f\") " pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"
Sep 08 04:19:44.340644 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:44.340631    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfa75482-045d-4f12-ae36-70f877cb348f-workload-certs\") pod \"e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj\" (UID: \"bfa75482-045d-4f12-ae36-70f877cb348f\") " pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"
Sep 08 04:19:44.340700 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:44.340665    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zclg\" (UniqueName: \"kubernetes.io/projected/bfa75482-045d-4f12-ae36-70f877cb348f-kube-api-access-7zclg\") pod \"e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj\" (UID: \"bfa75482-045d-4f12-ae36-70f877cb348f\") " pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"
Sep 08 04:19:44.340753 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:44.340710    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfa75482-045d-4f12-ae36-70f877cb348f-istio-data\") pod \"e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj\" (UID: \"bfa75482-045d-4f12-ae36-70f877cb348f\") " pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"
Sep 08 04:19:44.441924 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:44.441893    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfa75482-045d-4f12-ae36-70f877cb348f-workload-certs\") pod \"e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj\" (UID: \"bfa75482-045d-4f12-ae36-70f877cb348f\") " pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"
Sep 08 04:19:44.442097 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:44.442002    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zclg\" (UniqueName: \"kubernetes.io/projected/bfa75482-045d-4f12-ae36-70f877cb348f-kube-api-access-7zclg\") pod \"e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj\" (UID: \"bfa75482-045d-4f12-ae36-70f877cb348f\") " pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"
Sep 08 04:19:44.442097 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:44.442041    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfa75482-045d-4f12-ae36-70f877cb348f-istio-data\") pod \"e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj\" (UID: \"bfa75482-045d-4f12-ae36-70f877cb348f\") " pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"
Sep 08 04:19:44.442097 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:44.442087    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfa75482-045d-4f12-ae36-70f877cb348f-istio-envoy\") pod \"e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj\" (UID: \"bfa75482-045d-4f12-ae36-70f877cb348f\") " pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"
Sep 08 04:19:44.442216 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:44.442107    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfa75482-045d-4f12-ae36-70f877cb348f-istiod-ca-cert\") pod \"e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj\" (UID: \"bfa75482-045d-4f12-ae36-70f877cb348f\") " pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"
Sep 08 04:19:44.442216 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:44.442195    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfa75482-045d-4f12-ae36-70f877cb348f-workload-socket\") pod \"e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj\" (UID: \"bfa75482-045d-4f12-ae36-70f877cb348f\") " pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"
Sep 08 04:19:44.442323 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:44.442235    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfa75482-045d-4f12-ae36-70f877cb348f-istio-podinfo\") pod \"e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj\" (UID: \"bfa75482-045d-4f12-ae36-70f877cb348f\") " pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"
Sep 08 04:19:44.442323 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:44.442252    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfa75482-045d-4f12-ae36-70f877cb348f-istio-token\") pod \"e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj\" (UID: \"bfa75482-045d-4f12-ae36-70f877cb348f\") " pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"
Sep 08 04:19:44.442323 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:44.442280    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfa75482-045d-4f12-ae36-70f877cb348f-credential-socket\") pod \"e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj\" (UID: \"bfa75482-045d-4f12-ae36-70f877cb348f\") " pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"
Sep 08 04:19:44.442481 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:44.442335    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfa75482-045d-4f12-ae36-70f877cb348f-workload-certs\") pod \"e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj\" (UID: \"bfa75482-045d-4f12-ae36-70f877cb348f\") " pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"
Sep 08 04:19:44.442481 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:44.442452    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfa75482-045d-4f12-ae36-70f877cb348f-istio-data\") pod \"e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj\" (UID: \"bfa75482-045d-4f12-ae36-70f877cb348f\") " pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"
Sep 08 04:19:44.442627 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:44.442588    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfa75482-045d-4f12-ae36-70f877cb348f-workload-socket\") pod \"e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj\" (UID: \"bfa75482-045d-4f12-ae36-70f877cb348f\") " pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"
Sep 08 04:19:44.442686 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:44.442664    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfa75482-045d-4f12-ae36-70f877cb348f-credential-socket\") pod \"e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj\" (UID: \"bfa75482-045d-4f12-ae36-70f877cb348f\") " pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"
Sep 08 04:19:44.442923 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:44.442901    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfa75482-045d-4f12-ae36-70f877cb348f-istiod-ca-cert\") pod \"e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj\" (UID: \"bfa75482-045d-4f12-ae36-70f877cb348f\") " pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"
Sep 08 04:19:44.444513 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:44.444487    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfa75482-045d-4f12-ae36-70f877cb348f-istio-envoy\") pod \"e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj\" (UID: \"bfa75482-045d-4f12-ae36-70f877cb348f\") " pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"
Sep 08 04:19:44.444798 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:44.444783    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfa75482-045d-4f12-ae36-70f877cb348f-istio-podinfo\") pod \"e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj\" (UID: \"bfa75482-045d-4f12-ae36-70f877cb348f\") " pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"
Sep 08 04:19:44.456966 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:44.456947    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfa75482-045d-4f12-ae36-70f877cb348f-istio-token\") pod \"e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj\" (UID: \"bfa75482-045d-4f12-ae36-70f877cb348f\") " pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"
Sep 08 04:19:44.464496 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:44.464468    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zclg\" (UniqueName: \"kubernetes.io/projected/bfa75482-045d-4f12-ae36-70f877cb348f-kube-api-access-7zclg\") pod \"e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj\" (UID: \"bfa75482-045d-4f12-ae36-70f877cb348f\") " pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"
Sep 08 04:19:44.622916 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:44.622839    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"
Sep 08 04:19:44.937798 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:44.937774    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"]
Sep 08 04:19:44.940034 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:19:44.940009    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfa75482_045d_4f12_ae36_70f877cb348f.slice/crio-578e2ccdf08385818546f6cd9f1da66f5f5242a2b62eb2dd598d6c909189af30 WatchSource:0}: Error finding container 578e2ccdf08385818546f6cd9f1da66f5f5242a2b62eb2dd598d6c909189af30: Status 404 returned error can't find the container with id 578e2ccdf08385818546f6cd9f1da66f5f5242a2b62eb2dd598d6c909189af30
Sep 08 04:19:44.942171 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:44.942141    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:19:44.942270 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:44.942226    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:19:44.942335 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:44.942274    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:19:45.025229 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:45.025193    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj" event={"ID":"bfa75482-045d-4f12-ae36-70f877cb348f","Type":"ContainerStarted","Data":"1a6a1e9d356948bfa6427c1bbff4b085ecdb9580d6b927ff424be3d0ff6300ee"}
Sep 08 04:19:45.025347 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:45.025248    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj" event={"ID":"bfa75482-045d-4f12-ae36-70f877cb348f","Type":"ContainerStarted","Data":"578e2ccdf08385818546f6cd9f1da66f5f5242a2b62eb2dd598d6c909189af30"}
Sep 08 04:19:45.054576 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:45.054503    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj" podStartSLOduration=1.054481963 podStartE2EDuration="1.054481963s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:19:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:19:45.051740446 +0000 UTC m=+1144.837031683" watchObservedRunningTime="2026-09-08 04:19:45.054481963 +0000 UTC m=+1144.839773200"
Sep 08 04:19:45.623236 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:45.623205    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"
Sep 08 04:19:46.628518 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:46.628490    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"
Sep 08 04:19:47.036453 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:47.036420    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"
Sep 08 04:19:47.037470 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:47.037446    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"
Sep 08 04:19:58.137845 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:58.137811    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"]
Sep 08 04:19:58.142076 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:58.142050    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"
Sep 08 04:19:58.144663 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:58.144646    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-720789-openshift-default-dockercfg-2cx5m\""
Sep 08 04:19:58.163089 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:58.163060    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"]
Sep 08 04:19:58.279373 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:58.279344    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-istio-podinfo\") pod \"e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl\" (UID: \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\") " pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"
Sep 08 04:19:58.279373 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:58.279378    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-istio-envoy\") pod \"e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl\" (UID: \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\") " pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"
Sep 08 04:19:58.279659 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:58.279406    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-istio-token\") pod \"e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl\" (UID: \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\") " pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"
Sep 08 04:19:58.279659 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:58.279464    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-credential-socket\") pod \"e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl\" (UID: \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\") " pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"
Sep 08 04:19:58.279659 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:58.279508    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-workload-socket\") pod \"e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl\" (UID: \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\") " pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"
Sep 08 04:19:58.279659 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:58.279544    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-istio-data\") pod \"e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl\" (UID: \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\") " pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"
Sep 08 04:19:58.279659 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:58.279625    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-workload-certs\") pod \"e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl\" (UID: \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\") " pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"
Sep 08 04:19:58.279659 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:58.279644    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnntr\" (UniqueName: \"kubernetes.io/projected/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-kube-api-access-tnntr\") pod \"e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl\" (UID: \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\") " pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"
Sep 08 04:19:58.279875 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:58.279689    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-istiod-ca-cert\") pod \"e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl\" (UID: \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\") " pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"
Sep 08 04:19:58.380401 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:58.380363    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-istio-data\") pod \"e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl\" (UID: \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\") " pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"
Sep 08 04:19:58.380629 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:58.380417    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-workload-certs\") pod \"e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl\" (UID: \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\") " pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"
Sep 08 04:19:58.380721 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:58.380659    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnntr\" (UniqueName: \"kubernetes.io/projected/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-kube-api-access-tnntr\") pod \"e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl\" (UID: \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\") " pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"
Sep 08 04:19:58.380721 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:58.380702    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-istiod-ca-cert\") pod \"e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl\" (UID: \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\") " pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"
Sep 08 04:19:58.380833 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:58.380792    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-istio-podinfo\") pod \"e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl\" (UID: \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\") " pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"
Sep 08 04:19:58.380833 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:58.380814    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-istio-envoy\") pod \"e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl\" (UID: \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\") " pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"
Sep 08 04:19:58.380947 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:58.380846    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-istio-token\") pod \"e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl\" (UID: \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\") " pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"
Sep 08 04:19:58.380947 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:58.380864    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-workload-certs\") pod \"e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl\" (UID: \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\") " pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"
Sep 08 04:19:58.380947 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:58.380876    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-credential-socket\") pod \"e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl\" (UID: \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\") " pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"
Sep 08 04:19:58.380947 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:58.380845    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-istio-data\") pod \"e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl\" (UID: \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\") " pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"
Sep 08 04:19:58.381151 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:58.380949    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-workload-socket\") pod \"e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl\" (UID: \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\") " pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"
Sep 08 04:19:58.381151 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:58.381118    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-credential-socket\") pod \"e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl\" (UID: \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\") " pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"
Sep 08 04:19:58.381303 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:58.381282    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-workload-socket\") pod \"e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl\" (UID: \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\") " pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"
Sep 08 04:19:58.381372 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:58.381357    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-istiod-ca-cert\") pod \"e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl\" (UID: \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\") " pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"
Sep 08 04:19:58.383146 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:58.383128    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-istio-envoy\") pod \"e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl\" (UID: \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\") " pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"
Sep 08 04:19:58.383419 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:58.383400    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-istio-podinfo\") pod \"e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl\" (UID: \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\") " pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"
Sep 08 04:19:58.426622 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:58.422547    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnntr\" (UniqueName: \"kubernetes.io/projected/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-kube-api-access-tnntr\") pod \"e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl\" (UID: \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\") " pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"
Sep 08 04:19:58.428241 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:58.428205    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-istio-token\") pod \"e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl\" (UID: \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\") " pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"
Sep 08 04:19:58.453189 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:58.453161    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"
Sep 08 04:19:58.801020 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:19:58.800984    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa8e3e75_f6f5_4d8c_97b2_23ec87f78415.slice/crio-8385ccb9b74e387908f952e753dde5be6ad5cc8aa5ff636641cacc75374b011c WatchSource:0}: Error finding container 8385ccb9b74e387908f952e753dde5be6ad5cc8aa5ff636641cacc75374b011c: Status 404 returned error can't find the container with id 8385ccb9b74e387908f952e753dde5be6ad5cc8aa5ff636641cacc75374b011c
Sep 08 04:19:58.801241 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:58.801218    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"]
Sep 08 04:19:58.804094 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:58.804047    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:19:58.804203 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:58.804137    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:19:58.804203 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:58.804182    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:19:59.126635 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:59.126519    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl" event={"ID":"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415","Type":"ContainerStarted","Data":"681f017f7d1a544106c1c437dba09c77703452752dd47b386430e864a8e31350"}
Sep 08 04:19:59.126635 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:59.126610    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl" event={"ID":"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415","Type":"ContainerStarted","Data":"8385ccb9b74e387908f952e753dde5be6ad5cc8aa5ff636641cacc75374b011c"}
Sep 08 04:19:59.155409 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:59.155352    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl" podStartSLOduration=1.155330541 podStartE2EDuration="1.155330541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:19:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:19:59.151000189 +0000 UTC m=+1158.936291424" watchObservedRunningTime="2026-09-08 04:19:59.155330541 +0000 UTC m=+1158.940621778"
Sep 08 04:19:59.453813 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:59.453640    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"
Sep 08 04:19:59.458933 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:19:59.458905    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"
Sep 08 04:20:00.133947 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:00.133921    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"
Sep 08 04:20:00.134861 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:00.134843    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"
Sep 08 04:20:02.204686 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:02.204602    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-720789-846cbdfbbf-td6rg"]
Sep 08 04:20:02.209434 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:02.209409    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-720789-846cbdfbbf-td6rg"
Sep 08 04:20:02.212909 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:02.212888    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-720789-serving-cert\""
Sep 08 04:20:02.229623 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:02.229597    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-720789-846cbdfbbf-td6rg"]
Sep 08 04:20:02.324937 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:02.324901    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33688555-96cc-427b-85b7-87ac8bacadcf-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-720789-846cbdfbbf-td6rg\" (UID: \"33688555-96cc-427b-85b7-87ac8bacadcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-720789-846cbdfbbf-td6rg"
Sep 08 04:20:02.325138 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:02.324950    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33688555-96cc-427b-85b7-87ac8bacadcf-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-720789-846cbdfbbf-td6rg\" (UID: \"33688555-96cc-427b-85b7-87ac8bacadcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-720789-846cbdfbbf-td6rg"
Sep 08 04:20:02.325138 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:02.325062    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/33688555-96cc-427b-85b7-87ac8bacadcf-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-720789-846cbdfbbf-td6rg\" (UID: \"33688555-96cc-427b-85b7-87ac8bacadcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-720789-846cbdfbbf-td6rg"
Sep 08 04:20:02.325283 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:02.325149    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc87t\" (UniqueName: \"kubernetes.io/projected/33688555-96cc-427b-85b7-87ac8bacadcf-kube-api-access-zc87t\") pod \"maas-api-e2e-shared-b-w3-720789-846cbdfbbf-td6rg\" (UID: \"33688555-96cc-427b-85b7-87ac8bacadcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-720789-846cbdfbbf-td6rg"
Sep 08 04:20:02.426456 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:02.426429    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/33688555-96cc-427b-85b7-87ac8bacadcf-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-720789-846cbdfbbf-td6rg\" (UID: \"33688555-96cc-427b-85b7-87ac8bacadcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-720789-846cbdfbbf-td6rg"
Sep 08 04:20:02.426646 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:02.426488    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zc87t\" (UniqueName: \"kubernetes.io/projected/33688555-96cc-427b-85b7-87ac8bacadcf-kube-api-access-zc87t\") pod \"maas-api-e2e-shared-b-w3-720789-846cbdfbbf-td6rg\" (UID: \"33688555-96cc-427b-85b7-87ac8bacadcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-720789-846cbdfbbf-td6rg"
Sep 08 04:20:02.426646 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:02.426548    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33688555-96cc-427b-85b7-87ac8bacadcf-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-720789-846cbdfbbf-td6rg\" (UID: \"33688555-96cc-427b-85b7-87ac8bacadcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-720789-846cbdfbbf-td6rg"
Sep 08 04:20:02.426646 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:02.426606    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33688555-96cc-427b-85b7-87ac8bacadcf-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-720789-846cbdfbbf-td6rg\" (UID: \"33688555-96cc-427b-85b7-87ac8bacadcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-720789-846cbdfbbf-td6rg"
Sep 08 04:20:02.427371 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:02.427343    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33688555-96cc-427b-85b7-87ac8bacadcf-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-720789-846cbdfbbf-td6rg\" (UID: \"33688555-96cc-427b-85b7-87ac8bacadcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-720789-846cbdfbbf-td6rg"
Sep 08 04:20:02.429282 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:02.429258    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/33688555-96cc-427b-85b7-87ac8bacadcf-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-720789-846cbdfbbf-td6rg\" (UID: \"33688555-96cc-427b-85b7-87ac8bacadcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-720789-846cbdfbbf-td6rg"
Sep 08 04:20:02.429643 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:02.429623    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33688555-96cc-427b-85b7-87ac8bacadcf-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-720789-846cbdfbbf-td6rg\" (UID: \"33688555-96cc-427b-85b7-87ac8bacadcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-720789-846cbdfbbf-td6rg"
Sep 08 04:20:02.435937 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:02.435913    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc87t\" (UniqueName: \"kubernetes.io/projected/33688555-96cc-427b-85b7-87ac8bacadcf-kube-api-access-zc87t\") pod \"maas-api-e2e-shared-b-w3-720789-846cbdfbbf-td6rg\" (UID: \"33688555-96cc-427b-85b7-87ac8bacadcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-720789-846cbdfbbf-td6rg"
Sep 08 04:20:02.522661 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:02.522627    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-720789-846cbdfbbf-td6rg"
Sep 08 04:20:02.809141 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:02.809105    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-720789-846cbdfbbf-td6rg"]
Sep 08 04:20:02.812512 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:20:02.812486    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33688555_96cc_427b_85b7_87ac8bacadcf.slice/crio-798338a7523b472011cc7189fe4a7b6abca5dac43a23c1087dfd70c7b6539942 WatchSource:0}: Error finding container 798338a7523b472011cc7189fe4a7b6abca5dac43a23c1087dfd70c7b6539942: Status 404 returned error can't find the container with id 798338a7523b472011cc7189fe4a7b6abca5dac43a23c1087dfd70c7b6539942
Sep 08 04:20:03.014306 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:03.014019    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": read tcp 10.134.0.2:49610->10.134.0.65:15021: read: connection reset by peer" start-of-body=
Sep 08 04:20:03.014306 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:03.014082    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj" podUID="bfa75482-045d-4f12-ae36-70f877cb348f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": read tcp 10.134.0.2:49610->10.134.0.65:15021: read: connection reset by peer"
Sep 08 04:20:03.152593 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:03.152490    2573 generic.go:356] "Generic (PLEG): container finished" podID="bfa75482-045d-4f12-ae36-70f877cb348f" containerID="1a6a1e9d356948bfa6427c1bbff4b085ecdb9580d6b927ff424be3d0ff6300ee" exitCode=0
Sep 08 04:20:03.152758 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:03.152594    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj" event={"ID":"bfa75482-045d-4f12-ae36-70f877cb348f","Type":"ContainerDied","Data":"1a6a1e9d356948bfa6427c1bbff4b085ecdb9580d6b927ff424be3d0ff6300ee"}
Sep 08 04:20:03.153127 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:03.153107    2573 scope.go:117] "RemoveContainer" containerID="1a6a1e9d356948bfa6427c1bbff4b085ecdb9580d6b927ff424be3d0ff6300ee"
Sep 08 04:20:03.153979 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:03.153959    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-720789-846cbdfbbf-td6rg" event={"ID":"33688555-96cc-427b-85b7-87ac8bacadcf","Type":"ContainerStarted","Data":"798338a7523b472011cc7189fe4a7b6abca5dac43a23c1087dfd70c7b6539942"}
Sep 08 04:20:03.154391 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:03.154361    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:20:03.154471 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:03.154428    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:20:03.154471 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:03.154455    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:20:04.161829 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:04.161788    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj" event={"ID":"bfa75482-045d-4f12-ae36-70f877cb348f","Type":"ContainerStarted","Data":"35043aab23f7587bf82222ba400ce2db64cabc0c9366c2e471f1585400e32c32"}
Sep 08 04:20:04.163476 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:04.163450    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-720789-846cbdfbbf-td6rg" event={"ID":"33688555-96cc-427b-85b7-87ac8bacadcf","Type":"ContainerStarted","Data":"dda109ef67a24177ff11dfc3a16438c0bd31e60a4f2ce4dac4e96869c894f704"}
Sep 08 04:20:04.163625 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:04.163545    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-720789-846cbdfbbf-td6rg"
Sep 08 04:20:04.203199 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:04.203146    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-720789-846cbdfbbf-td6rg" podStartSLOduration=1.5149857340000001 podStartE2EDuration="2.203129842s" totalImagesPullingTime="688.144108ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:20:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:20:04.202189269 +0000 UTC m=+1163.987480506" watchObservedRunningTime="2026-09-08 04:20:04.203129842 +0000 UTC m=+1163.988421077"
Sep 08 04:20:04.623489 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:04.623445    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"
Sep 08 04:20:04.623746 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:04.623718    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 08 04:20:04.623833 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:04.623783    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj" podUID="bfa75482-045d-4f12-ae36-70f877cb348f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 08 04:20:05.624199 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:05.624168    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 08 04:20:05.624576 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:05.624223    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj" podUID="bfa75482-045d-4f12-ae36-70f877cb348f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 08 04:20:06.623978 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:06.623941    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 08 04:20:06.624162 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:06.623996    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj" podUID="bfa75482-045d-4f12-ae36-70f877cb348f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 08 04:20:07.623200 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:07.623163    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 08 04:20:07.623790 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:07.623227    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj" podUID="bfa75482-045d-4f12-ae36-70f877cb348f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 08 04:20:08.623654 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:08.623622    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 08 04:20:08.624042 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:08.623675    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj" podUID="bfa75482-045d-4f12-ae36-70f877cb348f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 08 04:20:09.624066 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:09.624025    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 08 04:20:09.624448 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:09.624100    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj" podUID="bfa75482-045d-4f12-ae36-70f877cb348f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 08 04:20:10.174786 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:10.174760    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-720789-846cbdfbbf-td6rg"
Sep 08 04:20:10.707464 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:10.707423    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"
Sep 08 04:20:10.707962 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:10.707879    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"
Sep 08 04:20:10.708713 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:10.708690    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"
Sep 08 04:20:20.264450 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:20.264416    2573 generic.go:356] "Generic (PLEG): container finished" podID="fa8e3e75-f6f5-4d8c-97b2-23ec87f78415" containerID="681f017f7d1a544106c1c437dba09c77703452752dd47b386430e864a8e31350" exitCode=0
Sep 08 04:20:20.264850 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:20.264488    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl" event={"ID":"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415","Type":"ContainerDied","Data":"681f017f7d1a544106c1c437dba09c77703452752dd47b386430e864a8e31350"}
Sep 08 04:20:20.264893 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:20.264879    2573 scope.go:117] "RemoveContainer" containerID="681f017f7d1a544106c1c437dba09c77703452752dd47b386430e864a8e31350"
Sep 08 04:20:20.266139 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:20.266105    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:20:20.266253 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:20.266193    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:20:20.266317 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:20.266254    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:20:21.272167 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:21.272131    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl" event={"ID":"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415","Type":"ContainerStarted","Data":"c27242511111864c9850fb04be17a2c5f9d0c93c70419387846f7f03931c9bdf"}
Sep 08 04:20:21.454120 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:21.454083    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"
Sep 08 04:20:21.454316 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:21.454293    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 08 04:20:21.454361 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:21.454347    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl" podUID="fa8e3e75-f6f5-4d8c-97b2-23ec87f78415" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 08 04:20:22.454020 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:22.453990    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 08 04:20:22.454396 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:22.454043    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl" podUID="fa8e3e75-f6f5-4d8c-97b2-23ec87f78415" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 08 04:20:23.454342 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:23.454300    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 08 04:20:23.454846 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:23.454365    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl" podUID="fa8e3e75-f6f5-4d8c-97b2-23ec87f78415" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 08 04:20:24.454440 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:24.454405    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 08 04:20:24.454899 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:24.454469    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl" podUID="fa8e3e75-f6f5-4d8c-97b2-23ec87f78415" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 08 04:20:25.454150 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:25.454114    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 08 04:20:25.454336 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:25.454170    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl" podUID="fa8e3e75-f6f5-4d8c-97b2-23ec87f78415" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 08 04:20:26.564464 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:26.564432    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"
Sep 08 04:20:26.565467 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:26.565438    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"
Sep 08 04:20:26.566687 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:26.566664    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"
Sep 08 04:20:27.439787 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:27.439757    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"]
Sep 08 04:20:27.442843 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:27.442822    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"
Sep 08 04:20:27.446034 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:27.446017    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-777fbd7c-openshift-default-dockercfg-5dvvq\""
Sep 08 04:20:27.466142 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:27.466115    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"]
Sep 08 04:20:27.514371 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:27.514339    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/311b1421-c8b9-47c0-8c05-09737ae76db7-istio-envoy\") pod \"e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5\" (UID: \"311b1421-c8b9-47c0-8c05-09737ae76db7\") " pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"
Sep 08 04:20:27.514371 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:27.514373    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/311b1421-c8b9-47c0-8c05-09737ae76db7-istiod-ca-cert\") pod \"e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5\" (UID: \"311b1421-c8b9-47c0-8c05-09737ae76db7\") " pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"
Sep 08 04:20:27.514548 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:27.514402    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/311b1421-c8b9-47c0-8c05-09737ae76db7-credential-socket\") pod \"e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5\" (UID: \"311b1421-c8b9-47c0-8c05-09737ae76db7\") " pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"
Sep 08 04:20:27.514548 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:27.514482    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/311b1421-c8b9-47c0-8c05-09737ae76db7-istio-data\") pod \"e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5\" (UID: \"311b1421-c8b9-47c0-8c05-09737ae76db7\") " pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"
Sep 08 04:20:27.514548 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:27.514510    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxdpp\" (UniqueName: \"kubernetes.io/projected/311b1421-c8b9-47c0-8c05-09737ae76db7-kube-api-access-fxdpp\") pod \"e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5\" (UID: \"311b1421-c8b9-47c0-8c05-09737ae76db7\") " pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"
Sep 08 04:20:27.514548 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:27.514541    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/311b1421-c8b9-47c0-8c05-09737ae76db7-istio-podinfo\") pod \"e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5\" (UID: \"311b1421-c8b9-47c0-8c05-09737ae76db7\") " pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"
Sep 08 04:20:27.514729 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:27.514609    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/311b1421-c8b9-47c0-8c05-09737ae76db7-istio-token\") pod \"e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5\" (UID: \"311b1421-c8b9-47c0-8c05-09737ae76db7\") " pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"
Sep 08 04:20:27.514729 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:27.514633    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/311b1421-c8b9-47c0-8c05-09737ae76db7-workload-certs\") pod \"e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5\" (UID: \"311b1421-c8b9-47c0-8c05-09737ae76db7\") " pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"
Sep 08 04:20:27.514729 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:27.514701    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/311b1421-c8b9-47c0-8c05-09737ae76db7-workload-socket\") pod \"e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5\" (UID: \"311b1421-c8b9-47c0-8c05-09737ae76db7\") " pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"
Sep 08 04:20:27.616066 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:27.616032    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/311b1421-c8b9-47c0-8c05-09737ae76db7-workload-socket\") pod \"e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5\" (UID: \"311b1421-c8b9-47c0-8c05-09737ae76db7\") " pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"
Sep 08 04:20:27.616506 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:27.616084    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/311b1421-c8b9-47c0-8c05-09737ae76db7-istio-envoy\") pod \"e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5\" (UID: \"311b1421-c8b9-47c0-8c05-09737ae76db7\") " pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"
Sep 08 04:20:27.616506 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:27.616101    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/311b1421-c8b9-47c0-8c05-09737ae76db7-istiod-ca-cert\") pod \"e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5\" (UID: \"311b1421-c8b9-47c0-8c05-09737ae76db7\") " pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"
Sep 08 04:20:27.616506 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:27.616126    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/311b1421-c8b9-47c0-8c05-09737ae76db7-credential-socket\") pod \"e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5\" (UID: \"311b1421-c8b9-47c0-8c05-09737ae76db7\") " pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"
Sep 08 04:20:27.616506 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:27.616159    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/311b1421-c8b9-47c0-8c05-09737ae76db7-istio-data\") pod \"e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5\" (UID: \"311b1421-c8b9-47c0-8c05-09737ae76db7\") " pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"
Sep 08 04:20:27.616506 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:27.616179    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxdpp\" (UniqueName: \"kubernetes.io/projected/311b1421-c8b9-47c0-8c05-09737ae76db7-kube-api-access-fxdpp\") pod \"e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5\" (UID: \"311b1421-c8b9-47c0-8c05-09737ae76db7\") " pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"
Sep 08 04:20:27.616506 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:27.616211    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/311b1421-c8b9-47c0-8c05-09737ae76db7-istio-podinfo\") pod \"e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5\" (UID: \"311b1421-c8b9-47c0-8c05-09737ae76db7\") " pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"
Sep 08 04:20:27.616506 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:27.616315    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/311b1421-c8b9-47c0-8c05-09737ae76db7-istio-token\") pod \"e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5\" (UID: \"311b1421-c8b9-47c0-8c05-09737ae76db7\") " pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"
Sep 08 04:20:27.616506 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:27.616363    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/311b1421-c8b9-47c0-8c05-09737ae76db7-workload-certs\") pod \"e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5\" (UID: \"311b1421-c8b9-47c0-8c05-09737ae76db7\") " pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"
Sep 08 04:20:27.616506 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:27.616471    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/311b1421-c8b9-47c0-8c05-09737ae76db7-workload-socket\") pod \"e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5\" (UID: \"311b1421-c8b9-47c0-8c05-09737ae76db7\") " pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"
Sep 08 04:20:27.617036 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:27.616764    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/311b1421-c8b9-47c0-8c05-09737ae76db7-istio-data\") pod \"e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5\" (UID: \"311b1421-c8b9-47c0-8c05-09737ae76db7\") " pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"
Sep 08 04:20:27.617036 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:27.616879    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/311b1421-c8b9-47c0-8c05-09737ae76db7-workload-certs\") pod \"e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5\" (UID: \"311b1421-c8b9-47c0-8c05-09737ae76db7\") " pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"
Sep 08 04:20:27.617036 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:27.616885    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/311b1421-c8b9-47c0-8c05-09737ae76db7-istiod-ca-cert\") pod \"e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5\" (UID: \"311b1421-c8b9-47c0-8c05-09737ae76db7\") " pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"
Sep 08 04:20:27.617036 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:27.616985    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/311b1421-c8b9-47c0-8c05-09737ae76db7-credential-socket\") pod \"e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5\" (UID: \"311b1421-c8b9-47c0-8c05-09737ae76db7\") " pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"
Sep 08 04:20:27.618523 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:27.618506    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/311b1421-c8b9-47c0-8c05-09737ae76db7-istio-envoy\") pod \"e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5\" (UID: \"311b1421-c8b9-47c0-8c05-09737ae76db7\") " pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"
Sep 08 04:20:27.618930 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:27.618908    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/311b1421-c8b9-47c0-8c05-09737ae76db7-istio-podinfo\") pod \"e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5\" (UID: \"311b1421-c8b9-47c0-8c05-09737ae76db7\") " pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"
Sep 08 04:20:27.628661 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:27.628638    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/311b1421-c8b9-47c0-8c05-09737ae76db7-istio-token\") pod \"e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5\" (UID: \"311b1421-c8b9-47c0-8c05-09737ae76db7\") " pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"
Sep 08 04:20:27.629870 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:27.629852    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxdpp\" (UniqueName: \"kubernetes.io/projected/311b1421-c8b9-47c0-8c05-09737ae76db7-kube-api-access-fxdpp\") pod \"e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5\" (UID: \"311b1421-c8b9-47c0-8c05-09737ae76db7\") " pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"
Sep 08 04:20:27.753106 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:27.753081    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"
Sep 08 04:20:28.041382 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:28.041359    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"]
Sep 08 04:20:28.043029 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:20:28.043004    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod311b1421_c8b9_47c0_8c05_09737ae76db7.slice/crio-6441686989b8a527cee9e491d864abe93c7d3be231d4ccf0128f02c2d423d2d9 WatchSource:0}: Error finding container 6441686989b8a527cee9e491d864abe93c7d3be231d4ccf0128f02c2d423d2d9: Status 404 returned error can't find the container with id 6441686989b8a527cee9e491d864abe93c7d3be231d4ccf0128f02c2d423d2d9
Sep 08 04:20:28.045274 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:28.045242    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:20:28.045336 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:28.045308    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:20:28.045371 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:28.045335    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:20:28.319529 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:28.319435    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5" event={"ID":"311b1421-c8b9-47c0-8c05-09737ae76db7","Type":"ContainerStarted","Data":"fb95f269a0a2df56eb40eca807bb73d739f3cdc6b6b52f2ab1e8f075cc019118"}
Sep 08 04:20:28.319529 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:28.319500    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5" event={"ID":"311b1421-c8b9-47c0-8c05-09737ae76db7","Type":"ContainerStarted","Data":"6441686989b8a527cee9e491d864abe93c7d3be231d4ccf0128f02c2d423d2d9"}
Sep 08 04:20:28.350195 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:28.350136    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5" podStartSLOduration=1.350115675 podStartE2EDuration="1.350115675s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:20:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:20:28.346105584 +0000 UTC m=+1188.131396821" watchObservedRunningTime="2026-09-08 04:20:28.350115675 +0000 UTC m=+1188.135406912"
Sep 08 04:20:28.754120 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:28.754093    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"
Sep 08 04:20:29.764155 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:29.764122    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"
Sep 08 04:20:30.332788 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:30.332761    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"
Sep 08 04:20:30.333853 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:30.333830    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"
Sep 08 04:20:46.374753 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:46.374709    2573 patch_prober.go:28] interesting pod/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 04:20:46.375253 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:46.374776    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5" podUID="311b1421-c8b9-47c0-8c05-09737ae76db7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 04:20:48.461000 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:48.460907    2573 generic.go:356] "Generic (PLEG): container finished" podID="311b1421-c8b9-47c0-8c05-09737ae76db7" containerID="fb95f269a0a2df56eb40eca807bb73d739f3cdc6b6b52f2ab1e8f075cc019118" exitCode=0
Sep 08 04:20:48.461000 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:48.460986    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5" event={"ID":"311b1421-c8b9-47c0-8c05-09737ae76db7","Type":"ContainerDied","Data":"fb95f269a0a2df56eb40eca807bb73d739f3cdc6b6b52f2ab1e8f075cc019118"}
Sep 08 04:20:48.461399 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:48.461386    2573 scope.go:117] "RemoveContainer" containerID="fb95f269a0a2df56eb40eca807bb73d739f3cdc6b6b52f2ab1e8f075cc019118"
Sep 08 04:20:48.462570 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:48.462528    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:20:48.462635 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:48.462616    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:20:48.462675 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:48.462652    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:20:49.468945 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:49.468909    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5" event={"ID":"311b1421-c8b9-47c0-8c05-09737ae76db7","Type":"ContainerStarted","Data":"13e7a3bf07d2be01bfb3b75b91a75f33483887bb3a6d7d06dfd2453bf66cf98f"}
Sep 08 04:20:49.754259 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:49.754220    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"
Sep 08 04:20:49.754467 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:49.754446    2573 patch_prober.go:28] interesting pod/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 08 04:20:49.754517 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:49.754496    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5" podUID="311b1421-c8b9-47c0-8c05-09737ae76db7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 08 04:20:50.753477 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:50.753440    2573 patch_prober.go:28] interesting pod/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 08 04:20:50.753862 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:50.753498    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5" podUID="311b1421-c8b9-47c0-8c05-09737ae76db7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 08 04:20:51.753377 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:51.753343    2573 patch_prober.go:28] interesting pod/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 08 04:20:51.753539 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:51.753395    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5" podUID="311b1421-c8b9-47c0-8c05-09737ae76db7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 08 04:20:52.753868 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:52.753833    2573 patch_prober.go:28] interesting pod/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 08 04:20:52.754452 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:52.753887    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5" podUID="311b1421-c8b9-47c0-8c05-09737ae76db7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 08 04:20:53.753663 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:53.753621    2573 patch_prober.go:28] interesting pod/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 08 04:20:53.753834 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:53.753686    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5" podUID="311b1421-c8b9-47c0-8c05-09737ae76db7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 08 04:20:54.753715 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:54.753679    2573 patch_prober.go:28] interesting pod/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 08 04:20:54.754071 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:54.753735    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5" podUID="311b1421-c8b9-47c0-8c05-09737ae76db7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 08 04:20:55.757823 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:55.757789    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"
Sep 08 04:20:55.758187 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:55.758074    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"
Sep 08 04:20:55.758694 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:20:55.758678    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"
Sep 08 04:21:40.779044 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:21:40.778965    2573 scope.go:117] "RemoveContainer" containerID="7b58ecc7d6d2044a4ca42af0eabfddb85b2e7c7a8c2b24fb59cfe5d23b8efbc8"
Sep 08 04:23:33.359230 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:33.359198    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"]
Sep 08 04:23:33.359766 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:33.359462    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5" podUID="311b1421-c8b9-47c0-8c05-09737ae76db7" containerName="istio-proxy" containerID="cri-o://13e7a3bf07d2be01bfb3b75b91a75f33483887bb3a6d7d06dfd2453bf66cf98f" gracePeriod=30
Sep 08 04:23:38.620634 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:38.620579    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"
Sep 08 04:23:38.731980 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:38.731955    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/311b1421-c8b9-47c0-8c05-09737ae76db7-credential-socket\") pod \"311b1421-c8b9-47c0-8c05-09737ae76db7\" (UID: \"311b1421-c8b9-47c0-8c05-09737ae76db7\") "
Sep 08 04:23:38.732138 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:38.732010    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/311b1421-c8b9-47c0-8c05-09737ae76db7-istio-data\") pod \"311b1421-c8b9-47c0-8c05-09737ae76db7\" (UID: \"311b1421-c8b9-47c0-8c05-09737ae76db7\") "
Sep 08 04:23:38.732138 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:38.732075    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/311b1421-c8b9-47c0-8c05-09737ae76db7-istio-podinfo\") pod \"311b1421-c8b9-47c0-8c05-09737ae76db7\" (UID: \"311b1421-c8b9-47c0-8c05-09737ae76db7\") "
Sep 08 04:23:38.732138 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:38.732099    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/311b1421-c8b9-47c0-8c05-09737ae76db7-istiod-ca-cert\") pod \"311b1421-c8b9-47c0-8c05-09737ae76db7\" (UID: \"311b1421-c8b9-47c0-8c05-09737ae76db7\") "
Sep 08 04:23:38.732138 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:38.732120    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/311b1421-c8b9-47c0-8c05-09737ae76db7-workload-certs\") pod \"311b1421-c8b9-47c0-8c05-09737ae76db7\" (UID: \"311b1421-c8b9-47c0-8c05-09737ae76db7\") "
Sep 08 04:23:38.732328 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:38.732145    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/311b1421-c8b9-47c0-8c05-09737ae76db7-istio-envoy\") pod \"311b1421-c8b9-47c0-8c05-09737ae76db7\" (UID: \"311b1421-c8b9-47c0-8c05-09737ae76db7\") "
Sep 08 04:23:38.732328 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:38.732175    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/311b1421-c8b9-47c0-8c05-09737ae76db7-workload-socket\") pod \"311b1421-c8b9-47c0-8c05-09737ae76db7\" (UID: \"311b1421-c8b9-47c0-8c05-09737ae76db7\") "
Sep 08 04:23:38.732328 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:38.732223    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxdpp\" (UniqueName: \"kubernetes.io/projected/311b1421-c8b9-47c0-8c05-09737ae76db7-kube-api-access-fxdpp\") pod \"311b1421-c8b9-47c0-8c05-09737ae76db7\" (UID: \"311b1421-c8b9-47c0-8c05-09737ae76db7\") "
Sep 08 04:23:38.732328 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:38.732265    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/311b1421-c8b9-47c0-8c05-09737ae76db7-istio-token\") pod \"311b1421-c8b9-47c0-8c05-09737ae76db7\" (UID: \"311b1421-c8b9-47c0-8c05-09737ae76db7\") "
Sep 08 04:23:38.732534 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:38.732219    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/311b1421-c8b9-47c0-8c05-09737ae76db7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "311b1421-c8b9-47c0-8c05-09737ae76db7" (UID: "311b1421-c8b9-47c0-8c05-09737ae76db7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:23:38.732534 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:38.732321    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/311b1421-c8b9-47c0-8c05-09737ae76db7-istio-data" (OuterVolumeSpecName: "istio-data") pod "311b1421-c8b9-47c0-8c05-09737ae76db7" (UID: "311b1421-c8b9-47c0-8c05-09737ae76db7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:23:38.732534 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:38.732471    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/311b1421-c8b9-47c0-8c05-09737ae76db7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "311b1421-c8b9-47c0-8c05-09737ae76db7" (UID: "311b1421-c8b9-47c0-8c05-09737ae76db7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:23:38.732534 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:38.732510    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/311b1421-c8b9-47c0-8c05-09737ae76db7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "311b1421-c8b9-47c0-8c05-09737ae76db7" (UID: "311b1421-c8b9-47c0-8c05-09737ae76db7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 04:23:38.732792 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:38.732697    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/311b1421-c8b9-47c0-8c05-09737ae76db7-credential-socket\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:23:38.732792 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:38.732713    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/311b1421-c8b9-47c0-8c05-09737ae76db7-istio-data\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:23:38.732792 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:38.732731    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/311b1421-c8b9-47c0-8c05-09737ae76db7-istiod-ca-cert\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:23:38.732792 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:38.732746    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/311b1421-c8b9-47c0-8c05-09737ae76db7-workload-socket\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:23:38.732792 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:38.732686    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/311b1421-c8b9-47c0-8c05-09737ae76db7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "311b1421-c8b9-47c0-8c05-09737ae76db7" (UID: "311b1421-c8b9-47c0-8c05-09737ae76db7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:23:38.734620 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:38.734598    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/311b1421-c8b9-47c0-8c05-09737ae76db7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "311b1421-c8b9-47c0-8c05-09737ae76db7" (UID: "311b1421-c8b9-47c0-8c05-09737ae76db7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:23:38.734719 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:38.734622    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/311b1421-c8b9-47c0-8c05-09737ae76db7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "311b1421-c8b9-47c0-8c05-09737ae76db7" (UID: "311b1421-c8b9-47c0-8c05-09737ae76db7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 04:23:38.734719 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:38.734629    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/311b1421-c8b9-47c0-8c05-09737ae76db7-kube-api-access-fxdpp" (OuterVolumeSpecName: "kube-api-access-fxdpp") pod "311b1421-c8b9-47c0-8c05-09737ae76db7" (UID: "311b1421-c8b9-47c0-8c05-09737ae76db7"). InnerVolumeSpecName "kube-api-access-fxdpp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:23:38.734719 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:38.734660    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/311b1421-c8b9-47c0-8c05-09737ae76db7-istio-token" (OuterVolumeSpecName: "istio-token") pod "311b1421-c8b9-47c0-8c05-09737ae76db7" (UID: "311b1421-c8b9-47c0-8c05-09737ae76db7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:23:38.834034 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:38.834007    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/311b1421-c8b9-47c0-8c05-09737ae76db7-istio-podinfo\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:23:38.834034 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:38.834032    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/311b1421-c8b9-47c0-8c05-09737ae76db7-workload-certs\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:23:38.834034 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:38.834043    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/311b1421-c8b9-47c0-8c05-09737ae76db7-istio-envoy\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:23:38.834232 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:38.834052    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxdpp\" (UniqueName: \"kubernetes.io/projected/311b1421-c8b9-47c0-8c05-09737ae76db7-kube-api-access-fxdpp\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:23:38.834232 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:38.834060    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/311b1421-c8b9-47c0-8c05-09737ae76db7-istio-token\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:23:39.467227 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:39.467191    2573 generic.go:356] "Generic (PLEG): container finished" podID="311b1421-c8b9-47c0-8c05-09737ae76db7" containerID="13e7a3bf07d2be01bfb3b75b91a75f33483887bb3a6d7d06dfd2453bf66cf98f" exitCode=0
Sep 08 04:23:39.467402 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:39.467247    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"
Sep 08 04:23:39.467402 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:39.467275    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5" event={"ID":"311b1421-c8b9-47c0-8c05-09737ae76db7","Type":"ContainerDied","Data":"13e7a3bf07d2be01bfb3b75b91a75f33483887bb3a6d7d06dfd2453bf66cf98f"}
Sep 08 04:23:39.467402 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:39.467333    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5" event={"ID":"311b1421-c8b9-47c0-8c05-09737ae76db7","Type":"ContainerDied","Data":"6441686989b8a527cee9e491d864abe93c7d3be231d4ccf0128f02c2d423d2d9"}
Sep 08 04:23:39.467402 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:39.467360    2573 scope.go:117] "RemoveContainer" containerID="13e7a3bf07d2be01bfb3b75b91a75f33483887bb3a6d7d06dfd2453bf66cf98f"
Sep 08 04:23:39.478208 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:39.478032    2573 scope.go:117] "RemoveContainer" containerID="fb95f269a0a2df56eb40eca807bb73d739f3cdc6b6b52f2ab1e8f075cc019118"
Sep 08 04:23:39.486381 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:39.486357    2573 scope.go:117] "RemoveContainer" containerID="13e7a3bf07d2be01bfb3b75b91a75f33483887bb3a6d7d06dfd2453bf66cf98f"
Sep 08 04:23:39.486675 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:23:39.486654    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13e7a3bf07d2be01bfb3b75b91a75f33483887bb3a6d7d06dfd2453bf66cf98f\": container with ID starting with 13e7a3bf07d2be01bfb3b75b91a75f33483887bb3a6d7d06dfd2453bf66cf98f not found: ID does not exist" containerID="13e7a3bf07d2be01bfb3b75b91a75f33483887bb3a6d7d06dfd2453bf66cf98f"
Sep 08 04:23:39.486751 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:39.486682    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13e7a3bf07d2be01bfb3b75b91a75f33483887bb3a6d7d06dfd2453bf66cf98f"} err="failed to get container status \"13e7a3bf07d2be01bfb3b75b91a75f33483887bb3a6d7d06dfd2453bf66cf98f\": rpc error: code = NotFound desc = could not find container \"13e7a3bf07d2be01bfb3b75b91a75f33483887bb3a6d7d06dfd2453bf66cf98f\": container with ID starting with 13e7a3bf07d2be01bfb3b75b91a75f33483887bb3a6d7d06dfd2453bf66cf98f not found: ID does not exist"
Sep 08 04:23:39.486751 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:39.486699    2573 scope.go:117] "RemoveContainer" containerID="fb95f269a0a2df56eb40eca807bb73d739f3cdc6b6b52f2ab1e8f075cc019118"
Sep 08 04:23:39.486951 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:23:39.486933    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb95f269a0a2df56eb40eca807bb73d739f3cdc6b6b52f2ab1e8f075cc019118\": container with ID starting with fb95f269a0a2df56eb40eca807bb73d739f3cdc6b6b52f2ab1e8f075cc019118 not found: ID does not exist" containerID="fb95f269a0a2df56eb40eca807bb73d739f3cdc6b6b52f2ab1e8f075cc019118"
Sep 08 04:23:39.487007 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:39.486957    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb95f269a0a2df56eb40eca807bb73d739f3cdc6b6b52f2ab1e8f075cc019118"} err="failed to get container status \"fb95f269a0a2df56eb40eca807bb73d739f3cdc6b6b52f2ab1e8f075cc019118\": rpc error: code = NotFound desc = could not find container \"fb95f269a0a2df56eb40eca807bb73d739f3cdc6b6b52f2ab1e8f075cc019118\": container with ID starting with fb95f269a0a2df56eb40eca807bb73d739f3cdc6b6b52f2ab1e8f075cc019118 not found: ID does not exist"
Sep 08 04:23:39.490849 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:39.490827    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"]
Sep 08 04:23:39.496614 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:39.496594    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5"]
Sep 08 04:23:40.676815 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:23:40.676785    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="311b1421-c8b9-47c0-8c05-09737ae76db7" path="/var/lib/kubelet/pods/311b1421-c8b9-47c0-8c05-09737ae76db7/volumes"
Sep 08 04:24:28.826743 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:28.826713    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"]
Sep 08 04:24:28.827211 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:28.827198    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="311b1421-c8b9-47c0-8c05-09737ae76db7" containerName="istio-proxy"
Sep 08 04:24:28.827255 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:28.827213    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="311b1421-c8b9-47c0-8c05-09737ae76db7" containerName="istio-proxy"
Sep 08 04:24:28.827255 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:28.827223    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="311b1421-c8b9-47c0-8c05-09737ae76db7" containerName="istio-proxy"
Sep 08 04:24:28.827255 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:28.827228    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="311b1421-c8b9-47c0-8c05-09737ae76db7" containerName="istio-proxy"
Sep 08 04:24:28.827346 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:28.827305    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="311b1421-c8b9-47c0-8c05-09737ae76db7" containerName="istio-proxy"
Sep 08 04:24:28.827346 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:28.827316    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="311b1421-c8b9-47c0-8c05-09737ae76db7" containerName="istio-proxy"
Sep 08 04:24:28.830746 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:28.830725    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"
Sep 08 04:24:28.833827 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:28.833805    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-dab019-openshift-default-dockercfg-65625\""
Sep 08 04:24:28.850138 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:28.850116    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"]
Sep 08 04:24:28.916465 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:28.916429    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbdm2\" (UniqueName: \"kubernetes.io/projected/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-kube-api-access-kbdm2\") pod \"e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc\" (UID: \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\") " pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"
Sep 08 04:24:28.916677 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:28.916480    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-istiod-ca-cert\") pod \"e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc\" (UID: \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\") " pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"
Sep 08 04:24:28.916677 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:28.916520    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-workload-socket\") pod \"e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc\" (UID: \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\") " pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"
Sep 08 04:24:28.916677 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:28.916581    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-istio-data\") pod \"e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc\" (UID: \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\") " pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"
Sep 08 04:24:28.916677 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:28.916611    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-workload-certs\") pod \"e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc\" (UID: \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\") " pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"
Sep 08 04:24:28.916677 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:28.916632    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-istio-podinfo\") pod \"e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc\" (UID: \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\") " pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"
Sep 08 04:24:28.916947 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:28.916747    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-credential-socket\") pod \"e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc\" (UID: \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\") " pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"
Sep 08 04:24:28.916947 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:28.916789    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-istio-token\") pod \"e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc\" (UID: \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\") " pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"
Sep 08 04:24:28.916947 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:28.916856    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-istio-envoy\") pod \"e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc\" (UID: \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\") " pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"
Sep 08 04:24:29.017573 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:29.017535    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-istiod-ca-cert\") pod \"e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc\" (UID: \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\") " pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"
Sep 08 04:24:29.017776 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:29.017635    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-workload-socket\") pod \"e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc\" (UID: \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\") " pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"
Sep 08 04:24:29.017776 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:29.017669    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-istio-data\") pod \"e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc\" (UID: \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\") " pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"
Sep 08 04:24:29.017776 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:29.017715    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-workload-certs\") pod \"e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc\" (UID: \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\") " pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"
Sep 08 04:24:29.017776 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:29.017750    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-istio-podinfo\") pod \"e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc\" (UID: \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\") " pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"
Sep 08 04:24:29.017996 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:29.017824    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-credential-socket\") pod \"e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc\" (UID: \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\") " pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"
Sep 08 04:24:29.017996 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:29.017855    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-istio-token\") pod \"e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc\" (UID: \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\") " pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"
Sep 08 04:24:29.017996 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:29.017928    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-istio-envoy\") pod \"e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc\" (UID: \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\") " pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"
Sep 08 04:24:29.018142 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:29.017999    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbdm2\" (UniqueName: \"kubernetes.io/projected/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-kube-api-access-kbdm2\") pod \"e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc\" (UID: \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\") " pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"
Sep 08 04:24:29.018142 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:29.018055    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-workload-socket\") pod \"e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc\" (UID: \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\") " pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"
Sep 08 04:24:29.018142 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:29.018113    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-workload-certs\") pod \"e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc\" (UID: \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\") " pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"
Sep 08 04:24:29.018289 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:29.018143    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-istio-data\") pod \"e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc\" (UID: \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\") " pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"
Sep 08 04:24:29.018289 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:29.018199    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-credential-socket\") pod \"e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc\" (UID: \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\") " pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"
Sep 08 04:24:29.018408 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:29.018337    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-istiod-ca-cert\") pod \"e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc\" (UID: \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\") " pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"
Sep 08 04:24:29.020338 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:29.020310    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-istio-envoy\") pod \"e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc\" (UID: \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\") " pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"
Sep 08 04:24:29.020448 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:29.020396    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-istio-podinfo\") pod \"e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc\" (UID: \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\") " pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"
Sep 08 04:24:29.027701 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:29.027674    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbdm2\" (UniqueName: \"kubernetes.io/projected/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-kube-api-access-kbdm2\") pod \"e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc\" (UID: \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\") " pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"
Sep 08 04:24:29.027825 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:29.027805    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-istio-token\") pod \"e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc\" (UID: \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\") " pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"
Sep 08 04:24:29.143103 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:29.143025    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"
Sep 08 04:24:29.424934 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:29.424903    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"]
Sep 08 04:24:29.426519 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:24:29.426491    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98bb97ab_62fb_46fe_8b9a_804a036c1a5a.slice/crio-f312a2ab9954b498afcdb86dd3572aae1d8ef03a813c150b0a33327aef59fd6a WatchSource:0}: Error finding container f312a2ab9954b498afcdb86dd3572aae1d8ef03a813c150b0a33327aef59fd6a: Status 404 returned error can't find the container with id f312a2ab9954b498afcdb86dd3572aae1d8ef03a813c150b0a33327aef59fd6a
Sep 08 04:24:29.428786 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:29.428753    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:24:29.428861 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:29.428818    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:24:29.428861 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:29.428848    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:24:29.775588 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:29.775521    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc" event={"ID":"98bb97ab-62fb-46fe-8b9a-804a036c1a5a","Type":"ContainerStarted","Data":"84b60875068acd2bb51f4ef5f0a4c14b4e23f8a80cb5351788b408b85d3d978d"}
Sep 08 04:24:29.775787 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:29.775604    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc" event={"ID":"98bb97ab-62fb-46fe-8b9a-804a036c1a5a","Type":"ContainerStarted","Data":"f312a2ab9954b498afcdb86dd3572aae1d8ef03a813c150b0a33327aef59fd6a"}
Sep 08 04:24:29.801469 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:29.801404    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc" podStartSLOduration=1.801381854 podStartE2EDuration="1.801381854s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:24:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:24:29.797679375 +0000 UTC m=+1429.582970611" watchObservedRunningTime="2026-09-08 04:24:29.801381854 +0000 UTC m=+1429.586673093"
Sep 08 04:24:30.143894 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:30.143809    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"
Sep 08 04:24:30.149454 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:30.149428    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"
Sep 08 04:24:30.781584 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:30.781530    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"
Sep 08 04:24:30.782609 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:30.782588    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"
Sep 08 04:24:32.852201 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:32.852127    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-dab019-59d96d489b-6gb5g"]
Sep 08 04:24:32.856423 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:32.856395    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dab019-59d96d489b-6gb5g"
Sep 08 04:24:32.858747 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:32.858727    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-dab019-serving-cert\""
Sep 08 04:24:32.868227 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:32.868198    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-dab019-59d96d489b-6gb5g"]
Sep 08 04:24:32.965852 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:32.965814    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d4bb651-f6c3-4973-bcca-d81dc95c029b-maas-api-tls\") pod \"maas-api-e2e-api-a-dab019-59d96d489b-6gb5g\" (UID: \"7d4bb651-f6c3-4973-bcca-d81dc95c029b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dab019-59d96d489b-6gb5g"
Sep 08 04:24:32.966047 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:32.965915    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d4bb651-f6c3-4973-bcca-d81dc95c029b-metrics-certs\") pod \"maas-api-e2e-api-a-dab019-59d96d489b-6gb5g\" (UID: \"7d4bb651-f6c3-4973-bcca-d81dc95c029b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dab019-59d96d489b-6gb5g"
Sep 08 04:24:32.966047 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:32.965954    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6tsl\" (UniqueName: \"kubernetes.io/projected/7d4bb651-f6c3-4973-bcca-d81dc95c029b-kube-api-access-v6tsl\") pod \"maas-api-e2e-api-a-dab019-59d96d489b-6gb5g\" (UID: \"7d4bb651-f6c3-4973-bcca-d81dc95c029b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dab019-59d96d489b-6gb5g"
Sep 08 04:24:32.966176 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:32.966160    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d4bb651-f6c3-4973-bcca-d81dc95c029b-openshift-service-ca\") pod \"maas-api-e2e-api-a-dab019-59d96d489b-6gb5g\" (UID: \"7d4bb651-f6c3-4973-bcca-d81dc95c029b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dab019-59d96d489b-6gb5g"
Sep 08 04:24:33.067044 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:33.067009    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d4bb651-f6c3-4973-bcca-d81dc95c029b-openshift-service-ca\") pod \"maas-api-e2e-api-a-dab019-59d96d489b-6gb5g\" (UID: \"7d4bb651-f6c3-4973-bcca-d81dc95c029b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dab019-59d96d489b-6gb5g"
Sep 08 04:24:33.067239 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:33.067076    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d4bb651-f6c3-4973-bcca-d81dc95c029b-maas-api-tls\") pod \"maas-api-e2e-api-a-dab019-59d96d489b-6gb5g\" (UID: \"7d4bb651-f6c3-4973-bcca-d81dc95c029b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dab019-59d96d489b-6gb5g"
Sep 08 04:24:33.067239 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:33.067100    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d4bb651-f6c3-4973-bcca-d81dc95c029b-metrics-certs\") pod \"maas-api-e2e-api-a-dab019-59d96d489b-6gb5g\" (UID: \"7d4bb651-f6c3-4973-bcca-d81dc95c029b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dab019-59d96d489b-6gb5g"
Sep 08 04:24:33.067239 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:33.067115    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6tsl\" (UniqueName: \"kubernetes.io/projected/7d4bb651-f6c3-4973-bcca-d81dc95c029b-kube-api-access-v6tsl\") pod \"maas-api-e2e-api-a-dab019-59d96d489b-6gb5g\" (UID: \"7d4bb651-f6c3-4973-bcca-d81dc95c029b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dab019-59d96d489b-6gb5g"
Sep 08 04:24:33.067411 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:24:33.067248    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-dab019-serving-cert: secret "maas-api-e2e-api-a-dab019-serving-cert" not found
Sep 08 04:24:33.067411 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:24:33.067328    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d4bb651-f6c3-4973-bcca-d81dc95c029b-maas-api-tls podName:7d4bb651-f6c3-4973-bcca-d81dc95c029b nodeName:}" failed. No retries permitted until 2026-09-08 04:24:33.567305613 +0000 UTC m=+1433.352596847 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7d4bb651-f6c3-4973-bcca-d81dc95c029b-maas-api-tls") pod "maas-api-e2e-api-a-dab019-59d96d489b-6gb5g" (UID: "7d4bb651-f6c3-4973-bcca-d81dc95c029b") : secret "maas-api-e2e-api-a-dab019-serving-cert" not found
Sep 08 04:24:33.067817 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:33.067794    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d4bb651-f6c3-4973-bcca-d81dc95c029b-openshift-service-ca\") pod \"maas-api-e2e-api-a-dab019-59d96d489b-6gb5g\" (UID: \"7d4bb651-f6c3-4973-bcca-d81dc95c029b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dab019-59d96d489b-6gb5g"
Sep 08 04:24:33.069741 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:33.069719    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d4bb651-f6c3-4973-bcca-d81dc95c029b-metrics-certs\") pod \"maas-api-e2e-api-a-dab019-59d96d489b-6gb5g\" (UID: \"7d4bb651-f6c3-4973-bcca-d81dc95c029b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dab019-59d96d489b-6gb5g"
Sep 08 04:24:33.080244 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:33.080223    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6tsl\" (UniqueName: \"kubernetes.io/projected/7d4bb651-f6c3-4973-bcca-d81dc95c029b-kube-api-access-v6tsl\") pod \"maas-api-e2e-api-a-dab019-59d96d489b-6gb5g\" (UID: \"7d4bb651-f6c3-4973-bcca-d81dc95c029b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dab019-59d96d489b-6gb5g"
Sep 08 04:24:33.572100 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:33.572072    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d4bb651-f6c3-4973-bcca-d81dc95c029b-maas-api-tls\") pod \"maas-api-e2e-api-a-dab019-59d96d489b-6gb5g\" (UID: \"7d4bb651-f6c3-4973-bcca-d81dc95c029b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dab019-59d96d489b-6gb5g"
Sep 08 04:24:33.574710 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:33.574687    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d4bb651-f6c3-4973-bcca-d81dc95c029b-maas-api-tls\") pod \"maas-api-e2e-api-a-dab019-59d96d489b-6gb5g\" (UID: \"7d4bb651-f6c3-4973-bcca-d81dc95c029b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dab019-59d96d489b-6gb5g"
Sep 08 04:24:33.770705 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:33.770673    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dab019-59d96d489b-6gb5g"
Sep 08 04:24:34.051650 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:34.051620    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-dab019-59d96d489b-6gb5g"]
Sep 08 04:24:34.052612 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:24:34.052588    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d4bb651_f6c3_4973_bcca_d81dc95c029b.slice/crio-f33782eeca2bbe3c3d33194b45f5ecb61be20c6a7dbd222af05cacd374cbb623 WatchSource:0}: Error finding container f33782eeca2bbe3c3d33194b45f5ecb61be20c6a7dbd222af05cacd374cbb623: Status 404 returned error can't find the container with id f33782eeca2bbe3c3d33194b45f5ecb61be20c6a7dbd222af05cacd374cbb623
Sep 08 04:24:34.054027 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:34.054011    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 04:24:34.819874 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:34.819839    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dab019-59d96d489b-6gb5g" event={"ID":"7d4bb651-f6c3-4973-bcca-d81dc95c029b","Type":"ContainerStarted","Data":"c3f16420595f3458b776a80343f8aa894b64a71253b1afa1ab012779cfebbb29"}
Sep 08 04:24:34.820060 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:34.819900    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dab019-59d96d489b-6gb5g" event={"ID":"7d4bb651-f6c3-4973-bcca-d81dc95c029b","Type":"ContainerStarted","Data":"f33782eeca2bbe3c3d33194b45f5ecb61be20c6a7dbd222af05cacd374cbb623"}
Sep 08 04:24:34.820060 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:34.819927    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dab019-59d96d489b-6gb5g"
Sep 08 04:24:34.840469 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:34.840412    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dab019-59d96d489b-6gb5g" podStartSLOduration=2.405747785 podStartE2EDuration="2.84039766s" totalImagesPullingTime="434.649875ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:24:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:24:34.837661026 +0000 UTC m=+1434.622952254" watchObservedRunningTime="2026-09-08 04:24:34.84039766 +0000 UTC m=+1434.625688896"
Sep 08 04:24:40.831705 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:40.831669    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dab019-59d96d489b-6gb5g"
Sep 08 04:24:46.822708 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:46.822669    2573 patch_prober.go:28] interesting pod/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 04:24:46.823090 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:46.822738    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc" podUID="98bb97ab-62fb-46fe-8b9a-804a036c1a5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 04:24:48.918204 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:48.918171    2573 generic.go:356] "Generic (PLEG): container finished" podID="98bb97ab-62fb-46fe-8b9a-804a036c1a5a" containerID="84b60875068acd2bb51f4ef5f0a4c14b4e23f8a80cb5351788b408b85d3d978d" exitCode=0
Sep 08 04:24:48.918619 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:48.918247    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc" event={"ID":"98bb97ab-62fb-46fe-8b9a-804a036c1a5a","Type":"ContainerDied","Data":"84b60875068acd2bb51f4ef5f0a4c14b4e23f8a80cb5351788b408b85d3d978d"}
Sep 08 04:24:48.918704 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:48.918689    2573 scope.go:117] "RemoveContainer" containerID="84b60875068acd2bb51f4ef5f0a4c14b4e23f8a80cb5351788b408b85d3d978d"
Sep 08 04:24:48.919795 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:48.919768    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:24:48.919863 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:48.919843    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:24:48.919903 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:48.919882    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:24:49.925849 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:49.925814    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc" event={"ID":"98bb97ab-62fb-46fe-8b9a-804a036c1a5a","Type":"ContainerStarted","Data":"77ec44f659f06074c193c44d66624c1592601e70fe6f628360d7dc2d0fe58192"}
Sep 08 04:24:50.143816 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:50.143774    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"
Sep 08 04:24:50.143995 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:50.143973    2573 patch_prober.go:28] interesting pod/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 08 04:24:50.144042 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:50.144023    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc" podUID="98bb97ab-62fb-46fe-8b9a-804a036c1a5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 08 04:24:51.143866 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:51.143830    2573 patch_prober.go:28] interesting pod/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 08 04:24:51.144254 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:51.143898    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc" podUID="98bb97ab-62fb-46fe-8b9a-804a036c1a5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 08 04:24:52.144104 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:52.144071    2573 patch_prober.go:28] interesting pod/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 08 04:24:52.144480 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:52.144129    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc" podUID="98bb97ab-62fb-46fe-8b9a-804a036c1a5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 08 04:24:53.143495 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:53.143457    2573 patch_prober.go:28] interesting pod/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 08 04:24:53.143709 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:53.143525    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc" podUID="98bb97ab-62fb-46fe-8b9a-804a036c1a5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 08 04:24:54.144224 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:54.144189    2573 patch_prober.go:28] interesting pod/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 08 04:24:54.144591 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:54.144256    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc" podUID="98bb97ab-62fb-46fe-8b9a-804a036c1a5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 08 04:24:55.147842 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:55.147810    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"
Sep 08 04:24:55.148237 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:55.148087    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"
Sep 08 04:24:55.148823 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:55.148805    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"
Sep 08 04:24:57.534246 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:57.534213    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"]
Sep 08 04:24:57.540946 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:57.540911    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"
Sep 08 04:24:57.544702 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:57.544679    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-7bac07-openshift-default-dockercfg-r2mfl\""
Sep 08 04:24:57.569946 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:57.569921    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"]
Sep 08 04:24:57.640057 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:57.640014    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-credential-socket\") pod \"e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj\" (UID: \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\") " pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"
Sep 08 04:24:57.640240 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:57.640084    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-istio-token\") pod \"e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj\" (UID: \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\") " pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"
Sep 08 04:24:57.640240 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:57.640115    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-istiod-ca-cert\") pod \"e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj\" (UID: \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\") " pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"
Sep 08 04:24:57.640240 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:57.640142    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsqsc\" (UniqueName: \"kubernetes.io/projected/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-kube-api-access-vsqsc\") pod \"e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj\" (UID: \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\") " pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"
Sep 08 04:24:57.640240 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:57.640192    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-istio-envoy\") pod \"e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj\" (UID: \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\") " pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"
Sep 08 04:24:57.640453 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:57.640261    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-istio-podinfo\") pod \"e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj\" (UID: \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\") " pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"
Sep 08 04:24:57.640453 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:57.640289    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-workload-socket\") pod \"e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj\" (UID: \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\") " pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"
Sep 08 04:24:57.640453 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:57.640364    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-istio-data\") pod \"e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj\" (UID: \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\") " pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"
Sep 08 04:24:57.640453 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:57.640421    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-workload-certs\") pod \"e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj\" (UID: \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\") " pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"
Sep 08 04:24:57.740946 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:57.740913    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-istio-podinfo\") pod \"e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj\" (UID: \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\") " pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"
Sep 08 04:24:57.740946 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:57.740949    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-workload-socket\") pod \"e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj\" (UID: \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\") " pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"
Sep 08 04:24:57.741195 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:57.740969    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-istio-data\") pod \"e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj\" (UID: \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\") " pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"
Sep 08 04:24:57.741195 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:57.741003    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-workload-certs\") pod \"e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj\" (UID: \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\") " pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"
Sep 08 04:24:57.741195 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:57.741059    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-credential-socket\") pod \"e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj\" (UID: \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\") " pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"
Sep 08 04:24:57.741195 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:57.741080    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-istio-token\") pod \"e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj\" (UID: \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\") " pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"
Sep 08 04:24:57.741195 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:57.741101    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-istiod-ca-cert\") pod \"e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj\" (UID: \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\") " pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"
Sep 08 04:24:57.741195 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:57.741126    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsqsc\" (UniqueName: \"kubernetes.io/projected/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-kube-api-access-vsqsc\") pod \"e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj\" (UID: \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\") " pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"
Sep 08 04:24:57.741195 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:57.741169    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-istio-envoy\") pod \"e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj\" (UID: \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\") " pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"
Sep 08 04:24:57.741551 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:57.741352    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-workload-socket\") pod \"e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj\" (UID: \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\") " pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"
Sep 08 04:24:57.741551 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:57.741404    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-istio-data\") pod \"e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj\" (UID: \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\") " pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"
Sep 08 04:24:57.741551 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:57.741422    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-workload-certs\") pod \"e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj\" (UID: \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\") " pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"
Sep 08 04:24:57.741551 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:57.741478    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-credential-socket\") pod \"e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj\" (UID: \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\") " pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"
Sep 08 04:24:57.742038 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:57.742013    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-istiod-ca-cert\") pod \"e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj\" (UID: \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\") " pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"
Sep 08 04:24:57.743427 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:57.743386    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-istio-envoy\") pod \"e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj\" (UID: \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\") " pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"
Sep 08 04:24:57.743586 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:57.743540    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-istio-podinfo\") pod \"e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj\" (UID: \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\") " pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"
Sep 08 04:24:57.755341 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:57.755314    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-istio-token\") pod \"e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj\" (UID: \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\") " pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"
Sep 08 04:24:57.755433 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:57.755380    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsqsc\" (UniqueName: \"kubernetes.io/projected/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-kube-api-access-vsqsc\") pod \"e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj\" (UID: \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\") " pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"
Sep 08 04:24:57.851709 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:57.851631    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"
Sep 08 04:24:58.132502 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:58.132477    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"]
Sep 08 04:24:58.134010 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:24:58.133984    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod530583f8_f2d3_4a4c_b8b7_b1ed59cfc94e.slice/crio-d7e5ca28a759a1d3d9b5fb1cc956a2259d3c5c0f67cb50f43df7af40bfc1f4be WatchSource:0}: Error finding container d7e5ca28a759a1d3d9b5fb1cc956a2259d3c5c0f67cb50f43df7af40bfc1f4be: Status 404 returned error can't find the container with id d7e5ca28a759a1d3d9b5fb1cc956a2259d3c5c0f67cb50f43df7af40bfc1f4be
Sep 08 04:24:58.136376 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:58.136341    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:24:58.136480 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:58.136420    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:24:58.136480 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:58.136462    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:24:58.979494 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:58.979459    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj" event={"ID":"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e","Type":"ContainerStarted","Data":"a654ae931a8c43f0a20ecf520cfa531112e5ebed017502b05f689ee2357654c0"}
Sep 08 04:24:58.979938 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:58.979505    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj" event={"ID":"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e","Type":"ContainerStarted","Data":"d7e5ca28a759a1d3d9b5fb1cc956a2259d3c5c0f67cb50f43df7af40bfc1f4be"}
Sep 08 04:24:59.004214 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:59.004165    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj" podStartSLOduration=2.004148715 podStartE2EDuration="2.004148715s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:24:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:24:59.001146489 +0000 UTC m=+1458.786437728" watchObservedRunningTime="2026-09-08 04:24:59.004148715 +0000 UTC m=+1458.789439950"
Sep 08 04:24:59.852725 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:59.852694    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"
Sep 08 04:24:59.857983 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:59.857958    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"
Sep 08 04:24:59.985041 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:59.985008    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"
Sep 08 04:24:59.985819 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:24:59.985801    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"
Sep 08 04:25:22.133617 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:22.133582    2573 generic.go:356] "Generic (PLEG): container finished" podID="530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e" containerID="a654ae931a8c43f0a20ecf520cfa531112e5ebed017502b05f689ee2357654c0" exitCode=0
Sep 08 04:25:22.134122 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:22.133631    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj" event={"ID":"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e","Type":"ContainerDied","Data":"a654ae931a8c43f0a20ecf520cfa531112e5ebed017502b05f689ee2357654c0"}
Sep 08 04:25:22.134200 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:22.134165    2573 scope.go:117] "RemoveContainer" containerID="a654ae931a8c43f0a20ecf520cfa531112e5ebed017502b05f689ee2357654c0"
Sep 08 04:25:22.135430 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:22.135401    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:25:22.135508 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:22.135475    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:25:22.135548 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:22.135508    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:25:23.141425 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:23.141394    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj" event={"ID":"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e","Type":"ContainerStarted","Data":"9af358d9b556677efdba76cc454a7eb490b987dfcc887a1507b3ccfda47f45ba"}
Sep 08 04:25:23.853282 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:23.853246    2573 patch_prober.go:28] interesting pod/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 08 04:25:23.853490 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:23.853310    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj" podUID="530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 08 04:25:23.853490 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:23.852872    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"
Sep 08 04:25:24.852706 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:24.852673    2573 patch_prober.go:28] interesting pod/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 08 04:25:24.853092 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:24.852725    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj" podUID="530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 08 04:25:25.852082 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:25.852050    2573 patch_prober.go:28] interesting pod/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 08 04:25:25.852249 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:25.852103    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj" podUID="530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 08 04:25:26.852406 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:26.852367    2573 patch_prober.go:28] interesting pod/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 08 04:25:26.852789 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:26.852421    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj" podUID="530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 08 04:25:27.852364 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:27.852327    2573 patch_prober.go:28] interesting pod/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 08 04:25:27.852534 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:27.852388    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj" podUID="530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 08 04:25:28.856787 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:28.856759    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"
Sep 08 04:25:28.857221 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:28.857153    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"
Sep 08 04:25:28.857866 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:28.857850    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"
Sep 08 04:25:44.525974 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:44.525940    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-dab019-59d96d489b-6gb5g"]
Sep 08 04:25:44.526523 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:44.526202    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dab019-59d96d489b-6gb5g" podUID="7d4bb651-f6c3-4973-bcca-d81dc95c029b" containerName="maas-api" containerID="cri-o://c3f16420595f3458b776a80343f8aa894b64a71253b1afa1ab012779cfebbb29" gracePeriod=30
Sep 08 04:25:44.796666 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:44.796640    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dab019-59d96d489b-6gb5g"
Sep 08 04:25:44.957584 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:44.954703    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d4bb651-f6c3-4973-bcca-d81dc95c029b-maas-api-tls\") pod \"7d4bb651-f6c3-4973-bcca-d81dc95c029b\" (UID: \"7d4bb651-f6c3-4973-bcca-d81dc95c029b\") "
Sep 08 04:25:44.957584 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:44.954769    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d4bb651-f6c3-4973-bcca-d81dc95c029b-openshift-service-ca\") pod \"7d4bb651-f6c3-4973-bcca-d81dc95c029b\" (UID: \"7d4bb651-f6c3-4973-bcca-d81dc95c029b\") "
Sep 08 04:25:44.957584 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:44.954862    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d4bb651-f6c3-4973-bcca-d81dc95c029b-metrics-certs\") pod \"7d4bb651-f6c3-4973-bcca-d81dc95c029b\" (UID: \"7d4bb651-f6c3-4973-bcca-d81dc95c029b\") "
Sep 08 04:25:44.957584 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:44.954936    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6tsl\" (UniqueName: \"kubernetes.io/projected/7d4bb651-f6c3-4973-bcca-d81dc95c029b-kube-api-access-v6tsl\") pod \"7d4bb651-f6c3-4973-bcca-d81dc95c029b\" (UID: \"7d4bb651-f6c3-4973-bcca-d81dc95c029b\") "
Sep 08 04:25:44.957584 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:44.955179    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d4bb651-f6c3-4973-bcca-d81dc95c029b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7d4bb651-f6c3-4973-bcca-d81dc95c029b" (UID: "7d4bb651-f6c3-4973-bcca-d81dc95c029b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 04:25:44.957584 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:44.955378    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d4bb651-f6c3-4973-bcca-d81dc95c029b-openshift-service-ca\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:25:44.958731 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:44.958428    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d4bb651-f6c3-4973-bcca-d81dc95c029b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7d4bb651-f6c3-4973-bcca-d81dc95c029b" (UID: "7d4bb651-f6c3-4973-bcca-d81dc95c029b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:25:44.958731 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:44.958530    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d4bb651-f6c3-4973-bcca-d81dc95c029b-kube-api-access-v6tsl" (OuterVolumeSpecName: "kube-api-access-v6tsl") pod "7d4bb651-f6c3-4973-bcca-d81dc95c029b" (UID: "7d4bb651-f6c3-4973-bcca-d81dc95c029b"). InnerVolumeSpecName "kube-api-access-v6tsl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:25:44.958731 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:44.958618    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d4bb651-f6c3-4973-bcca-d81dc95c029b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7d4bb651-f6c3-4973-bcca-d81dc95c029b" (UID: "7d4bb651-f6c3-4973-bcca-d81dc95c029b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:25:45.056076 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:45.055996    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d4bb651-f6c3-4973-bcca-d81dc95c029b-metrics-certs\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:25:45.056076 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:45.056022    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6tsl\" (UniqueName: \"kubernetes.io/projected/7d4bb651-f6c3-4973-bcca-d81dc95c029b-kube-api-access-v6tsl\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:25:45.056076 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:45.056033    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d4bb651-f6c3-4973-bcca-d81dc95c029b-maas-api-tls\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:25:45.272182 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:45.272145    2573 generic.go:356] "Generic (PLEG): container finished" podID="7d4bb651-f6c3-4973-bcca-d81dc95c029b" containerID="c3f16420595f3458b776a80343f8aa894b64a71253b1afa1ab012779cfebbb29" exitCode=0
Sep 08 04:25:45.272360 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:45.272189    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dab019-59d96d489b-6gb5g"
Sep 08 04:25:45.272360 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:45.272226    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dab019-59d96d489b-6gb5g" event={"ID":"7d4bb651-f6c3-4973-bcca-d81dc95c029b","Type":"ContainerDied","Data":"c3f16420595f3458b776a80343f8aa894b64a71253b1afa1ab012779cfebbb29"}
Sep 08 04:25:45.272360 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:45.272280    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dab019-59d96d489b-6gb5g" event={"ID":"7d4bb651-f6c3-4973-bcca-d81dc95c029b","Type":"ContainerDied","Data":"f33782eeca2bbe3c3d33194b45f5ecb61be20c6a7dbd222af05cacd374cbb623"}
Sep 08 04:25:45.272360 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:45.272301    2573 scope.go:117] "RemoveContainer" containerID="c3f16420595f3458b776a80343f8aa894b64a71253b1afa1ab012779cfebbb29"
Sep 08 04:25:45.282656 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:45.282641    2573 scope.go:117] "RemoveContainer" containerID="c3f16420595f3458b776a80343f8aa894b64a71253b1afa1ab012779cfebbb29"
Sep 08 04:25:45.282915 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:25:45.282896    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3f16420595f3458b776a80343f8aa894b64a71253b1afa1ab012779cfebbb29\": container with ID starting with c3f16420595f3458b776a80343f8aa894b64a71253b1afa1ab012779cfebbb29 not found: ID does not exist" containerID="c3f16420595f3458b776a80343f8aa894b64a71253b1afa1ab012779cfebbb29"
Sep 08 04:25:45.282988 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:45.282926    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3f16420595f3458b776a80343f8aa894b64a71253b1afa1ab012779cfebbb29"} err="failed to get container status \"c3f16420595f3458b776a80343f8aa894b64a71253b1afa1ab012779cfebbb29\": rpc error: code = NotFound desc = could not find container \"c3f16420595f3458b776a80343f8aa894b64a71253b1afa1ab012779cfebbb29\": container with ID starting with c3f16420595f3458b776a80343f8aa894b64a71253b1afa1ab012779cfebbb29 not found: ID does not exist"
Sep 08 04:25:45.298682 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:45.298652    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-dab019-59d96d489b-6gb5g"]
Sep 08 04:25:45.301965 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:45.301943    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-dab019-59d96d489b-6gb5g"]
Sep 08 04:25:46.676084 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:46.676050    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d4bb651-f6c3-4973-bcca-d81dc95c029b" path="/var/lib/kubelet/pods/7d4bb651-f6c3-4973-bcca-d81dc95c029b/volumes"
Sep 08 04:25:51.759881 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:51.759850    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"]
Sep 08 04:25:51.760459 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:51.760048    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc" podUID="98bb97ab-62fb-46fe-8b9a-804a036c1a5a" containerName="istio-proxy" containerID="cri-o://77ec44f659f06074c193c44d66624c1592601e70fe6f628360d7dc2d0fe58192" gracePeriod=30
Sep 08 04:25:55.150942 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:55.150905    2573 patch_prober.go:28] interesting pod/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 04:25:55.151290 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:55.150964    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc" podUID="98bb97ab-62fb-46fe-8b9a-804a036c1a5a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 04:25:57.029167 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:57.029109    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"
Sep 08 04:25:57.179045 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:57.179015    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-istiod-ca-cert\") pod \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\" (UID: \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\") "
Sep 08 04:25:57.179225 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:57.179057    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-istio-envoy\") pod \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\" (UID: \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\") "
Sep 08 04:25:57.179225 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:57.179120    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbdm2\" (UniqueName: \"kubernetes.io/projected/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-kube-api-access-kbdm2\") pod \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\" (UID: \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\") "
Sep 08 04:25:57.179225 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:57.179145    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-workload-certs\") pod \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\" (UID: \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\") "
Sep 08 04:25:57.179225 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:57.179203    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-istio-data\") pod \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\" (UID: \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\") "
Sep 08 04:25:57.179453 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:57.179230    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-workload-socket\") pod \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\" (UID: \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\") "
Sep 08 04:25:57.179453 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:57.179276    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-istio-token\") pod \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\" (UID: \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\") "
Sep 08 04:25:57.179453 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:57.179421    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-credential-socket\") pod \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\" (UID: \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\") "
Sep 08 04:25:57.179453 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:57.179418    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "98bb97ab-62fb-46fe-8b9a-804a036c1a5a" (UID: "98bb97ab-62fb-46fe-8b9a-804a036c1a5a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 04:25:57.179659 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:57.179472    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-istio-podinfo\") pod \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\" (UID: \"98bb97ab-62fb-46fe-8b9a-804a036c1a5a\") "
Sep 08 04:25:57.179718 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:57.179695    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-istio-data" (OuterVolumeSpecName: "istio-data") pod "98bb97ab-62fb-46fe-8b9a-804a036c1a5a" (UID: "98bb97ab-62fb-46fe-8b9a-804a036c1a5a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:25:57.179868 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:57.179826    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "98bb97ab-62fb-46fe-8b9a-804a036c1a5a" (UID: "98bb97ab-62fb-46fe-8b9a-804a036c1a5a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:25:57.179979 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:57.179947    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-istio-data\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:25:57.179979 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:57.179965    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-workload-socket\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:25:57.180089 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:57.179979    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-istiod-ca-cert\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:25:57.180089 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:57.179963    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "98bb97ab-62fb-46fe-8b9a-804a036c1a5a" (UID: "98bb97ab-62fb-46fe-8b9a-804a036c1a5a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:25:57.180089 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:57.180040    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "98bb97ab-62fb-46fe-8b9a-804a036c1a5a" (UID: "98bb97ab-62fb-46fe-8b9a-804a036c1a5a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:25:57.181468 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:57.181443    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "98bb97ab-62fb-46fe-8b9a-804a036c1a5a" (UID: "98bb97ab-62fb-46fe-8b9a-804a036c1a5a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:25:57.181606 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:57.181517    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-kube-api-access-kbdm2" (OuterVolumeSpecName: "kube-api-access-kbdm2") pod "98bb97ab-62fb-46fe-8b9a-804a036c1a5a" (UID: "98bb97ab-62fb-46fe-8b9a-804a036c1a5a"). InnerVolumeSpecName "kube-api-access-kbdm2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:25:57.181758 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:57.181740    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "98bb97ab-62fb-46fe-8b9a-804a036c1a5a" (UID: "98bb97ab-62fb-46fe-8b9a-804a036c1a5a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 04:25:57.181823 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:57.181807    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-istio-token" (OuterVolumeSpecName: "istio-token") pod "98bb97ab-62fb-46fe-8b9a-804a036c1a5a" (UID: "98bb97ab-62fb-46fe-8b9a-804a036c1a5a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:25:57.280758 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:57.280688    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbdm2\" (UniqueName: \"kubernetes.io/projected/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-kube-api-access-kbdm2\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:25:57.280758 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:57.280713    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-workload-certs\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:25:57.280758 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:57.280723    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-istio-token\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:25:57.280758 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:57.280731    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-credential-socket\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:25:57.280758 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:57.280739    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-istio-podinfo\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:25:57.280758 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:57.280747    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98bb97ab-62fb-46fe-8b9a-804a036c1a5a-istio-envoy\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:25:57.347251 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:57.347212    2573 generic.go:356] "Generic (PLEG): container finished" podID="98bb97ab-62fb-46fe-8b9a-804a036c1a5a" containerID="77ec44f659f06074c193c44d66624c1592601e70fe6f628360d7dc2d0fe58192" exitCode=0
Sep 08 04:25:57.347421 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:57.347272    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"
Sep 08 04:25:57.347421 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:57.347301    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc" event={"ID":"98bb97ab-62fb-46fe-8b9a-804a036c1a5a","Type":"ContainerDied","Data":"77ec44f659f06074c193c44d66624c1592601e70fe6f628360d7dc2d0fe58192"}
Sep 08 04:25:57.347421 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:57.347366    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc" event={"ID":"98bb97ab-62fb-46fe-8b9a-804a036c1a5a","Type":"ContainerDied","Data":"f312a2ab9954b498afcdb86dd3572aae1d8ef03a813c150b0a33327aef59fd6a"}
Sep 08 04:25:57.347421 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:57.347403    2573 scope.go:117] "RemoveContainer" containerID="77ec44f659f06074c193c44d66624c1592601e70fe6f628360d7dc2d0fe58192"
Sep 08 04:25:57.357568 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:57.357536    2573 scope.go:117] "RemoveContainer" containerID="84b60875068acd2bb51f4ef5f0a4c14b4e23f8a80cb5351788b408b85d3d978d"
Sep 08 04:25:57.370017 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:57.367613    2573 scope.go:117] "RemoveContainer" containerID="77ec44f659f06074c193c44d66624c1592601e70fe6f628360d7dc2d0fe58192"
Sep 08 04:25:57.370017 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:25:57.368703    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77ec44f659f06074c193c44d66624c1592601e70fe6f628360d7dc2d0fe58192\": container with ID starting with 77ec44f659f06074c193c44d66624c1592601e70fe6f628360d7dc2d0fe58192 not found: ID does not exist" containerID="77ec44f659f06074c193c44d66624c1592601e70fe6f628360d7dc2d0fe58192"
Sep 08 04:25:57.370017 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:57.368862    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77ec44f659f06074c193c44d66624c1592601e70fe6f628360d7dc2d0fe58192"} err="failed to get container status \"77ec44f659f06074c193c44d66624c1592601e70fe6f628360d7dc2d0fe58192\": rpc error: code = NotFound desc = could not find container \"77ec44f659f06074c193c44d66624c1592601e70fe6f628360d7dc2d0fe58192\": container with ID starting with 77ec44f659f06074c193c44d66624c1592601e70fe6f628360d7dc2d0fe58192 not found: ID does not exist"
Sep 08 04:25:57.370017 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:57.368886    2573 scope.go:117] "RemoveContainer" containerID="84b60875068acd2bb51f4ef5f0a4c14b4e23f8a80cb5351788b408b85d3d978d"
Sep 08 04:25:57.370459 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:25:57.370436    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84b60875068acd2bb51f4ef5f0a4c14b4e23f8a80cb5351788b408b85d3d978d\": container with ID starting with 84b60875068acd2bb51f4ef5f0a4c14b4e23f8a80cb5351788b408b85d3d978d not found: ID does not exist" containerID="84b60875068acd2bb51f4ef5f0a4c14b4e23f8a80cb5351788b408b85d3d978d"
Sep 08 04:25:57.370642 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:57.370480    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84b60875068acd2bb51f4ef5f0a4c14b4e23f8a80cb5351788b408b85d3d978d"} err="failed to get container status \"84b60875068acd2bb51f4ef5f0a4c14b4e23f8a80cb5351788b408b85d3d978d\": rpc error: code = NotFound desc = could not find container \"84b60875068acd2bb51f4ef5f0a4c14b4e23f8a80cb5351788b408b85d3d978d\": container with ID starting with 84b60875068acd2bb51f4ef5f0a4c14b4e23f8a80cb5351788b408b85d3d978d not found: ID does not exist"
Sep 08 04:25:57.372208 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:57.372181    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"]
Sep 08 04:25:57.374621 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:57.374603    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc"]
Sep 08 04:25:58.682866 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:25:58.682833    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98bb97ab-62fb-46fe-8b9a-804a036c1a5a" path="/var/lib/kubelet/pods/98bb97ab-62fb-46fe-8b9a-804a036c1a5a/volumes"
Sep 08 04:26:14.689483 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:14.689295    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"]
Sep 08 04:26:14.689977 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:14.689538    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj" podUID="530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e" containerName="istio-proxy" containerID="cri-o://9af358d9b556677efdba76cc454a7eb490b987dfcc887a1507b3ccfda47f45ba" gracePeriod=30
Sep 08 04:26:19.951351 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:19.951324    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"
Sep 08 04:26:20.005465 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:20.005433    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-credential-socket\") pod \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\" (UID: \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\") "
Sep 08 04:26:20.005662 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:20.005484    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-workload-socket\") pod \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\" (UID: \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\") "
Sep 08 04:26:20.005662 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:20.005538    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-istio-data\") pod \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\" (UID: \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\") "
Sep 08 04:26:20.005662 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:20.005624    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vsqsc\" (UniqueName: \"kubernetes.io/projected/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-kube-api-access-vsqsc\") pod \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\" (UID: \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\") "
Sep 08 04:26:20.005662 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:20.005653    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-workload-certs\") pod \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\" (UID: \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\") "
Sep 08 04:26:20.005914 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:20.005702    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-istio-token\") pod \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\" (UID: \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\") "
Sep 08 04:26:20.005914 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:20.005725    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-istio-envoy\") pod \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\" (UID: \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\") "
Sep 08 04:26:20.005914 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:20.005754    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-istio-podinfo\") pod \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\" (UID: \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\") "
Sep 08 04:26:20.005914 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:20.005760    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e" (UID: "530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:26:20.005914 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:20.005813    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-istiod-ca-cert\") pod \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\" (UID: \"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e\") "
Sep 08 04:26:20.005914 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:20.005833    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e" (UID: "530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:26:20.006243 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:20.005951    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-istio-data" (OuterVolumeSpecName: "istio-data") pod "530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e" (UID: "530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:26:20.006243 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:20.005991    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e" (UID: "530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:26:20.006369 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:20.006342    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-workload-certs\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:26:20.006430 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:20.006365    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e" (UID: "530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 04:26:20.006575 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:20.006406    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-credential-socket\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:26:20.006655 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:20.006575    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-workload-socket\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:26:20.006655 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:20.006589    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-istio-data\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:26:20.008221 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:20.008191    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-kube-api-access-vsqsc" (OuterVolumeSpecName: "kube-api-access-vsqsc") pod "530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e" (UID: "530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e"). InnerVolumeSpecName "kube-api-access-vsqsc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:26:20.008221 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:20.008195    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-istio-token" (OuterVolumeSpecName: "istio-token") pod "530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e" (UID: "530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:26:20.008523 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:20.008508    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e" (UID: "530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 04:26:20.008605 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:20.008585    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e" (UID: "530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:26:20.107761 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:20.107733    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vsqsc\" (UniqueName: \"kubernetes.io/projected/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-kube-api-access-vsqsc\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:26:20.107761 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:20.107760    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-istio-token\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:26:20.107898 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:20.107770    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-istio-envoy\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:26:20.107898 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:20.107778    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-istio-podinfo\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:26:20.107898 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:20.107786    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e-istiod-ca-cert\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:26:20.485135 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:20.485051    2573 generic.go:356] "Generic (PLEG): container finished" podID="530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e" containerID="9af358d9b556677efdba76cc454a7eb490b987dfcc887a1507b3ccfda47f45ba" exitCode=0
Sep 08 04:26:20.485135 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:20.485098    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"
Sep 08 04:26:20.485317 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:20.485135    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj" event={"ID":"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e","Type":"ContainerDied","Data":"9af358d9b556677efdba76cc454a7eb490b987dfcc887a1507b3ccfda47f45ba"}
Sep 08 04:26:20.485317 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:20.485193    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj" event={"ID":"530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e","Type":"ContainerDied","Data":"d7e5ca28a759a1d3d9b5fb1cc956a2259d3c5c0f67cb50f43df7af40bfc1f4be"}
Sep 08 04:26:20.485317 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:20.485222    2573 scope.go:117] "RemoveContainer" containerID="9af358d9b556677efdba76cc454a7eb490b987dfcc887a1507b3ccfda47f45ba"
Sep 08 04:26:20.496039 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:20.496017    2573 scope.go:117] "RemoveContainer" containerID="a654ae931a8c43f0a20ecf520cfa531112e5ebed017502b05f689ee2357654c0"
Sep 08 04:26:20.506694 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:20.506676    2573 scope.go:117] "RemoveContainer" containerID="9af358d9b556677efdba76cc454a7eb490b987dfcc887a1507b3ccfda47f45ba"
Sep 08 04:26:20.507123 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:26:20.507105    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9af358d9b556677efdba76cc454a7eb490b987dfcc887a1507b3ccfda47f45ba\": container with ID starting with 9af358d9b556677efdba76cc454a7eb490b987dfcc887a1507b3ccfda47f45ba not found: ID does not exist" containerID="9af358d9b556677efdba76cc454a7eb490b987dfcc887a1507b3ccfda47f45ba"
Sep 08 04:26:20.507204 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:20.507132    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9af358d9b556677efdba76cc454a7eb490b987dfcc887a1507b3ccfda47f45ba"} err="failed to get container status \"9af358d9b556677efdba76cc454a7eb490b987dfcc887a1507b3ccfda47f45ba\": rpc error: code = NotFound desc = could not find container \"9af358d9b556677efdba76cc454a7eb490b987dfcc887a1507b3ccfda47f45ba\": container with ID starting with 9af358d9b556677efdba76cc454a7eb490b987dfcc887a1507b3ccfda47f45ba not found: ID does not exist"
Sep 08 04:26:20.507204 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:20.507151    2573 scope.go:117] "RemoveContainer" containerID="a654ae931a8c43f0a20ecf520cfa531112e5ebed017502b05f689ee2357654c0"
Sep 08 04:26:20.507411 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:26:20.507391    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a654ae931a8c43f0a20ecf520cfa531112e5ebed017502b05f689ee2357654c0\": container with ID starting with a654ae931a8c43f0a20ecf520cfa531112e5ebed017502b05f689ee2357654c0 not found: ID does not exist" containerID="a654ae931a8c43f0a20ecf520cfa531112e5ebed017502b05f689ee2357654c0"
Sep 08 04:26:20.507469 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:20.507413    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a654ae931a8c43f0a20ecf520cfa531112e5ebed017502b05f689ee2357654c0"} err="failed to get container status \"a654ae931a8c43f0a20ecf520cfa531112e5ebed017502b05f689ee2357654c0\": rpc error: code = NotFound desc = could not find container \"a654ae931a8c43f0a20ecf520cfa531112e5ebed017502b05f689ee2357654c0\": container with ID starting with a654ae931a8c43f0a20ecf520cfa531112e5ebed017502b05f689ee2357654c0 not found: ID does not exist"
Sep 08 04:26:20.513746 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:20.513723    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"]
Sep 08 04:26:20.519174 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:20.519151    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj"]
Sep 08 04:26:20.675387 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:20.675349    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e" path="/var/lib/kubelet/pods/530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e/volumes"
Sep 08 04:26:51.174160 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:51.174124    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"]
Sep 08 04:26:51.174599 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:51.174351    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj" podUID="bfa75482-045d-4f12-ae36-70f877cb348f" containerName="istio-proxy" containerID="cri-o://35043aab23f7587bf82222ba400ce2db64cabc0c9366c2e471f1585400e32c32" gracePeriod=30
Sep 08 04:26:55.710658 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:55.710624    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 04:26:55.711016 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:55.710687    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj" podUID="bfa75482-045d-4f12-ae36-70f877cb348f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 04:26:56.428094 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:56.428066    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"
Sep 08 04:26:56.569941 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:56.569910    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfa75482-045d-4f12-ae36-70f877cb348f-istio-data\") pod \"bfa75482-045d-4f12-ae36-70f877cb348f\" (UID: \"bfa75482-045d-4f12-ae36-70f877cb348f\") "
Sep 08 04:26:56.570097 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:56.569969    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zclg\" (UniqueName: \"kubernetes.io/projected/bfa75482-045d-4f12-ae36-70f877cb348f-kube-api-access-7zclg\") pod \"bfa75482-045d-4f12-ae36-70f877cb348f\" (UID: \"bfa75482-045d-4f12-ae36-70f877cb348f\") "
Sep 08 04:26:56.570097 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:56.570012    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfa75482-045d-4f12-ae36-70f877cb348f-workload-certs\") pod \"bfa75482-045d-4f12-ae36-70f877cb348f\" (UID: \"bfa75482-045d-4f12-ae36-70f877cb348f\") "
Sep 08 04:26:56.570097 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:56.570052    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfa75482-045d-4f12-ae36-70f877cb348f-istio-podinfo\") pod \"bfa75482-045d-4f12-ae36-70f877cb348f\" (UID: \"bfa75482-045d-4f12-ae36-70f877cb348f\") "
Sep 08 04:26:56.570240 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:56.570110    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfa75482-045d-4f12-ae36-70f877cb348f-istio-token\") pod \"bfa75482-045d-4f12-ae36-70f877cb348f\" (UID: \"bfa75482-045d-4f12-ae36-70f877cb348f\") "
Sep 08 04:26:56.570240 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:56.570141    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfa75482-045d-4f12-ae36-70f877cb348f-istio-envoy\") pod \"bfa75482-045d-4f12-ae36-70f877cb348f\" (UID: \"bfa75482-045d-4f12-ae36-70f877cb348f\") "
Sep 08 04:26:56.570240 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:56.570164    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfa75482-045d-4f12-ae36-70f877cb348f-credential-socket\") pod \"bfa75482-045d-4f12-ae36-70f877cb348f\" (UID: \"bfa75482-045d-4f12-ae36-70f877cb348f\") "
Sep 08 04:26:56.570240 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:56.570202    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfa75482-045d-4f12-ae36-70f877cb348f-istio-data" (OuterVolumeSpecName: "istio-data") pod "bfa75482-045d-4f12-ae36-70f877cb348f" (UID: "bfa75482-045d-4f12-ae36-70f877cb348f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:26:56.570240 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:56.570216    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfa75482-045d-4f12-ae36-70f877cb348f-workload-socket\") pod \"bfa75482-045d-4f12-ae36-70f877cb348f\" (UID: \"bfa75482-045d-4f12-ae36-70f877cb348f\") "
Sep 08 04:26:56.570514 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:56.570285    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfa75482-045d-4f12-ae36-70f877cb348f-istiod-ca-cert\") pod \"bfa75482-045d-4f12-ae36-70f877cb348f\" (UID: \"bfa75482-045d-4f12-ae36-70f877cb348f\") "
Sep 08 04:26:56.570514 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:56.570312    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfa75482-045d-4f12-ae36-70f877cb348f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bfa75482-045d-4f12-ae36-70f877cb348f" (UID: "bfa75482-045d-4f12-ae36-70f877cb348f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:26:56.570514 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:56.570429    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfa75482-045d-4f12-ae36-70f877cb348f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bfa75482-045d-4f12-ae36-70f877cb348f" (UID: "bfa75482-045d-4f12-ae36-70f877cb348f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:26:56.570720 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:56.570535    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfa75482-045d-4f12-ae36-70f877cb348f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bfa75482-045d-4f12-ae36-70f877cb348f" (UID: "bfa75482-045d-4f12-ae36-70f877cb348f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:26:56.570783 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:56.570732    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfa75482-045d-4f12-ae36-70f877cb348f-credential-socket\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:26:56.570783 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:56.570751    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfa75482-045d-4f12-ae36-70f877cb348f-workload-socket\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:26:56.570783 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:56.570765    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfa75482-045d-4f12-ae36-70f877cb348f-istio-data\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:26:56.571116 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:56.570819    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfa75482-045d-4f12-ae36-70f877cb348f-workload-certs\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:26:56.571116 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:56.570912    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfa75482-045d-4f12-ae36-70f877cb348f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bfa75482-045d-4f12-ae36-70f877cb348f" (UID: "bfa75482-045d-4f12-ae36-70f877cb348f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 04:26:56.572334 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:56.572304    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfa75482-045d-4f12-ae36-70f877cb348f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bfa75482-045d-4f12-ae36-70f877cb348f" (UID: "bfa75482-045d-4f12-ae36-70f877cb348f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:26:56.572334 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:56.572322    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfa75482-045d-4f12-ae36-70f877cb348f-kube-api-access-7zclg" (OuterVolumeSpecName: "kube-api-access-7zclg") pod "bfa75482-045d-4f12-ae36-70f877cb348f" (UID: "bfa75482-045d-4f12-ae36-70f877cb348f"). InnerVolumeSpecName "kube-api-access-7zclg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:26:56.572492 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:56.572395    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfa75482-045d-4f12-ae36-70f877cb348f-istio-token" (OuterVolumeSpecName: "istio-token") pod "bfa75482-045d-4f12-ae36-70f877cb348f" (UID: "bfa75482-045d-4f12-ae36-70f877cb348f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:26:56.572492 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:56.572408    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bfa75482-045d-4f12-ae36-70f877cb348f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bfa75482-045d-4f12-ae36-70f877cb348f" (UID: "bfa75482-045d-4f12-ae36-70f877cb348f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 04:26:56.671468 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:56.671427    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zclg\" (UniqueName: \"kubernetes.io/projected/bfa75482-045d-4f12-ae36-70f877cb348f-kube-api-access-7zclg\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:26:56.671468 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:56.671462    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfa75482-045d-4f12-ae36-70f877cb348f-istio-podinfo\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:26:56.671666 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:56.671477    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfa75482-045d-4f12-ae36-70f877cb348f-istio-token\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:26:56.671666 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:56.671490    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfa75482-045d-4f12-ae36-70f877cb348f-istio-envoy\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:26:56.671666 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:56.671505    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfa75482-045d-4f12-ae36-70f877cb348f-istiod-ca-cert\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:26:56.698199 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:56.698172    2573 generic.go:356] "Generic (PLEG): container finished" podID="bfa75482-045d-4f12-ae36-70f877cb348f" containerID="35043aab23f7587bf82222ba400ce2db64cabc0c9366c2e471f1585400e32c32" exitCode=0
Sep 08 04:26:56.698312 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:56.698226    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"
Sep 08 04:26:56.698312 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:56.698249    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj" event={"ID":"bfa75482-045d-4f12-ae36-70f877cb348f","Type":"ContainerDied","Data":"35043aab23f7587bf82222ba400ce2db64cabc0c9366c2e471f1585400e32c32"}
Sep 08 04:26:56.698417 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:56.698317    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj" event={"ID":"bfa75482-045d-4f12-ae36-70f877cb348f","Type":"ContainerDied","Data":"578e2ccdf08385818546f6cd9f1da66f5f5242a2b62eb2dd598d6c909189af30"}
Sep 08 04:26:56.698417 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:56.698344    2573 scope.go:117] "RemoveContainer" containerID="35043aab23f7587bf82222ba400ce2db64cabc0c9366c2e471f1585400e32c32"
Sep 08 04:26:56.707532 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:56.707512    2573 scope.go:117] "RemoveContainer" containerID="1a6a1e9d356948bfa6427c1bbff4b085ecdb9580d6b927ff424be3d0ff6300ee"
Sep 08 04:26:56.715585 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:56.715548    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"]
Sep 08 04:26:56.716285 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:56.716267    2573 scope.go:117] "RemoveContainer" containerID="35043aab23f7587bf82222ba400ce2db64cabc0c9366c2e471f1585400e32c32"
Sep 08 04:26:56.716583 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:26:56.716540    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35043aab23f7587bf82222ba400ce2db64cabc0c9366c2e471f1585400e32c32\": container with ID starting with 35043aab23f7587bf82222ba400ce2db64cabc0c9366c2e471f1585400e32c32 not found: ID does not exist" containerID="35043aab23f7587bf82222ba400ce2db64cabc0c9366c2e471f1585400e32c32"
Sep 08 04:26:56.716712 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:56.716690    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35043aab23f7587bf82222ba400ce2db64cabc0c9366c2e471f1585400e32c32"} err="failed to get container status \"35043aab23f7587bf82222ba400ce2db64cabc0c9366c2e471f1585400e32c32\": rpc error: code = NotFound desc = could not find container \"35043aab23f7587bf82222ba400ce2db64cabc0c9366c2e471f1585400e32c32\": container with ID starting with 35043aab23f7587bf82222ba400ce2db64cabc0c9366c2e471f1585400e32c32 not found: ID does not exist"
Sep 08 04:26:56.716797 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:56.716716    2573 scope.go:117] "RemoveContainer" containerID="1a6a1e9d356948bfa6427c1bbff4b085ecdb9580d6b927ff424be3d0ff6300ee"
Sep 08 04:26:56.716996 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:26:56.716979    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a6a1e9d356948bfa6427c1bbff4b085ecdb9580d6b927ff424be3d0ff6300ee\": container with ID starting with 1a6a1e9d356948bfa6427c1bbff4b085ecdb9580d6b927ff424be3d0ff6300ee not found: ID does not exist" containerID="1a6a1e9d356948bfa6427c1bbff4b085ecdb9580d6b927ff424be3d0ff6300ee"
Sep 08 04:26:56.717046 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:56.717000    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a6a1e9d356948bfa6427c1bbff4b085ecdb9580d6b927ff424be3d0ff6300ee"} err="failed to get container status \"1a6a1e9d356948bfa6427c1bbff4b085ecdb9580d6b927ff424be3d0ff6300ee\": rpc error: code = NotFound desc = could not find container \"1a6a1e9d356948bfa6427c1bbff4b085ecdb9580d6b927ff424be3d0ff6300ee\": container with ID starting with 1a6a1e9d356948bfa6427c1bbff4b085ecdb9580d6b927ff424be3d0ff6300ee not found: ID does not exist"
Sep 08 04:26:56.722214 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:56.722196    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj"]
Sep 08 04:26:58.674897 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:26:58.674856    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfa75482-045d-4f12-ae36-70f877cb348f" path="/var/lib/kubelet/pods/bfa75482-045d-4f12-ae36-70f877cb348f/volumes"
Sep 08 04:28:51.848288 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:28:51.848261    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-72hb9_170d8dd1-15b0-4fb0-ab11-eefe97714cbd/payload-processing/0.log"
Sep 08 04:30:00.634242 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:00.634215    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-72hb9_170d8dd1-15b0-4fb0-ab11-eefe97714cbd/payload-processing/0.log"
Sep 08 04:30:01.335638 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.335602    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"]
Sep 08 04:30:01.336303 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.336278    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfa75482-045d-4f12-ae36-70f877cb348f" containerName="istio-proxy"
Sep 08 04:30:01.336303 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.336305    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfa75482-045d-4f12-ae36-70f877cb348f" containerName="istio-proxy"
Sep 08 04:30:01.336452 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.336319    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfa75482-045d-4f12-ae36-70f877cb348f" containerName="istio-proxy"
Sep 08 04:30:01.336452 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.336325    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfa75482-045d-4f12-ae36-70f877cb348f" containerName="istio-proxy"
Sep 08 04:30:01.336452 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.336333    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d4bb651-f6c3-4973-bcca-d81dc95c029b" containerName="maas-api"
Sep 08 04:30:01.336452 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.336339    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d4bb651-f6c3-4973-bcca-d81dc95c029b" containerName="maas-api"
Sep 08 04:30:01.336452 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.336345    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98bb97ab-62fb-46fe-8b9a-804a036c1a5a" containerName="istio-proxy"
Sep 08 04:30:01.336452 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.336352    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="98bb97ab-62fb-46fe-8b9a-804a036c1a5a" containerName="istio-proxy"
Sep 08 04:30:01.336452 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.336360    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e" containerName="istio-proxy"
Sep 08 04:30:01.336452 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.336365    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e" containerName="istio-proxy"
Sep 08 04:30:01.336452 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.336371    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e" containerName="istio-proxy"
Sep 08 04:30:01.336452 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.336376    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e" containerName="istio-proxy"
Sep 08 04:30:01.336452 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.336393    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98bb97ab-62fb-46fe-8b9a-804a036c1a5a" containerName="istio-proxy"
Sep 08 04:30:01.336452 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.336397    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="98bb97ab-62fb-46fe-8b9a-804a036c1a5a" containerName="istio-proxy"
Sep 08 04:30:01.337010 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.336470    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfa75482-045d-4f12-ae36-70f877cb348f" containerName="istio-proxy"
Sep 08 04:30:01.337010 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.336476    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e" containerName="istio-proxy"
Sep 08 04:30:01.337010 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.336484    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="530583f8-f2d3-4a4c-b8b7-b1ed59cfc94e" containerName="istio-proxy"
Sep 08 04:30:01.337010 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.336492    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d4bb651-f6c3-4973-bcca-d81dc95c029b" containerName="maas-api"
Sep 08 04:30:01.337010 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.336498    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="98bb97ab-62fb-46fe-8b9a-804a036c1a5a" containerName="istio-proxy"
Sep 08 04:30:01.337010 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.336503    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="98bb97ab-62fb-46fe-8b9a-804a036c1a5a" containerName="istio-proxy"
Sep 08 04:30:01.339934 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.339908    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"
Sep 08 04:30:01.342441 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.342422    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-431421-openshift-default-dockercfg-kdgx6\""
Sep 08 04:30:01.357597 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.357541    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdb005b4-7026-439b-89bc-f572b4bb7293-credential-socket\") pod \"e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn\" (UID: \"fdb005b4-7026-439b-89bc-f572b4bb7293\") " pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"
Sep 08 04:30:01.357685 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.357639    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdb005b4-7026-439b-89bc-f572b4bb7293-workload-socket\") pod \"e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn\" (UID: \"fdb005b4-7026-439b-89bc-f572b4bb7293\") " pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"
Sep 08 04:30:01.357685 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.357671    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdb005b4-7026-439b-89bc-f572b4bb7293-istio-podinfo\") pod \"e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn\" (UID: \"fdb005b4-7026-439b-89bc-f572b4bb7293\") " pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"
Sep 08 04:30:01.357809 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.357784    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swhqb\" (UniqueName: \"kubernetes.io/projected/fdb005b4-7026-439b-89bc-f572b4bb7293-kube-api-access-swhqb\") pod \"e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn\" (UID: \"fdb005b4-7026-439b-89bc-f572b4bb7293\") " pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"
Sep 08 04:30:01.357869 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.357845    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdb005b4-7026-439b-89bc-f572b4bb7293-istiod-ca-cert\") pod \"e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn\" (UID: \"fdb005b4-7026-439b-89bc-f572b4bb7293\") " pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"
Sep 08 04:30:01.357949 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.357936    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdb005b4-7026-439b-89bc-f572b4bb7293-workload-certs\") pod \"e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn\" (UID: \"fdb005b4-7026-439b-89bc-f572b4bb7293\") " pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"
Sep 08 04:30:01.358007 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.357973    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdb005b4-7026-439b-89bc-f572b4bb7293-istio-envoy\") pod \"e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn\" (UID: \"fdb005b4-7026-439b-89bc-f572b4bb7293\") " pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"
Sep 08 04:30:01.358063 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.358012    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdb005b4-7026-439b-89bc-f572b4bb7293-istio-data\") pod \"e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn\" (UID: \"fdb005b4-7026-439b-89bc-f572b4bb7293\") " pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"
Sep 08 04:30:01.358063 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.358053    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdb005b4-7026-439b-89bc-f572b4bb7293-istio-token\") pod \"e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn\" (UID: \"fdb005b4-7026-439b-89bc-f572b4bb7293\") " pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"
Sep 08 04:30:01.358137 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.358105    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"]
Sep 08 04:30:01.458691 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.458650    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdb005b4-7026-439b-89bc-f572b4bb7293-istiod-ca-cert\") pod \"e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn\" (UID: \"fdb005b4-7026-439b-89bc-f572b4bb7293\") " pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"
Sep 08 04:30:01.458860 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.458742    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdb005b4-7026-439b-89bc-f572b4bb7293-workload-certs\") pod \"e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn\" (UID: \"fdb005b4-7026-439b-89bc-f572b4bb7293\") " pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"
Sep 08 04:30:01.458860 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.458774    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdb005b4-7026-439b-89bc-f572b4bb7293-istio-envoy\") pod \"e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn\" (UID: \"fdb005b4-7026-439b-89bc-f572b4bb7293\") " pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"
Sep 08 04:30:01.458860 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.458805    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdb005b4-7026-439b-89bc-f572b4bb7293-istio-data\") pod \"e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn\" (UID: \"fdb005b4-7026-439b-89bc-f572b4bb7293\") " pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"
Sep 08 04:30:01.458860 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.458844    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdb005b4-7026-439b-89bc-f572b4bb7293-istio-token\") pod \"e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn\" (UID: \"fdb005b4-7026-439b-89bc-f572b4bb7293\") " pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"
Sep 08 04:30:01.459094 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.458886    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdb005b4-7026-439b-89bc-f572b4bb7293-credential-socket\") pod \"e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn\" (UID: \"fdb005b4-7026-439b-89bc-f572b4bb7293\") " pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"
Sep 08 04:30:01.459094 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.458919    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdb005b4-7026-439b-89bc-f572b4bb7293-workload-socket\") pod \"e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn\" (UID: \"fdb005b4-7026-439b-89bc-f572b4bb7293\") " pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"
Sep 08 04:30:01.459094 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.458944    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdb005b4-7026-439b-89bc-f572b4bb7293-istio-podinfo\") pod \"e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn\" (UID: \"fdb005b4-7026-439b-89bc-f572b4bb7293\") " pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"
Sep 08 04:30:01.459094 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.459039    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swhqb\" (UniqueName: \"kubernetes.io/projected/fdb005b4-7026-439b-89bc-f572b4bb7293-kube-api-access-swhqb\") pod \"e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn\" (UID: \"fdb005b4-7026-439b-89bc-f572b4bb7293\") " pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"
Sep 08 04:30:01.459326 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.459248    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdb005b4-7026-439b-89bc-f572b4bb7293-workload-certs\") pod \"e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn\" (UID: \"fdb005b4-7026-439b-89bc-f572b4bb7293\") " pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"
Sep 08 04:30:01.459383 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.459322    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdb005b4-7026-439b-89bc-f572b4bb7293-istio-data\") pod \"e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn\" (UID: \"fdb005b4-7026-439b-89bc-f572b4bb7293\") " pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"
Sep 08 04:30:01.459531 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.459506    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdb005b4-7026-439b-89bc-f572b4bb7293-istiod-ca-cert\") pod \"e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn\" (UID: \"fdb005b4-7026-439b-89bc-f572b4bb7293\") " pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"
Sep 08 04:30:01.459731 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.459505    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdb005b4-7026-439b-89bc-f572b4bb7293-workload-socket\") pod \"e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn\" (UID: \"fdb005b4-7026-439b-89bc-f572b4bb7293\") " pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"
Sep 08 04:30:01.459731 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.459611    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdb005b4-7026-439b-89bc-f572b4bb7293-credential-socket\") pod \"e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn\" (UID: \"fdb005b4-7026-439b-89bc-f572b4bb7293\") " pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"
Sep 08 04:30:01.461400 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.461380    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdb005b4-7026-439b-89bc-f572b4bb7293-istio-envoy\") pod \"e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn\" (UID: \"fdb005b4-7026-439b-89bc-f572b4bb7293\") " pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"
Sep 08 04:30:01.461752 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.461732    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdb005b4-7026-439b-89bc-f572b4bb7293-istio-podinfo\") pod \"e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn\" (UID: \"fdb005b4-7026-439b-89bc-f572b4bb7293\") " pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"
Sep 08 04:30:01.468341 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.468314    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdb005b4-7026-439b-89bc-f572b4bb7293-istio-token\") pod \"e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn\" (UID: \"fdb005b4-7026-439b-89bc-f572b4bb7293\") " pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"
Sep 08 04:30:01.468469 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.468451    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swhqb\" (UniqueName: \"kubernetes.io/projected/fdb005b4-7026-439b-89bc-f572b4bb7293-kube-api-access-swhqb\") pod \"e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn\" (UID: \"fdb005b4-7026-439b-89bc-f572b4bb7293\") " pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"
Sep 08 04:30:01.652460 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.652371    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"
Sep 08 04:30:01.934575 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.934531    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"]
Sep 08 04:30:01.936336 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:30:01.936310    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdb005b4_7026_439b_89bc_f572b4bb7293.slice/crio-d1129b7c1215ae19153108d944bc1d9ab9f53cb659540e2944b39f6e8fa74a8d WatchSource:0}: Error finding container d1129b7c1215ae19153108d944bc1d9ab9f53cb659540e2944b39f6e8fa74a8d: Status 404 returned error can't find the container with id d1129b7c1215ae19153108d944bc1d9ab9f53cb659540e2944b39f6e8fa74a8d
Sep 08 04:30:01.938791 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.938756    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:30:01.938881 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.938819    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:30:01.938881 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:01.938846    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:30:02.762916 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:02.762872    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn" event={"ID":"fdb005b4-7026-439b-89bc-f572b4bb7293","Type":"ContainerStarted","Data":"b251e007e549f2428a70fa32456c65a0445fd18fab4ceb5ea0de5a88e422f121"}
Sep 08 04:30:02.763363 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:02.762930    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn" event={"ID":"fdb005b4-7026-439b-89bc-f572b4bb7293","Type":"ContainerStarted","Data":"d1129b7c1215ae19153108d944bc1d9ab9f53cb659540e2944b39f6e8fa74a8d"}
Sep 08 04:30:02.787295 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:02.787184    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn" podStartSLOduration=1.787168718 podStartE2EDuration="1.787168718s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:30:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:30:02.785067307 +0000 UTC m=+1762.570358544" watchObservedRunningTime="2026-09-08 04:30:02.787168718 +0000 UTC m=+1762.572459955"
Sep 08 04:30:03.652902 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:03.652865    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"
Sep 08 04:30:03.658324 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:03.658300    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"
Sep 08 04:30:03.769073 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:03.769043    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"
Sep 08 04:30:03.769968 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:03.769952    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"
Sep 08 04:30:06.005516 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:06.005484    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd"]
Sep 08 04:30:06.006305 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:06.006273    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfa75482-045d-4f12-ae36-70f877cb348f" containerName="istio-proxy"
Sep 08 04:30:06.009712 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:06.009533    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd"
Sep 08 04:30:06.012572 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:06.012530    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-431421-serving-cert\""
Sep 08 04:30:06.026355 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:06.026335    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd"]
Sep 08 04:30:06.101660 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:06.101631    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4185001-9a9a-4050-b4b8-a2147ade5545-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd\" (UID: \"f4185001-9a9a-4050-b4b8-a2147ade5545\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd"
Sep 08 04:30:06.101808 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:06.101669    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4185001-9a9a-4050-b4b8-a2147ade5545-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd\" (UID: \"f4185001-9a9a-4050-b4b8-a2147ade5545\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd"
Sep 08 04:30:06.101854 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:06.101815    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4185001-9a9a-4050-b4b8-a2147ade5545-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd\" (UID: \"f4185001-9a9a-4050-b4b8-a2147ade5545\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd"
Sep 08 04:30:06.101890 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:06.101849    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbltr\" (UniqueName: \"kubernetes.io/projected/f4185001-9a9a-4050-b4b8-a2147ade5545-kube-api-access-xbltr\") pod \"maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd\" (UID: \"f4185001-9a9a-4050-b4b8-a2147ade5545\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd"
Sep 08 04:30:06.202514 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:06.202479    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4185001-9a9a-4050-b4b8-a2147ade5545-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd\" (UID: \"f4185001-9a9a-4050-b4b8-a2147ade5545\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd"
Sep 08 04:30:06.202710 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:06.202536    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbltr\" (UniqueName: \"kubernetes.io/projected/f4185001-9a9a-4050-b4b8-a2147ade5545-kube-api-access-xbltr\") pod \"maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd\" (UID: \"f4185001-9a9a-4050-b4b8-a2147ade5545\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd"
Sep 08 04:30:06.202710 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:30:06.202632    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-431421-serving-cert: secret "maas-api-e2e-ipp-cleanup-431421-serving-cert" not found
Sep 08 04:30:06.202710 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:30:06.202699    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4185001-9a9a-4050-b4b8-a2147ade5545-maas-api-tls podName:f4185001-9a9a-4050-b4b8-a2147ade5545 nodeName:}" failed. No retries permitted until 2026-09-08 04:30:06.702683074 +0000 UTC m=+1766.487974288 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f4185001-9a9a-4050-b4b8-a2147ade5545-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd" (UID: "f4185001-9a9a-4050-b4b8-a2147ade5545") : secret "maas-api-e2e-ipp-cleanup-431421-serving-cert" not found
Sep 08 04:30:06.202710 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:06.202637    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4185001-9a9a-4050-b4b8-a2147ade5545-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd\" (UID: \"f4185001-9a9a-4050-b4b8-a2147ade5545\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd"
Sep 08 04:30:06.202945 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:06.202765    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4185001-9a9a-4050-b4b8-a2147ade5545-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd\" (UID: \"f4185001-9a9a-4050-b4b8-a2147ade5545\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd"
Sep 08 04:30:06.203311 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:06.203289    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4185001-9a9a-4050-b4b8-a2147ade5545-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd\" (UID: \"f4185001-9a9a-4050-b4b8-a2147ade5545\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd"
Sep 08 04:30:06.205390 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:06.205365    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4185001-9a9a-4050-b4b8-a2147ade5545-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd\" (UID: \"f4185001-9a9a-4050-b4b8-a2147ade5545\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd"
Sep 08 04:30:06.213802 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:06.213781    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbltr\" (UniqueName: \"kubernetes.io/projected/f4185001-9a9a-4050-b4b8-a2147ade5545-kube-api-access-xbltr\") pod \"maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd\" (UID: \"f4185001-9a9a-4050-b4b8-a2147ade5545\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd"
Sep 08 04:30:06.708263 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:06.708229    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4185001-9a9a-4050-b4b8-a2147ade5545-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd\" (UID: \"f4185001-9a9a-4050-b4b8-a2147ade5545\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd"
Sep 08 04:30:06.710859 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:06.710836    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4185001-9a9a-4050-b4b8-a2147ade5545-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd\" (UID: \"f4185001-9a9a-4050-b4b8-a2147ade5545\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd"
Sep 08 04:30:06.924023 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:06.923972    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd"
Sep 08 04:30:07.205158 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:07.205123    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd"]
Sep 08 04:30:07.205699 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:30:07.205669    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4185001_9a9a_4050_b4b8_a2147ade5545.slice/crio-b1510e5e0e3107f0e019abe107de2ea78ffbb61350f4e8e712cf9401d603ebdd WatchSource:0}: Error finding container b1510e5e0e3107f0e019abe107de2ea78ffbb61350f4e8e712cf9401d603ebdd: Status 404 returned error can't find the container with id b1510e5e0e3107f0e019abe107de2ea78ffbb61350f4e8e712cf9401d603ebdd
Sep 08 04:30:07.207326 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:07.207306    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 04:30:07.793848 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:07.793809    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd" event={"ID":"f4185001-9a9a-4050-b4b8-a2147ade5545","Type":"ContainerStarted","Data":"4bc4705ce940cedfc40998636c90abdca2087224f6e661d5b1f71fa76c5a13c0"}
Sep 08 04:30:07.794025 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:07.793879    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd" event={"ID":"f4185001-9a9a-4050-b4b8-a2147ade5545","Type":"ContainerStarted","Data":"b1510e5e0e3107f0e019abe107de2ea78ffbb61350f4e8e712cf9401d603ebdd"}
Sep 08 04:30:07.794025 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:07.793973    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd"
Sep 08 04:30:07.816427 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:07.816380    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd" podStartSLOduration=2.314677374 podStartE2EDuration="2.816363859s" totalImagesPullingTime="501.686485ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:30:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:30:07.813633422 +0000 UTC m=+1767.598924654" watchObservedRunningTime="2026-09-08 04:30:07.816363859 +0000 UTC m=+1767.601655094"
Sep 08 04:30:13.805837 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:13.805804    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd"
Sep 08 04:30:26.905784 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:26.905740    2573 generic.go:356] "Generic (PLEG): container finished" podID="fdb005b4-7026-439b-89bc-f572b4bb7293" containerID="b251e007e549f2428a70fa32456c65a0445fd18fab4ceb5ea0de5a88e422f121" exitCode=0
Sep 08 04:30:26.906184 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:26.905811    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn" event={"ID":"fdb005b4-7026-439b-89bc-f572b4bb7293","Type":"ContainerDied","Data":"b251e007e549f2428a70fa32456c65a0445fd18fab4ceb5ea0de5a88e422f121"}
Sep 08 04:30:26.906227 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:26.906209    2573 scope.go:117] "RemoveContainer" containerID="b251e007e549f2428a70fa32456c65a0445fd18fab4ceb5ea0de5a88e422f121"
Sep 08 04:30:26.907367 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:26.907329    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:30:26.907491 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:26.907398    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:30:26.907491 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:26.907431    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 04:30:27.917432 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:27.917403    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn" event={"ID":"fdb005b4-7026-439b-89bc-f572b4bb7293","Type":"ContainerStarted","Data":"2116c3b59b82d489e88fbbb31626616632e4fba037a92208e6fea682284f83bc"}
Sep 08 04:30:28.653126 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:28.653085    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"
Sep 08 04:30:28.653317 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:28.653274    2573 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 08 04:30:28.653374 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:28.653326    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn" podUID="fdb005b4-7026-439b-89bc-f572b4bb7293" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 08 04:30:29.653058 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:29.653017    2573 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 08 04:30:29.653438 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:29.653081    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn" podUID="fdb005b4-7026-439b-89bc-f572b4bb7293" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 08 04:30:30.653032 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:30.652986    2573 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 08 04:30:30.653238 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:30.653053    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn" podUID="fdb005b4-7026-439b-89bc-f572b4bb7293" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 08 04:30:31.653132 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:31.653053    2573 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 08 04:30:31.653132 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:31.653109    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn" podUID="fdb005b4-7026-439b-89bc-f572b4bb7293" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 08 04:30:32.653654 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:32.653615    2573 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 08 04:30:32.654071 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:32.653674    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn" podUID="fdb005b4-7026-439b-89bc-f572b4bb7293" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 08 04:30:33.657072 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:33.657040    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"
Sep 08 04:30:33.657427 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:33.657367    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"
Sep 08 04:30:33.657992 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:33.657975    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"
Sep 08 04:30:37.041662 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:37.041630    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd"]
Sep 08 04:30:37.042237 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:37.041877    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd" podUID="f4185001-9a9a-4050-b4b8-a2147ade5545" containerName="maas-api" containerID="cri-o://4bc4705ce940cedfc40998636c90abdca2087224f6e661d5b1f71fa76c5a13c0" gracePeriod=30
Sep 08 04:30:37.310772 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:37.310747    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd"
Sep 08 04:30:37.433464 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:37.433436    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4185001-9a9a-4050-b4b8-a2147ade5545-openshift-service-ca\") pod \"f4185001-9a9a-4050-b4b8-a2147ade5545\" (UID: \"f4185001-9a9a-4050-b4b8-a2147ade5545\") "
Sep 08 04:30:37.433642 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:37.433507    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4185001-9a9a-4050-b4b8-a2147ade5545-metrics-certs\") pod \"f4185001-9a9a-4050-b4b8-a2147ade5545\" (UID: \"f4185001-9a9a-4050-b4b8-a2147ade5545\") "
Sep 08 04:30:37.433642 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:37.433532    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4185001-9a9a-4050-b4b8-a2147ade5545-maas-api-tls\") pod \"f4185001-9a9a-4050-b4b8-a2147ade5545\" (UID: \"f4185001-9a9a-4050-b4b8-a2147ade5545\") "
Sep 08 04:30:37.433773 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:37.433658    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbltr\" (UniqueName: \"kubernetes.io/projected/f4185001-9a9a-4050-b4b8-a2147ade5545-kube-api-access-xbltr\") pod \"f4185001-9a9a-4050-b4b8-a2147ade5545\" (UID: \"f4185001-9a9a-4050-b4b8-a2147ade5545\") "
Sep 08 04:30:37.433833 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:37.433810    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4185001-9a9a-4050-b4b8-a2147ade5545-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f4185001-9a9a-4050-b4b8-a2147ade5545" (UID: "f4185001-9a9a-4050-b4b8-a2147ade5545"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 04:30:37.434011 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:37.433988    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4185001-9a9a-4050-b4b8-a2147ade5545-openshift-service-ca\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:30:37.435795 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:37.435765    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4185001-9a9a-4050-b4b8-a2147ade5545-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f4185001-9a9a-4050-b4b8-a2147ade5545" (UID: "f4185001-9a9a-4050-b4b8-a2147ade5545"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:30:37.435901 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:37.435812    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4185001-9a9a-4050-b4b8-a2147ade5545-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f4185001-9a9a-4050-b4b8-a2147ade5545" (UID: "f4185001-9a9a-4050-b4b8-a2147ade5545"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:30:37.435901 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:37.435833    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4185001-9a9a-4050-b4b8-a2147ade5545-kube-api-access-xbltr" (OuterVolumeSpecName: "kube-api-access-xbltr") pod "f4185001-9a9a-4050-b4b8-a2147ade5545" (UID: "f4185001-9a9a-4050-b4b8-a2147ade5545"). InnerVolumeSpecName "kube-api-access-xbltr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:30:37.535329 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:37.535294    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4185001-9a9a-4050-b4b8-a2147ade5545-metrics-certs\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:30:37.535329 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:37.535322    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4185001-9a9a-4050-b4b8-a2147ade5545-maas-api-tls\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:30:37.535329 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:37.535332    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbltr\" (UniqueName: \"kubernetes.io/projected/f4185001-9a9a-4050-b4b8-a2147ade5545-kube-api-access-xbltr\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:30:37.973925 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:37.973886    2573 generic.go:356] "Generic (PLEG): container finished" podID="f4185001-9a9a-4050-b4b8-a2147ade5545" containerID="4bc4705ce940cedfc40998636c90abdca2087224f6e661d5b1f71fa76c5a13c0" exitCode=0
Sep 08 04:30:37.974107 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:37.973935    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd"
Sep 08 04:30:37.974107 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:37.973972    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd" event={"ID":"f4185001-9a9a-4050-b4b8-a2147ade5545","Type":"ContainerDied","Data":"4bc4705ce940cedfc40998636c90abdca2087224f6e661d5b1f71fa76c5a13c0"}
Sep 08 04:30:37.974107 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:37.974033    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd" event={"ID":"f4185001-9a9a-4050-b4b8-a2147ade5545","Type":"ContainerDied","Data":"b1510e5e0e3107f0e019abe107de2ea78ffbb61350f4e8e712cf9401d603ebdd"}
Sep 08 04:30:37.974107 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:37.974060    2573 scope.go:117] "RemoveContainer" containerID="4bc4705ce940cedfc40998636c90abdca2087224f6e661d5b1f71fa76c5a13c0"
Sep 08 04:30:37.984047 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:37.984029    2573 scope.go:117] "RemoveContainer" containerID="4bc4705ce940cedfc40998636c90abdca2087224f6e661d5b1f71fa76c5a13c0"
Sep 08 04:30:37.984313 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:30:37.984291    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bc4705ce940cedfc40998636c90abdca2087224f6e661d5b1f71fa76c5a13c0\": container with ID starting with 4bc4705ce940cedfc40998636c90abdca2087224f6e661d5b1f71fa76c5a13c0 not found: ID does not exist" containerID="4bc4705ce940cedfc40998636c90abdca2087224f6e661d5b1f71fa76c5a13c0"
Sep 08 04:30:37.984384 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:37.984321    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bc4705ce940cedfc40998636c90abdca2087224f6e661d5b1f71fa76c5a13c0"} err="failed to get container status \"4bc4705ce940cedfc40998636c90abdca2087224f6e661d5b1f71fa76c5a13c0\": rpc error: code = NotFound desc = could not find container \"4bc4705ce940cedfc40998636c90abdca2087224f6e661d5b1f71fa76c5a13c0\": container with ID starting with 4bc4705ce940cedfc40998636c90abdca2087224f6e661d5b1f71fa76c5a13c0 not found: ID does not exist"
Sep 08 04:30:37.996219 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:37.996194    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd"]
Sep 08 04:30:37.999181 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:37.999160    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-431421-7cfd8646fd-kqpnd"]
Sep 08 04:30:38.675792 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:38.675763    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4185001-9a9a-4050-b4b8-a2147ade5545" path="/var/lib/kubelet/pods/f4185001-9a9a-4050-b4b8-a2147ade5545/volumes"
Sep 08 04:30:44.241540 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:44.241494    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"]
Sep 08 04:30:44.242116 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:44.241777    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn" podUID="fdb005b4-7026-439b-89bc-f572b4bb7293" containerName="istio-proxy" containerID="cri-o://2116c3b59b82d489e88fbbb31626616632e4fba037a92208e6fea682284f83bc" gracePeriod=30
Sep 08 04:30:48.659802 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:48.659761    2573 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 04:30:48.660184 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:48.659842    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn" podUID="fdb005b4-7026-439b-89bc-f572b4bb7293" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 04:30:49.496385 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:49.496352    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"
Sep 08 04:30:49.554047 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:49.554020    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdb005b4-7026-439b-89bc-f572b4bb7293-istio-envoy\") pod \"fdb005b4-7026-439b-89bc-f572b4bb7293\" (UID: \"fdb005b4-7026-439b-89bc-f572b4bb7293\") "
Sep 08 04:30:49.554223 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:49.554080    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdb005b4-7026-439b-89bc-f572b4bb7293-istiod-ca-cert\") pod \"fdb005b4-7026-439b-89bc-f572b4bb7293\" (UID: \"fdb005b4-7026-439b-89bc-f572b4bb7293\") "
Sep 08 04:30:49.554223 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:49.554108    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdb005b4-7026-439b-89bc-f572b4bb7293-workload-certs\") pod \"fdb005b4-7026-439b-89bc-f572b4bb7293\" (UID: \"fdb005b4-7026-439b-89bc-f572b4bb7293\") "
Sep 08 04:30:49.554223 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:49.554143    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdb005b4-7026-439b-89bc-f572b4bb7293-workload-socket\") pod \"fdb005b4-7026-439b-89bc-f572b4bb7293\" (UID: \"fdb005b4-7026-439b-89bc-f572b4bb7293\") "
Sep 08 04:30:49.554223 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:49.554158    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdb005b4-7026-439b-89bc-f572b4bb7293-istio-data\") pod \"fdb005b4-7026-439b-89bc-f572b4bb7293\" (UID: \"fdb005b4-7026-439b-89bc-f572b4bb7293\") "
Sep 08 04:30:49.554223 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:49.554190    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdb005b4-7026-439b-89bc-f572b4bb7293-credential-socket\") pod \"fdb005b4-7026-439b-89bc-f572b4bb7293\" (UID: \"fdb005b4-7026-439b-89bc-f572b4bb7293\") "
Sep 08 04:30:49.554223 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:49.554222    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdb005b4-7026-439b-89bc-f572b4bb7293-istio-podinfo\") pod \"fdb005b4-7026-439b-89bc-f572b4bb7293\" (UID: \"fdb005b4-7026-439b-89bc-f572b4bb7293\") "
Sep 08 04:30:49.554580 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:49.554246    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdb005b4-7026-439b-89bc-f572b4bb7293-istio-token\") pod \"fdb005b4-7026-439b-89bc-f572b4bb7293\" (UID: \"fdb005b4-7026-439b-89bc-f572b4bb7293\") "
Sep 08 04:30:49.554580 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:49.554308    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swhqb\" (UniqueName: \"kubernetes.io/projected/fdb005b4-7026-439b-89bc-f572b4bb7293-kube-api-access-swhqb\") pod \"fdb005b4-7026-439b-89bc-f572b4bb7293\" (UID: \"fdb005b4-7026-439b-89bc-f572b4bb7293\") "
Sep 08 04:30:49.554580 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:49.554397    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdb005b4-7026-439b-89bc-f572b4bb7293-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fdb005b4-7026-439b-89bc-f572b4bb7293" (UID: "fdb005b4-7026-439b-89bc-f572b4bb7293"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:30:49.554580 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:49.554474    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdb005b4-7026-439b-89bc-f572b4bb7293-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fdb005b4-7026-439b-89bc-f572b4bb7293" (UID: "fdb005b4-7026-439b-89bc-f572b4bb7293"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:30:49.554580 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:49.554487    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdb005b4-7026-439b-89bc-f572b4bb7293-istio-data" (OuterVolumeSpecName: "istio-data") pod "fdb005b4-7026-439b-89bc-f572b4bb7293" (UID: "fdb005b4-7026-439b-89bc-f572b4bb7293"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:30:49.555011 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:49.554693    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdb005b4-7026-439b-89bc-f572b4bb7293-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fdb005b4-7026-439b-89bc-f572b4bb7293" (UID: "fdb005b4-7026-439b-89bc-f572b4bb7293"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 04:30:49.555011 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:49.554721    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdb005b4-7026-439b-89bc-f572b4bb7293-workload-socket\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:30:49.555011 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:49.554744    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdb005b4-7026-439b-89bc-f572b4bb7293-istio-data\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:30:49.555011 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:49.554759    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdb005b4-7026-439b-89bc-f572b4bb7293-workload-certs\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:30:49.555011 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:49.554763    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdb005b4-7026-439b-89bc-f572b4bb7293-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fdb005b4-7026-439b-89bc-f572b4bb7293" (UID: "fdb005b4-7026-439b-89bc-f572b4bb7293"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:30:49.556547 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:49.556519    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdb005b4-7026-439b-89bc-f572b4bb7293-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fdb005b4-7026-439b-89bc-f572b4bb7293" (UID: "fdb005b4-7026-439b-89bc-f572b4bb7293"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:30:49.556547 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:49.556536    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdb005b4-7026-439b-89bc-f572b4bb7293-kube-api-access-swhqb" (OuterVolumeSpecName: "kube-api-access-swhqb") pod "fdb005b4-7026-439b-89bc-f572b4bb7293" (UID: "fdb005b4-7026-439b-89bc-f572b4bb7293"). InnerVolumeSpecName "kube-api-access-swhqb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:30:49.556547 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:49.556522    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fdb005b4-7026-439b-89bc-f572b4bb7293-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fdb005b4-7026-439b-89bc-f572b4bb7293" (UID: "fdb005b4-7026-439b-89bc-f572b4bb7293"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 04:30:49.556735 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:49.556674    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdb005b4-7026-439b-89bc-f572b4bb7293-istio-token" (OuterVolumeSpecName: "istio-token") pod "fdb005b4-7026-439b-89bc-f572b4bb7293" (UID: "fdb005b4-7026-439b-89bc-f572b4bb7293"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:30:49.655472 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:49.655389    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swhqb\" (UniqueName: \"kubernetes.io/projected/fdb005b4-7026-439b-89bc-f572b4bb7293-kube-api-access-swhqb\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:30:49.655472 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:49.655420    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdb005b4-7026-439b-89bc-f572b4bb7293-istio-envoy\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:30:49.655472 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:49.655431    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdb005b4-7026-439b-89bc-f572b4bb7293-istiod-ca-cert\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:30:49.655472 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:49.655439    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdb005b4-7026-439b-89bc-f572b4bb7293-credential-socket\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:30:49.655472 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:49.655448    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdb005b4-7026-439b-89bc-f572b4bb7293-istio-podinfo\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:30:49.655472 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:49.655455    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdb005b4-7026-439b-89bc-f572b4bb7293-istio-token\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:30:50.054056 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:50.054020    2573 generic.go:356] "Generic (PLEG): container finished" podID="fdb005b4-7026-439b-89bc-f572b4bb7293" containerID="2116c3b59b82d489e88fbbb31626616632e4fba037a92208e6fea682284f83bc" exitCode=0
Sep 08 04:30:50.054504 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:50.054068    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"
Sep 08 04:30:50.054504 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:50.054094    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn" event={"ID":"fdb005b4-7026-439b-89bc-f572b4bb7293","Type":"ContainerDied","Data":"2116c3b59b82d489e88fbbb31626616632e4fba037a92208e6fea682284f83bc"}
Sep 08 04:30:50.054504 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:50.054145    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn" event={"ID":"fdb005b4-7026-439b-89bc-f572b4bb7293","Type":"ContainerDied","Data":"d1129b7c1215ae19153108d944bc1d9ab9f53cb659540e2944b39f6e8fa74a8d"}
Sep 08 04:30:50.054504 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:50.054169    2573 scope.go:117] "RemoveContainer" containerID="2116c3b59b82d489e88fbbb31626616632e4fba037a92208e6fea682284f83bc"
Sep 08 04:30:50.064068 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:50.064051    2573 scope.go:117] "RemoveContainer" containerID="b251e007e549f2428a70fa32456c65a0445fd18fab4ceb5ea0de5a88e422f121"
Sep 08 04:30:50.072910 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:50.072893    2573 scope.go:117] "RemoveContainer" containerID="2116c3b59b82d489e88fbbb31626616632e4fba037a92208e6fea682284f83bc"
Sep 08 04:30:50.073317 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:30:50.073290    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2116c3b59b82d489e88fbbb31626616632e4fba037a92208e6fea682284f83bc\": container with ID starting with 2116c3b59b82d489e88fbbb31626616632e4fba037a92208e6fea682284f83bc not found: ID does not exist" containerID="2116c3b59b82d489e88fbbb31626616632e4fba037a92208e6fea682284f83bc"
Sep 08 04:30:50.073412 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:50.073328    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2116c3b59b82d489e88fbbb31626616632e4fba037a92208e6fea682284f83bc"} err="failed to get container status \"2116c3b59b82d489e88fbbb31626616632e4fba037a92208e6fea682284f83bc\": rpc error: code = NotFound desc = could not find container \"2116c3b59b82d489e88fbbb31626616632e4fba037a92208e6fea682284f83bc\": container with ID starting with 2116c3b59b82d489e88fbbb31626616632e4fba037a92208e6fea682284f83bc not found: ID does not exist"
Sep 08 04:30:50.073412 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:50.073354    2573 scope.go:117] "RemoveContainer" containerID="b251e007e549f2428a70fa32456c65a0445fd18fab4ceb5ea0de5a88e422f121"
Sep 08 04:30:50.073747 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:30:50.073718    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b251e007e549f2428a70fa32456c65a0445fd18fab4ceb5ea0de5a88e422f121\": container with ID starting with b251e007e549f2428a70fa32456c65a0445fd18fab4ceb5ea0de5a88e422f121 not found: ID does not exist" containerID="b251e007e549f2428a70fa32456c65a0445fd18fab4ceb5ea0de5a88e422f121"
Sep 08 04:30:50.073824 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:50.073750    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b251e007e549f2428a70fa32456c65a0445fd18fab4ceb5ea0de5a88e422f121"} err="failed to get container status \"b251e007e549f2428a70fa32456c65a0445fd18fab4ceb5ea0de5a88e422f121\": rpc error: code = NotFound desc = could not find container \"b251e007e549f2428a70fa32456c65a0445fd18fab4ceb5ea0de5a88e422f121\": container with ID starting with b251e007e549f2428a70fa32456c65a0445fd18fab4ceb5ea0de5a88e422f121 not found: ID does not exist"
Sep 08 04:30:50.076242 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:50.076221    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"]
Sep 08 04:30:50.080219 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:50.080201    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn"]
Sep 08 04:30:50.681764 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:30:50.678942    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdb005b4-7026-439b-89bc-f572b4bb7293" path="/var/lib/kubelet/pods/fdb005b4-7026-439b-89bc-f572b4bb7293/volumes"
Sep 08 04:32:16.877341 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:16.877146    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c2a8bb-84b4b6f8f5-695gk"]
Sep 08 04:32:16.878170 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:16.878103    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c2a8bb-84b4b6f8f5-695gk" podUID="6d3f5a10-a752-4cbe-98ca-1012f225873a" containerName="maas-api" containerID="cri-o://45e5f540ba78e900227d469d72d33e2448da41a536ea1bce6d2d6a824b00adb9" gracePeriod=30
Sep 08 04:32:17.143121 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:17.143051    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c2a8bb-84b4b6f8f5-695gk"
Sep 08 04:32:17.214138 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:17.214106    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d3f5a10-a752-4cbe-98ca-1012f225873a-metrics-certs\") pod \"6d3f5a10-a752-4cbe-98ca-1012f225873a\" (UID: \"6d3f5a10-a752-4cbe-98ca-1012f225873a\") "
Sep 08 04:32:17.214306 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:17.214156    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqgh4\" (UniqueName: \"kubernetes.io/projected/6d3f5a10-a752-4cbe-98ca-1012f225873a-kube-api-access-rqgh4\") pod \"6d3f5a10-a752-4cbe-98ca-1012f225873a\" (UID: \"6d3f5a10-a752-4cbe-98ca-1012f225873a\") "
Sep 08 04:32:17.214306 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:17.214194    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d3f5a10-a752-4cbe-98ca-1012f225873a-openshift-service-ca\") pod \"6d3f5a10-a752-4cbe-98ca-1012f225873a\" (UID: \"6d3f5a10-a752-4cbe-98ca-1012f225873a\") "
Sep 08 04:32:17.214306 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:17.214276    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d3f5a10-a752-4cbe-98ca-1012f225873a-maas-api-tls\") pod \"6d3f5a10-a752-4cbe-98ca-1012f225873a\" (UID: \"6d3f5a10-a752-4cbe-98ca-1012f225873a\") "
Sep 08 04:32:17.214651 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:17.214616    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d3f5a10-a752-4cbe-98ca-1012f225873a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6d3f5a10-a752-4cbe-98ca-1012f225873a" (UID: "6d3f5a10-a752-4cbe-98ca-1012f225873a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 04:32:17.214748 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:17.214698    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d3f5a10-a752-4cbe-98ca-1012f225873a-openshift-service-ca\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:32:17.216513 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:17.216487    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d3f5a10-a752-4cbe-98ca-1012f225873a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6d3f5a10-a752-4cbe-98ca-1012f225873a" (UID: "6d3f5a10-a752-4cbe-98ca-1012f225873a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:32:17.216513 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:17.216492    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d3f5a10-a752-4cbe-98ca-1012f225873a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6d3f5a10-a752-4cbe-98ca-1012f225873a" (UID: "6d3f5a10-a752-4cbe-98ca-1012f225873a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:32:17.216697 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:17.216532    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d3f5a10-a752-4cbe-98ca-1012f225873a-kube-api-access-rqgh4" (OuterVolumeSpecName: "kube-api-access-rqgh4") pod "6d3f5a10-a752-4cbe-98ca-1012f225873a" (UID: "6d3f5a10-a752-4cbe-98ca-1012f225873a"). InnerVolumeSpecName "kube-api-access-rqgh4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:32:17.315369 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:17.315343    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d3f5a10-a752-4cbe-98ca-1012f225873a-metrics-certs\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:32:17.315369 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:17.315367    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqgh4\" (UniqueName: \"kubernetes.io/projected/6d3f5a10-a752-4cbe-98ca-1012f225873a-kube-api-access-rqgh4\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:32:17.315591 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:17.315379    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d3f5a10-a752-4cbe-98ca-1012f225873a-maas-api-tls\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:32:17.562677 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:17.562605    2573 generic.go:356] "Generic (PLEG): container finished" podID="6d3f5a10-a752-4cbe-98ca-1012f225873a" containerID="45e5f540ba78e900227d469d72d33e2448da41a536ea1bce6d2d6a824b00adb9" exitCode=0
Sep 08 04:32:17.562677 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:17.562667    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c2a8bb-84b4b6f8f5-695gk" event={"ID":"6d3f5a10-a752-4cbe-98ca-1012f225873a","Type":"ContainerDied","Data":"45e5f540ba78e900227d469d72d33e2448da41a536ea1bce6d2d6a824b00adb9"}
Sep 08 04:32:17.562926 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:17.562721    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c2a8bb-84b4b6f8f5-695gk" event={"ID":"6d3f5a10-a752-4cbe-98ca-1012f225873a","Type":"ContainerDied","Data":"417de1af7e91d2939b517f0fa45686e4bd72673743a13f01454b8af2d0d04ab7"}
Sep 08 04:32:17.562926 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:17.562651    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c2a8bb-84b4b6f8f5-695gk"
Sep 08 04:32:17.562926 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:17.562747    2573 scope.go:117] "RemoveContainer" containerID="45e5f540ba78e900227d469d72d33e2448da41a536ea1bce6d2d6a824b00adb9"
Sep 08 04:32:17.575772 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:17.575749    2573 scope.go:117] "RemoveContainer" containerID="45e5f540ba78e900227d469d72d33e2448da41a536ea1bce6d2d6a824b00adb9"
Sep 08 04:32:17.576062 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:32:17.576042    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45e5f540ba78e900227d469d72d33e2448da41a536ea1bce6d2d6a824b00adb9\": container with ID starting with 45e5f540ba78e900227d469d72d33e2448da41a536ea1bce6d2d6a824b00adb9 not found: ID does not exist" containerID="45e5f540ba78e900227d469d72d33e2448da41a536ea1bce6d2d6a824b00adb9"
Sep 08 04:32:17.576135 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:17.576074    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45e5f540ba78e900227d469d72d33e2448da41a536ea1bce6d2d6a824b00adb9"} err="failed to get container status \"45e5f540ba78e900227d469d72d33e2448da41a536ea1bce6d2d6a824b00adb9\": rpc error: code = NotFound desc = could not find container \"45e5f540ba78e900227d469d72d33e2448da41a536ea1bce6d2d6a824b00adb9\": container with ID starting with 45e5f540ba78e900227d469d72d33e2448da41a536ea1bce6d2d6a824b00adb9 not found: ID does not exist"
Sep 08 04:32:17.591362 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:17.591323    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c2a8bb-84b4b6f8f5-695gk"]
Sep 08 04:32:17.594038 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:17.594014    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c2a8bb-84b4b6f8f5-695gk"]
Sep 08 04:32:18.675766 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:18.675729    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d3f5a10-a752-4cbe-98ca-1012f225873a" path="/var/lib/kubelet/pods/6d3f5a10-a752-4cbe-98ca-1012f225873a/volumes"
Sep 08 04:32:34.792426 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:34.792378    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-720789-846cbdfbbf-td6rg"]
Sep 08 04:32:34.793889 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:34.793821    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-720789-846cbdfbbf-td6rg" podUID="33688555-96cc-427b-85b7-87ac8bacadcf" containerName="maas-api" containerID="cri-o://dda109ef67a24177ff11dfc3a16438c0bd31e60a4f2ce4dac4e96869c894f704" gracePeriod=30
Sep 08 04:32:35.054175 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:35.054118    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-720789-846cbdfbbf-td6rg"
Sep 08 04:32:35.182914 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:35.182883    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zc87t\" (UniqueName: \"kubernetes.io/projected/33688555-96cc-427b-85b7-87ac8bacadcf-kube-api-access-zc87t\") pod \"33688555-96cc-427b-85b7-87ac8bacadcf\" (UID: \"33688555-96cc-427b-85b7-87ac8bacadcf\") "
Sep 08 04:32:35.183088 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:35.182969    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/33688555-96cc-427b-85b7-87ac8bacadcf-metrics-certs\") pod \"33688555-96cc-427b-85b7-87ac8bacadcf\" (UID: \"33688555-96cc-427b-85b7-87ac8bacadcf\") "
Sep 08 04:32:35.183088 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:35.183009    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33688555-96cc-427b-85b7-87ac8bacadcf-openshift-service-ca\") pod \"33688555-96cc-427b-85b7-87ac8bacadcf\" (UID: \"33688555-96cc-427b-85b7-87ac8bacadcf\") "
Sep 08 04:32:35.183270 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:35.183189    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33688555-96cc-427b-85b7-87ac8bacadcf-maas-api-tls\") pod \"33688555-96cc-427b-85b7-87ac8bacadcf\" (UID: \"33688555-96cc-427b-85b7-87ac8bacadcf\") "
Sep 08 04:32:35.183454 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:35.183428    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33688555-96cc-427b-85b7-87ac8bacadcf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "33688555-96cc-427b-85b7-87ac8bacadcf" (UID: "33688555-96cc-427b-85b7-87ac8bacadcf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 04:32:35.183672 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:35.183647    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33688555-96cc-427b-85b7-87ac8bacadcf-openshift-service-ca\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:32:35.185722 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:35.185685    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33688555-96cc-427b-85b7-87ac8bacadcf-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "33688555-96cc-427b-85b7-87ac8bacadcf" (UID: "33688555-96cc-427b-85b7-87ac8bacadcf"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:32:35.185906 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:35.185882    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33688555-96cc-427b-85b7-87ac8bacadcf-kube-api-access-zc87t" (OuterVolumeSpecName: "kube-api-access-zc87t") pod "33688555-96cc-427b-85b7-87ac8bacadcf" (UID: "33688555-96cc-427b-85b7-87ac8bacadcf"). InnerVolumeSpecName "kube-api-access-zc87t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:32:35.186009 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:35.185987    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33688555-96cc-427b-85b7-87ac8bacadcf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "33688555-96cc-427b-85b7-87ac8bacadcf" (UID: "33688555-96cc-427b-85b7-87ac8bacadcf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:32:35.284885 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:35.284847    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/33688555-96cc-427b-85b7-87ac8bacadcf-metrics-certs\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:32:35.284885 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:35.284877    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33688555-96cc-427b-85b7-87ac8bacadcf-maas-api-tls\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:32:35.284885 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:35.284889    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zc87t\" (UniqueName: \"kubernetes.io/projected/33688555-96cc-427b-85b7-87ac8bacadcf-kube-api-access-zc87t\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:32:35.666778 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:35.666745    2573 generic.go:356] "Generic (PLEG): container finished" podID="33688555-96cc-427b-85b7-87ac8bacadcf" containerID="dda109ef67a24177ff11dfc3a16438c0bd31e60a4f2ce4dac4e96869c894f704" exitCode=0
Sep 08 04:32:35.666946 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:35.666791    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-720789-846cbdfbbf-td6rg"
Sep 08 04:32:35.666946 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:35.666828    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-720789-846cbdfbbf-td6rg" event={"ID":"33688555-96cc-427b-85b7-87ac8bacadcf","Type":"ContainerDied","Data":"dda109ef67a24177ff11dfc3a16438c0bd31e60a4f2ce4dac4e96869c894f704"}
Sep 08 04:32:35.666946 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:35.666890    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-720789-846cbdfbbf-td6rg" event={"ID":"33688555-96cc-427b-85b7-87ac8bacadcf","Type":"ContainerDied","Data":"798338a7523b472011cc7189fe4a7b6abca5dac43a23c1087dfd70c7b6539942"}
Sep 08 04:32:35.666946 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:35.666914    2573 scope.go:117] "RemoveContainer" containerID="dda109ef67a24177ff11dfc3a16438c0bd31e60a4f2ce4dac4e96869c894f704"
Sep 08 04:32:35.677129 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:35.677105    2573 scope.go:117] "RemoveContainer" containerID="dda109ef67a24177ff11dfc3a16438c0bd31e60a4f2ce4dac4e96869c894f704"
Sep 08 04:32:35.677409 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:32:35.677384    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dda109ef67a24177ff11dfc3a16438c0bd31e60a4f2ce4dac4e96869c894f704\": container with ID starting with dda109ef67a24177ff11dfc3a16438c0bd31e60a4f2ce4dac4e96869c894f704 not found: ID does not exist" containerID="dda109ef67a24177ff11dfc3a16438c0bd31e60a4f2ce4dac4e96869c894f704"
Sep 08 04:32:35.677471 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:35.677417    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dda109ef67a24177ff11dfc3a16438c0bd31e60a4f2ce4dac4e96869c894f704"} err="failed to get container status \"dda109ef67a24177ff11dfc3a16438c0bd31e60a4f2ce4dac4e96869c894f704\": rpc error: code = NotFound desc = could not find container \"dda109ef67a24177ff11dfc3a16438c0bd31e60a4f2ce4dac4e96869c894f704\": container with ID starting with dda109ef67a24177ff11dfc3a16438c0bd31e60a4f2ce4dac4e96869c894f704 not found: ID does not exist"
Sep 08 04:32:35.690714 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:35.690686    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-720789-846cbdfbbf-td6rg"]
Sep 08 04:32:35.693476 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:35.693458    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-720789-846cbdfbbf-td6rg"]
Sep 08 04:32:36.675877 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:36.675844    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33688555-96cc-427b-85b7-87ac8bacadcf" path="/var/lib/kubelet/pods/33688555-96cc-427b-85b7-87ac8bacadcf/volumes"
Sep 08 04:32:41.819142 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:41.819110    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"]
Sep 08 04:32:41.819649 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:41.819375    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl" podUID="fa8e3e75-f6f5-4d8c-97b2-23ec87f78415" containerName="istio-proxy" containerID="cri-o://c27242511111864c9850fb04be17a2c5f9d0c93c70419387846f7f03931c9bdf" gracePeriod=30
Sep 08 04:32:44.570771 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:44.570731    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f86964c84-tvwxb"]
Sep 08 04:32:44.571635 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:44.571576    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-f86964c84-tvwxb" podUID="7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef" containerName="manager" containerID="cri-o://17fd25fa01a62fab1af7b25cb47d1237d18d39ee181024abb0fbd8bda4fd5032" gracePeriod=30
Sep 08 04:32:44.720114 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:44.720064    2573 generic.go:356] "Generic (PLEG): container finished" podID="7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef" containerID="17fd25fa01a62fab1af7b25cb47d1237d18d39ee181024abb0fbd8bda4fd5032" exitCode=0
Sep 08 04:32:44.720288 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:44.720250    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f86964c84-tvwxb" event={"ID":"7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef","Type":"ContainerDied","Data":"17fd25fa01a62fab1af7b25cb47d1237d18d39ee181024abb0fbd8bda4fd5032"}
Sep 08 04:32:44.832638 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:44.832583    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f86964c84-tvwxb"
Sep 08 04:32:44.878651 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:44.878620    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef-metrics-certs\") pod \"7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef\" (UID: \"7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef\") "
Sep 08 04:32:44.878800 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:44.878667    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-587qx\" (UniqueName: \"kubernetes.io/projected/7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef-kube-api-access-587qx\") pod \"7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef\" (UID: \"7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef\") "
Sep 08 04:32:44.878882 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:44.878862    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef-webhook-cert\") pod \"7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef\" (UID: \"7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef\") "
Sep 08 04:32:44.881039 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:44.881013    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef" (UID: "7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:32:44.881289 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:44.881261    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef" (UID: "7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:32:44.881289 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:44.881274    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef-kube-api-access-587qx" (OuterVolumeSpecName: "kube-api-access-587qx") pod "7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef" (UID: "7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef"). InnerVolumeSpecName "kube-api-access-587qx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:32:44.979829 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:44.979795    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef-metrics-certs\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:32:44.979829 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:44.979823    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-587qx\" (UniqueName: \"kubernetes.io/projected/7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef-kube-api-access-587qx\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:32:44.980015 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:44.979837    2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef-webhook-cert\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:32:45.727927 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:45.727898    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f86964c84-tvwxb"
Sep 08 04:32:45.728361 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:45.727944    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f86964c84-tvwxb" event={"ID":"7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef","Type":"ContainerDied","Data":"0dac2f585842cb30645096adff7260ececc2572f4b212ea29e4dd9f0df1d2fd9"}
Sep 08 04:32:45.728361 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:45.728003    2573 scope.go:117] "RemoveContainer" containerID="17fd25fa01a62fab1af7b25cb47d1237d18d39ee181024abb0fbd8bda4fd5032"
Sep 08 04:32:45.749409 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:45.749379    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f86964c84-tvwxb"]
Sep 08 04:32:45.753566 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:45.753527    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-f86964c84-tvwxb"]
Sep 08 04:32:46.675548 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:46.675510    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef" path="/var/lib/kubelet/pods/7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef/volumes"
Sep 08 04:32:47.082180 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:47.082159    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"
Sep 08 04:32:47.101161 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:47.101133    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-workload-socket\") pod \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\" (UID: \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\") "
Sep 08 04:32:47.101308 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:47.101196    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnntr\" (UniqueName: \"kubernetes.io/projected/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-kube-api-access-tnntr\") pod \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\" (UID: \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\") "
Sep 08 04:32:47.101308 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:47.101234    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-istiod-ca-cert\") pod \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\" (UID: \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\") "
Sep 08 04:32:47.101308 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:47.101262    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-istio-podinfo\") pod \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\" (UID: \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\") "
Sep 08 04:32:47.101476 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:47.101309    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-istio-envoy\") pod \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\" (UID: \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\") "
Sep 08 04:32:47.101476 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:47.101354    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-credential-socket\") pod \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\" (UID: \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\") "
Sep 08 04:32:47.101476 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:47.101412    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fa8e3e75-f6f5-4d8c-97b2-23ec87f78415" (UID: "fa8e3e75-f6f5-4d8c-97b2-23ec87f78415"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:32:47.101734 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:47.101706    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fa8e3e75-f6f5-4d8c-97b2-23ec87f78415" (UID: "fa8e3e75-f6f5-4d8c-97b2-23ec87f78415"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 04:32:47.101734 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:47.101716    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fa8e3e75-f6f5-4d8c-97b2-23ec87f78415" (UID: "fa8e3e75-f6f5-4d8c-97b2-23ec87f78415"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:32:47.101910 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:47.101781    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-istio-data\") pod \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\" (UID: \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\") "
Sep 08 04:32:47.101910 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:47.101827    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-istio-token\") pod \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\" (UID: \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\") "
Sep 08 04:32:47.101910 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:47.101855    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-workload-certs\") pod \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\" (UID: \"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415\") "
Sep 08 04:32:47.102331 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:47.102076    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-istio-data" (OuterVolumeSpecName: "istio-data") pod "fa8e3e75-f6f5-4d8c-97b2-23ec87f78415" (UID: "fa8e3e75-f6f5-4d8c-97b2-23ec87f78415"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:32:47.102331 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:47.102235    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-credential-socket\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:32:47.102331 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:47.102289    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-istio-data\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:32:47.102331 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:47.102300    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fa8e3e75-f6f5-4d8c-97b2-23ec87f78415" (UID: "fa8e3e75-f6f5-4d8c-97b2-23ec87f78415"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:32:47.102331 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:47.102305    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-workload-socket\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:32:47.102331 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:47.102329    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-istiod-ca-cert\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:32:47.103749 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:47.103722    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fa8e3e75-f6f5-4d8c-97b2-23ec87f78415" (UID: "fa8e3e75-f6f5-4d8c-97b2-23ec87f78415"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 04:32:47.104049 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:47.104020    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fa8e3e75-f6f5-4d8c-97b2-23ec87f78415" (UID: "fa8e3e75-f6f5-4d8c-97b2-23ec87f78415"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:32:47.104128 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:47.104081    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-kube-api-access-tnntr" (OuterVolumeSpecName: "kube-api-access-tnntr") pod "fa8e3e75-f6f5-4d8c-97b2-23ec87f78415" (UID: "fa8e3e75-f6f5-4d8c-97b2-23ec87f78415"). InnerVolumeSpecName "kube-api-access-tnntr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:32:47.104320 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:47.104300    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-istio-token" (OuterVolumeSpecName: "istio-token") pod "fa8e3e75-f6f5-4d8c-97b2-23ec87f78415" (UID: "fa8e3e75-f6f5-4d8c-97b2-23ec87f78415"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:32:47.202928 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:47.202839    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnntr\" (UniqueName: \"kubernetes.io/projected/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-kube-api-access-tnntr\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:32:47.202928 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:47.202869    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-istio-podinfo\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:32:47.202928 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:47.202882    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-istio-envoy\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:32:47.202928 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:47.202893    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-istio-token\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:32:47.202928 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:47.202904    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415-workload-certs\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:32:47.744238 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:47.744201    2573 generic.go:356] "Generic (PLEG): container finished" podID="fa8e3e75-f6f5-4d8c-97b2-23ec87f78415" containerID="c27242511111864c9850fb04be17a2c5f9d0c93c70419387846f7f03931c9bdf" exitCode=0
Sep 08 04:32:47.744434 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:47.744254    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"
Sep 08 04:32:47.744434 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:47.744249    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl" event={"ID":"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415","Type":"ContainerDied","Data":"c27242511111864c9850fb04be17a2c5f9d0c93c70419387846f7f03931c9bdf"}
Sep 08 04:32:47.744434 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:47.744317    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl" event={"ID":"fa8e3e75-f6f5-4d8c-97b2-23ec87f78415","Type":"ContainerDied","Data":"8385ccb9b74e387908f952e753dde5be6ad5cc8aa5ff636641cacc75374b011c"}
Sep 08 04:32:47.744434 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:47.744352    2573 scope.go:117] "RemoveContainer" containerID="c27242511111864c9850fb04be17a2c5f9d0c93c70419387846f7f03931c9bdf"
Sep 08 04:32:47.756578 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:47.756546    2573 scope.go:117] "RemoveContainer" containerID="681f017f7d1a544106c1c437dba09c77703452752dd47b386430e864a8e31350"
Sep 08 04:32:47.764879 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:47.764865    2573 scope.go:117] "RemoveContainer" containerID="c27242511111864c9850fb04be17a2c5f9d0c93c70419387846f7f03931c9bdf"
Sep 08 04:32:47.765137 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:32:47.765118    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c27242511111864c9850fb04be17a2c5f9d0c93c70419387846f7f03931c9bdf\": container with ID starting with c27242511111864c9850fb04be17a2c5f9d0c93c70419387846f7f03931c9bdf not found: ID does not exist" containerID="c27242511111864c9850fb04be17a2c5f9d0c93c70419387846f7f03931c9bdf"
Sep 08 04:32:47.765208 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:47.765145    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c27242511111864c9850fb04be17a2c5f9d0c93c70419387846f7f03931c9bdf"} err="failed to get container status \"c27242511111864c9850fb04be17a2c5f9d0c93c70419387846f7f03931c9bdf\": rpc error: code = NotFound desc = could not find container \"c27242511111864c9850fb04be17a2c5f9d0c93c70419387846f7f03931c9bdf\": container with ID starting with c27242511111864c9850fb04be17a2c5f9d0c93c70419387846f7f03931c9bdf not found: ID does not exist"
Sep 08 04:32:47.765208 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:47.765160    2573 scope.go:117] "RemoveContainer" containerID="681f017f7d1a544106c1c437dba09c77703452752dd47b386430e864a8e31350"
Sep 08 04:32:47.765396 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:32:47.765375    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"681f017f7d1a544106c1c437dba09c77703452752dd47b386430e864a8e31350\": container with ID starting with 681f017f7d1a544106c1c437dba09c77703452752dd47b386430e864a8e31350 not found: ID does not exist" containerID="681f017f7d1a544106c1c437dba09c77703452752dd47b386430e864a8e31350"
Sep 08 04:32:47.765430 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:47.765403    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"681f017f7d1a544106c1c437dba09c77703452752dd47b386430e864a8e31350"} err="failed to get container status \"681f017f7d1a544106c1c437dba09c77703452752dd47b386430e864a8e31350\": rpc error: code = NotFound desc = could not find container \"681f017f7d1a544106c1c437dba09c77703452752dd47b386430e864a8e31350\": container with ID starting with 681f017f7d1a544106c1c437dba09c77703452752dd47b386430e864a8e31350 not found: ID does not exist"
Sep 08 04:32:47.772791 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:47.772769    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"]
Sep 08 04:32:47.779885 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:47.779865    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl"]
Sep 08 04:32:48.675022 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:32:48.674992    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa8e3e75-f6f5-4d8c-97b2-23ec87f78415" path="/var/lib/kubelet/pods/fa8e3e75-f6f5-4d8c-97b2-23ec87f78415/volumes"
Sep 08 04:33:46.608459 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:46.608424    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-f86964c84-h8wl4"]
Sep 08 04:33:46.608912 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:46.608865    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4185001-9a9a-4050-b4b8-a2147ade5545" containerName="maas-api"
Sep 08 04:33:46.608912 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:46.608877    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4185001-9a9a-4050-b4b8-a2147ade5545" containerName="maas-api"
Sep 08 04:33:46.608912 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:46.608891    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef" containerName="manager"
Sep 08 04:33:46.608912 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:46.608898    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef" containerName="manager"
Sep 08 04:33:46.608912 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:46.608904    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d3f5a10-a752-4cbe-98ca-1012f225873a" containerName="maas-api"
Sep 08 04:33:46.608912 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:46.608910    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d3f5a10-a752-4cbe-98ca-1012f225873a" containerName="maas-api"
Sep 08 04:33:46.609102 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:46.608918    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa8e3e75-f6f5-4d8c-97b2-23ec87f78415" containerName="istio-proxy"
Sep 08 04:33:46.609102 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:46.608923    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa8e3e75-f6f5-4d8c-97b2-23ec87f78415" containerName="istio-proxy"
Sep 08 04:33:46.609102 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:46.608934    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdb005b4-7026-439b-89bc-f572b4bb7293" containerName="istio-proxy"
Sep 08 04:33:46.609102 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:46.608938    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdb005b4-7026-439b-89bc-f572b4bb7293" containerName="istio-proxy"
Sep 08 04:33:46.609102 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:46.608946    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa8e3e75-f6f5-4d8c-97b2-23ec87f78415" containerName="istio-proxy"
Sep 08 04:33:46.609102 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:46.608952    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa8e3e75-f6f5-4d8c-97b2-23ec87f78415" containerName="istio-proxy"
Sep 08 04:33:46.609102 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:46.608959    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdb005b4-7026-439b-89bc-f572b4bb7293" containerName="istio-proxy"
Sep 08 04:33:46.609102 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:46.608964    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdb005b4-7026-439b-89bc-f572b4bb7293" containerName="istio-proxy"
Sep 08 04:33:46.609102 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:46.608978    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33688555-96cc-427b-85b7-87ac8bacadcf" containerName="maas-api"
Sep 08 04:33:46.609102 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:46.608982    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="33688555-96cc-427b-85b7-87ac8bacadcf" containerName="maas-api"
Sep 08 04:33:46.609102 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:46.609049    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdb005b4-7026-439b-89bc-f572b4bb7293" containerName="istio-proxy"
Sep 08 04:33:46.609102 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:46.609056    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdb005b4-7026-439b-89bc-f572b4bb7293" containerName="istio-proxy"
Sep 08 04:33:46.609102 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:46.609063    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa8e3e75-f6f5-4d8c-97b2-23ec87f78415" containerName="istio-proxy"
Sep 08 04:33:46.609102 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:46.609069    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4185001-9a9a-4050-b4b8-a2147ade5545" containerName="maas-api"
Sep 08 04:33:46.609102 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:46.609076    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d3f5a10-a752-4cbe-98ca-1012f225873a" containerName="maas-api"
Sep 08 04:33:46.609102 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:46.609082    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="7edd45d6-5ece-4f16-a2ad-9e4fd0dccdef" containerName="manager"
Sep 08 04:33:46.609102 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:46.609088    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="33688555-96cc-427b-85b7-87ac8bacadcf" containerName="maas-api"
Sep 08 04:33:46.612207 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:46.612188    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f86964c84-h8wl4"
Sep 08 04:33:46.616059 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:46.616037    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-g7lt2\""
Sep 08 04:33:46.616192 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:46.616037    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 08 04:33:46.616192 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:46.616071    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 08 04:33:46.616192 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:46.616038    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 08 04:33:46.621212 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:46.621193    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f86964c84-h8wl4"]
Sep 08 04:33:46.758327 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:46.758298    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dfc0ca68-f3a5-4224-b6df-f5629a22beb8-webhook-cert\") pod \"maas-controller-f86964c84-h8wl4\" (UID: \"dfc0ca68-f3a5-4224-b6df-f5629a22beb8\") " pod="opendatahub/maas-controller-f86964c84-h8wl4"
Sep 08 04:33:46.758499 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:46.758374    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tdzs\" (UniqueName: \"kubernetes.io/projected/dfc0ca68-f3a5-4224-b6df-f5629a22beb8-kube-api-access-6tdzs\") pod \"maas-controller-f86964c84-h8wl4\" (UID: \"dfc0ca68-f3a5-4224-b6df-f5629a22beb8\") " pod="opendatahub/maas-controller-f86964c84-h8wl4"
Sep 08 04:33:46.758499 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:46.758434    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfc0ca68-f3a5-4224-b6df-f5629a22beb8-metrics-certs\") pod \"maas-controller-f86964c84-h8wl4\" (UID: \"dfc0ca68-f3a5-4224-b6df-f5629a22beb8\") " pod="opendatahub/maas-controller-f86964c84-h8wl4"
Sep 08 04:33:46.859543 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:46.859463    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfc0ca68-f3a5-4224-b6df-f5629a22beb8-metrics-certs\") pod \"maas-controller-f86964c84-h8wl4\" (UID: \"dfc0ca68-f3a5-4224-b6df-f5629a22beb8\") " pod="opendatahub/maas-controller-f86964c84-h8wl4"
Sep 08 04:33:46.859734 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:46.859578    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dfc0ca68-f3a5-4224-b6df-f5629a22beb8-webhook-cert\") pod \"maas-controller-f86964c84-h8wl4\" (UID: \"dfc0ca68-f3a5-4224-b6df-f5629a22beb8\") " pod="opendatahub/maas-controller-f86964c84-h8wl4"
Sep 08 04:33:46.859734 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:46.859635    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tdzs\" (UniqueName: \"kubernetes.io/projected/dfc0ca68-f3a5-4224-b6df-f5629a22beb8-kube-api-access-6tdzs\") pod \"maas-controller-f86964c84-h8wl4\" (UID: \"dfc0ca68-f3a5-4224-b6df-f5629a22beb8\") " pod="opendatahub/maas-controller-f86964c84-h8wl4"
Sep 08 04:33:46.862325 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:46.862303    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfc0ca68-f3a5-4224-b6df-f5629a22beb8-metrics-certs\") pod \"maas-controller-f86964c84-h8wl4\" (UID: \"dfc0ca68-f3a5-4224-b6df-f5629a22beb8\") " pod="opendatahub/maas-controller-f86964c84-h8wl4"
Sep 08 04:33:46.862469 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:46.862370    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dfc0ca68-f3a5-4224-b6df-f5629a22beb8-webhook-cert\") pod \"maas-controller-f86964c84-h8wl4\" (UID: \"dfc0ca68-f3a5-4224-b6df-f5629a22beb8\") " pod="opendatahub/maas-controller-f86964c84-h8wl4"
Sep 08 04:33:46.867990 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:46.867968    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tdzs\" (UniqueName: \"kubernetes.io/projected/dfc0ca68-f3a5-4224-b6df-f5629a22beb8-kube-api-access-6tdzs\") pod \"maas-controller-f86964c84-h8wl4\" (UID: \"dfc0ca68-f3a5-4224-b6df-f5629a22beb8\") " pod="opendatahub/maas-controller-f86964c84-h8wl4"
Sep 08 04:33:46.923952 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:46.923924    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f86964c84-h8wl4"
Sep 08 04:33:47.195744 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:47.195668    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f86964c84-h8wl4"]
Sep 08 04:33:47.199712 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:33:47.199674    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfc0ca68_f3a5_4224_b6df_f5629a22beb8.slice/crio-4d78edb7bb98d10fd3e541d9df849af4ece09aa4d830b2a916cc25bd7632c9ce WatchSource:0}: Error finding container 4d78edb7bb98d10fd3e541d9df849af4ece09aa4d830b2a916cc25bd7632c9ce: Status 404 returned error can't find the container with id 4d78edb7bb98d10fd3e541d9df849af4ece09aa4d830b2a916cc25bd7632c9ce
Sep 08 04:33:48.070089 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:48.070049    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f86964c84-h8wl4" event={"ID":"dfc0ca68-f3a5-4224-b6df-f5629a22beb8","Type":"ContainerStarted","Data":"1d09c6594219252af413f444ce0e102f97148b20b283fce3b88b3d2842b0e00b"}
Sep 08 04:33:48.070486 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:48.070136    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f86964c84-h8wl4" event={"ID":"dfc0ca68-f3a5-4224-b6df-f5629a22beb8","Type":"ContainerStarted","Data":"4d78edb7bb98d10fd3e541d9df849af4ece09aa4d830b2a916cc25bd7632c9ce"}
Sep 08 04:33:48.070486 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:48.070162    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-f86964c84-h8wl4"
Sep 08 04:33:48.088834 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:48.088793    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-f86964c84-h8wl4" podStartSLOduration=1.634223768 podStartE2EDuration="2.088779124s" totalImagesPullingTime="454.555356ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:33:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:33:48.087169968 +0000 UTC m=+1987.872461227" watchObservedRunningTime="2026-09-08 04:33:48.088779124 +0000 UTC m=+1987.874070360"
Sep 08 04:33:59.078133 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:33:59.078100    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-f86964c84-h8wl4"
Sep 08 04:34:08.511255 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:08.511211    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f86964c84-h8wl4"]
Sep 08 04:34:08.511699 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:08.511458    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-f86964c84-h8wl4" podUID="dfc0ca68-f3a5-4224-b6df-f5629a22beb8" containerName="manager" containerID="cri-o://1d09c6594219252af413f444ce0e102f97148b20b283fce3b88b3d2842b0e00b" gracePeriod=30
Sep 08 04:34:08.759599 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:08.759573    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f86964c84-h8wl4"
Sep 08 04:34:08.852877 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:08.852805    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfc0ca68-f3a5-4224-b6df-f5629a22beb8-metrics-certs\") pod \"dfc0ca68-f3a5-4224-b6df-f5629a22beb8\" (UID: \"dfc0ca68-f3a5-4224-b6df-f5629a22beb8\") "
Sep 08 04:34:08.852877 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:08.852862    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dfc0ca68-f3a5-4224-b6df-f5629a22beb8-webhook-cert\") pod \"dfc0ca68-f3a5-4224-b6df-f5629a22beb8\" (UID: \"dfc0ca68-f3a5-4224-b6df-f5629a22beb8\") "
Sep 08 04:34:08.853047 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:08.852980    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tdzs\" (UniqueName: \"kubernetes.io/projected/dfc0ca68-f3a5-4224-b6df-f5629a22beb8-kube-api-access-6tdzs\") pod \"dfc0ca68-f3a5-4224-b6df-f5629a22beb8\" (UID: \"dfc0ca68-f3a5-4224-b6df-f5629a22beb8\") "
Sep 08 04:34:08.854882 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:08.854849    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfc0ca68-f3a5-4224-b6df-f5629a22beb8-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "dfc0ca68-f3a5-4224-b6df-f5629a22beb8" (UID: "dfc0ca68-f3a5-4224-b6df-f5629a22beb8"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:34:08.854993 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:08.854971    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfc0ca68-f3a5-4224-b6df-f5629a22beb8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "dfc0ca68-f3a5-4224-b6df-f5629a22beb8" (UID: "dfc0ca68-f3a5-4224-b6df-f5629a22beb8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:34:08.855037 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:08.855019    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfc0ca68-f3a5-4224-b6df-f5629a22beb8-kube-api-access-6tdzs" (OuterVolumeSpecName: "kube-api-access-6tdzs") pod "dfc0ca68-f3a5-4224-b6df-f5629a22beb8" (UID: "dfc0ca68-f3a5-4224-b6df-f5629a22beb8"). InnerVolumeSpecName "kube-api-access-6tdzs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:34:08.954333 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:08.954302    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6tdzs\" (UniqueName: \"kubernetes.io/projected/dfc0ca68-f3a5-4224-b6df-f5629a22beb8-kube-api-access-6tdzs\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:34:08.954333 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:08.954328    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfc0ca68-f3a5-4224-b6df-f5629a22beb8-metrics-certs\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:34:08.954333 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:08.954337    2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dfc0ca68-f3a5-4224-b6df-f5629a22beb8-webhook-cert\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:34:09.180859 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:09.180782    2573 generic.go:356] "Generic (PLEG): container finished" podID="dfc0ca68-f3a5-4224-b6df-f5629a22beb8" containerID="1d09c6594219252af413f444ce0e102f97148b20b283fce3b88b3d2842b0e00b" exitCode=0
Sep 08 04:34:09.180859 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:09.180836    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f86964c84-h8wl4"
Sep 08 04:34:09.181031 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:09.180873    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f86964c84-h8wl4" event={"ID":"dfc0ca68-f3a5-4224-b6df-f5629a22beb8","Type":"ContainerDied","Data":"1d09c6594219252af413f444ce0e102f97148b20b283fce3b88b3d2842b0e00b"}
Sep 08 04:34:09.181031 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:09.180933    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f86964c84-h8wl4" event={"ID":"dfc0ca68-f3a5-4224-b6df-f5629a22beb8","Type":"ContainerDied","Data":"4d78edb7bb98d10fd3e541d9df849af4ece09aa4d830b2a916cc25bd7632c9ce"}
Sep 08 04:34:09.181031 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:09.180962    2573 scope.go:117] "RemoveContainer" containerID="1d09c6594219252af413f444ce0e102f97148b20b283fce3b88b3d2842b0e00b"
Sep 08 04:34:09.191041 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:09.191019    2573 scope.go:117] "RemoveContainer" containerID="1d09c6594219252af413f444ce0e102f97148b20b283fce3b88b3d2842b0e00b"
Sep 08 04:34:09.191304 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:34:09.191284    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d09c6594219252af413f444ce0e102f97148b20b283fce3b88b3d2842b0e00b\": container with ID starting with 1d09c6594219252af413f444ce0e102f97148b20b283fce3b88b3d2842b0e00b not found: ID does not exist" containerID="1d09c6594219252af413f444ce0e102f97148b20b283fce3b88b3d2842b0e00b"
Sep 08 04:34:09.191376 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:09.191317    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d09c6594219252af413f444ce0e102f97148b20b283fce3b88b3d2842b0e00b"} err="failed to get container status \"1d09c6594219252af413f444ce0e102f97148b20b283fce3b88b3d2842b0e00b\": rpc error: code = NotFound desc = could not find container \"1d09c6594219252af413f444ce0e102f97148b20b283fce3b88b3d2842b0e00b\": container with ID starting with 1d09c6594219252af413f444ce0e102f97148b20b283fce3b88b3d2842b0e00b not found: ID does not exist"
Sep 08 04:34:09.205384 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:09.205348    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f86964c84-h8wl4"]
Sep 08 04:34:09.211916 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:09.211891    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-f86964c84-h8wl4"]
Sep 08 04:34:10.033716 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:10.033679    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-f86964c84-zdl62"]
Sep 08 04:34:10.034325 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:10.034304    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfc0ca68-f3a5-4224-b6df-f5629a22beb8" containerName="manager"
Sep 08 04:34:10.034325 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:10.034325    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfc0ca68-f3a5-4224-b6df-f5629a22beb8" containerName="manager"
Sep 08 04:34:10.034485 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:10.034465    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa8e3e75-f6f5-4d8c-97b2-23ec87f78415" containerName="istio-proxy"
Sep 08 04:34:10.034485 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:10.034481    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfc0ca68-f3a5-4224-b6df-f5629a22beb8" containerName="manager"
Sep 08 04:34:10.038967 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:10.038946    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f86964c84-zdl62"
Sep 08 04:34:10.043329 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:10.043307    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 08 04:34:10.043423 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:10.043328    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 08 04:34:10.043423 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:10.043308    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-g7lt2\""
Sep 08 04:34:10.043520 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:10.043308    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 08 04:34:10.048226 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:10.048204    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f86964c84-zdl62"]
Sep 08 04:34:10.065984 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:10.065959    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/15097bef-0b95-4523-8898-dc7fa3ce55a4-webhook-cert\") pod \"maas-controller-f86964c84-zdl62\" (UID: \"15097bef-0b95-4523-8898-dc7fa3ce55a4\") " pod="opendatahub/maas-controller-f86964c84-zdl62"
Sep 08 04:34:10.066104 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:10.066088    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15097bef-0b95-4523-8898-dc7fa3ce55a4-metrics-certs\") pod \"maas-controller-f86964c84-zdl62\" (UID: \"15097bef-0b95-4523-8898-dc7fa3ce55a4\") " pod="opendatahub/maas-controller-f86964c84-zdl62"
Sep 08 04:34:10.066168 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:10.066128    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc6p2\" (UniqueName: \"kubernetes.io/projected/15097bef-0b95-4523-8898-dc7fa3ce55a4-kube-api-access-dc6p2\") pod \"maas-controller-f86964c84-zdl62\" (UID: \"15097bef-0b95-4523-8898-dc7fa3ce55a4\") " pod="opendatahub/maas-controller-f86964c84-zdl62"
Sep 08 04:34:10.167124 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:10.167092    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/15097bef-0b95-4523-8898-dc7fa3ce55a4-webhook-cert\") pod \"maas-controller-f86964c84-zdl62\" (UID: \"15097bef-0b95-4523-8898-dc7fa3ce55a4\") " pod="opendatahub/maas-controller-f86964c84-zdl62"
Sep 08 04:34:10.167263 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:10.167182    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15097bef-0b95-4523-8898-dc7fa3ce55a4-metrics-certs\") pod \"maas-controller-f86964c84-zdl62\" (UID: \"15097bef-0b95-4523-8898-dc7fa3ce55a4\") " pod="opendatahub/maas-controller-f86964c84-zdl62"
Sep 08 04:34:10.167263 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:10.167221    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc6p2\" (UniqueName: \"kubernetes.io/projected/15097bef-0b95-4523-8898-dc7fa3ce55a4-kube-api-access-dc6p2\") pod \"maas-controller-f86964c84-zdl62\" (UID: \"15097bef-0b95-4523-8898-dc7fa3ce55a4\") " pod="opendatahub/maas-controller-f86964c84-zdl62"
Sep 08 04:34:10.169699 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:10.169679    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15097bef-0b95-4523-8898-dc7fa3ce55a4-metrics-certs\") pod \"maas-controller-f86964c84-zdl62\" (UID: \"15097bef-0b95-4523-8898-dc7fa3ce55a4\") " pod="opendatahub/maas-controller-f86964c84-zdl62"
Sep 08 04:34:10.169774 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:10.169709    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/15097bef-0b95-4523-8898-dc7fa3ce55a4-webhook-cert\") pod \"maas-controller-f86964c84-zdl62\" (UID: \"15097bef-0b95-4523-8898-dc7fa3ce55a4\") " pod="opendatahub/maas-controller-f86964c84-zdl62"
Sep 08 04:34:10.176602 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:10.176580    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc6p2\" (UniqueName: \"kubernetes.io/projected/15097bef-0b95-4523-8898-dc7fa3ce55a4-kube-api-access-dc6p2\") pod \"maas-controller-f86964c84-zdl62\" (UID: \"15097bef-0b95-4523-8898-dc7fa3ce55a4\") " pod="opendatahub/maas-controller-f86964c84-zdl62"
Sep 08 04:34:10.349827 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:10.349746    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f86964c84-zdl62"
Sep 08 04:34:10.626864 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:10.626833    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f86964c84-zdl62"]
Sep 08 04:34:10.627744 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:34:10.627715    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15097bef_0b95_4523_8898_dc7fa3ce55a4.slice/crio-ee3874bd5a5f57150d0198ecf4be6e06c41860d5771cc14d85d82ad98eefd6d2 WatchSource:0}: Error finding container ee3874bd5a5f57150d0198ecf4be6e06c41860d5771cc14d85d82ad98eefd6d2: Status 404 returned error can't find the container with id ee3874bd5a5f57150d0198ecf4be6e06c41860d5771cc14d85d82ad98eefd6d2
Sep 08 04:34:10.675157 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:10.675131    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfc0ca68-f3a5-4224-b6df-f5629a22beb8" path="/var/lib/kubelet/pods/dfc0ca68-f3a5-4224-b6df-f5629a22beb8/volumes"
Sep 08 04:34:11.194497 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:11.194460    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f86964c84-zdl62" event={"ID":"15097bef-0b95-4523-8898-dc7fa3ce55a4","Type":"ContainerStarted","Data":"404e68eaf27ab26f6d8629f3ce74ae68e4707eaa402aedb4547caa1eabddc782"}
Sep 08 04:34:11.194891 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:11.194515    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f86964c84-zdl62" event={"ID":"15097bef-0b95-4523-8898-dc7fa3ce55a4","Type":"ContainerStarted","Data":"ee3874bd5a5f57150d0198ecf4be6e06c41860d5771cc14d85d82ad98eefd6d2"}
Sep 08 04:34:11.194891 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:11.194548    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-f86964c84-zdl62"
Sep 08 04:34:11.219439 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:11.219391    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-f86964c84-zdl62" podStartSLOduration=0.844547785 podStartE2EDuration="1.219373635s" totalImagesPullingTime="374.82585ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:34:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:34:11.215985964 +0000 UTC m=+2011.001277212" watchObservedRunningTime="2026-09-08 04:34:11.219373635 +0000 UTC m=+2011.004664870"
Sep 08 04:34:22.202396 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:34:22.202365    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-f86964c84-zdl62"
Sep 08 04:35:26.257973 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:35:26.257932    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-q6g8c"]
Sep 08 04:35:26.260321 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:35:26.258146    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-q6g8c" podUID="5be73652-1097-4089-9948-9fdf4b40b3ea" containerName="manager" containerID="cri-o://006299855e58789195198fe02dee5daa8a92b1bf76bf95c124c206a7efed0997" gracePeriod=10
Sep 08 04:35:26.607851 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:35:26.607824    2573 generic.go:356] "Generic (PLEG): container finished" podID="5be73652-1097-4089-9948-9fdf4b40b3ea" containerID="006299855e58789195198fe02dee5daa8a92b1bf76bf95c124c206a7efed0997" exitCode=0
Sep 08 04:35:26.607959 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:35:26.607899    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-q6g8c" event={"ID":"5be73652-1097-4089-9948-9fdf4b40b3ea","Type":"ContainerDied","Data":"006299855e58789195198fe02dee5daa8a92b1bf76bf95c124c206a7efed0997"}
Sep 08 04:35:26.607959 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:35:26.607956    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-q6g8c" event={"ID":"5be73652-1097-4089-9948-9fdf4b40b3ea","Type":"ContainerDied","Data":"033c509350e2dce9e58fbef9931c2e8737c26f47e4e6e91c831f9e54db09990b"}
Sep 08 04:35:26.608037 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:35:26.607973    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="033c509350e2dce9e58fbef9931c2e8737c26f47e4e6e91c831f9e54db09990b"
Sep 08 04:35:26.619466 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:35:26.619449    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-q6g8c"
Sep 08 04:35:26.677656 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:35:26.677623    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5be73652-1097-4089-9948-9fdf4b40b3ea-extensions-socket-volume\") pod \"5be73652-1097-4089-9948-9fdf4b40b3ea\" (UID: \"5be73652-1097-4089-9948-9fdf4b40b3ea\") "
Sep 08 04:35:26.677825 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:35:26.677730    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42ns5\" (UniqueName: \"kubernetes.io/projected/5be73652-1097-4089-9948-9fdf4b40b3ea-kube-api-access-42ns5\") pod \"5be73652-1097-4089-9948-9fdf4b40b3ea\" (UID: \"5be73652-1097-4089-9948-9fdf4b40b3ea\") "
Sep 08 04:35:26.678027 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:35:26.677998    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5be73652-1097-4089-9948-9fdf4b40b3ea-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5be73652-1097-4089-9948-9fdf4b40b3ea" (UID: "5be73652-1097-4089-9948-9fdf4b40b3ea"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 04:35:26.678171 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:35:26.678138    2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5be73652-1097-4089-9948-9fdf4b40b3ea-extensions-socket-volume\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:35:26.680280 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:35:26.680262    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5be73652-1097-4089-9948-9fdf4b40b3ea-kube-api-access-42ns5" (OuterVolumeSpecName: "kube-api-access-42ns5") pod "5be73652-1097-4089-9948-9fdf4b40b3ea" (UID: "5be73652-1097-4089-9948-9fdf4b40b3ea"). InnerVolumeSpecName "kube-api-access-42ns5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:35:26.778847 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:35:26.778778    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42ns5\" (UniqueName: \"kubernetes.io/projected/5be73652-1097-4089-9948-9fdf4b40b3ea-kube-api-access-42ns5\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:35:27.612759 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:35:27.612730    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-q6g8c"
Sep 08 04:35:27.640570 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:35:27.640527    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-q6g8c"]
Sep 08 04:35:27.649338 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:35:27.649316    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-q6g8c"]
Sep 08 04:35:28.674545 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:35:28.674509    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5be73652-1097-4089-9948-9fdf4b40b3ea" path="/var/lib/kubelet/pods/5be73652-1097-4089-9948-9fdf4b40b3ea/volumes"
Sep 08 04:35:40.991181 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:35:40.991148    2573 scope.go:117] "RemoveContainer" containerID="006299855e58789195198fe02dee5daa8a92b1bf76bf95c124c206a7efed0997"
Sep 08 04:36:26.987804 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:36:26.987770    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cbpkz"]
Sep 08 04:36:26.988238 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:36:26.988212    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5be73652-1097-4089-9948-9fdf4b40b3ea" containerName="manager"
Sep 08 04:36:26.988238 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:36:26.988223    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5be73652-1097-4089-9948-9fdf4b40b3ea" containerName="manager"
Sep 08 04:36:26.988314 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:36:26.988291    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5be73652-1097-4089-9948-9fdf4b40b3ea" containerName="manager"
Sep 08 04:36:26.991514 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:36:26.991499    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cbpkz"
Sep 08 04:36:26.993968 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:36:26.993947    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-zh6p9\""
Sep 08 04:36:27.008547 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:36:27.008521    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cbpkz"]
Sep 08 04:36:27.122609 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:36:27.122577    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/02652db6-fe98-4300-80a1-fa65222ecf1b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-cbpkz\" (UID: \"02652db6-fe98-4300-80a1-fa65222ecf1b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cbpkz"
Sep 08 04:36:27.122742 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:36:27.122689    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l4wf\" (UniqueName: \"kubernetes.io/projected/02652db6-fe98-4300-80a1-fa65222ecf1b-kube-api-access-4l4wf\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-cbpkz\" (UID: \"02652db6-fe98-4300-80a1-fa65222ecf1b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cbpkz"
Sep 08 04:36:27.223949 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:36:27.223923    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l4wf\" (UniqueName: \"kubernetes.io/projected/02652db6-fe98-4300-80a1-fa65222ecf1b-kube-api-access-4l4wf\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-cbpkz\" (UID: \"02652db6-fe98-4300-80a1-fa65222ecf1b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cbpkz"
Sep 08 04:36:27.224082 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:36:27.223965    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/02652db6-fe98-4300-80a1-fa65222ecf1b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-cbpkz\" (UID: \"02652db6-fe98-4300-80a1-fa65222ecf1b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cbpkz"
Sep 08 04:36:27.224319 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:36:27.224303    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/02652db6-fe98-4300-80a1-fa65222ecf1b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-cbpkz\" (UID: \"02652db6-fe98-4300-80a1-fa65222ecf1b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cbpkz"
Sep 08 04:36:27.235857 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:36:27.235831    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l4wf\" (UniqueName: \"kubernetes.io/projected/02652db6-fe98-4300-80a1-fa65222ecf1b-kube-api-access-4l4wf\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-cbpkz\" (UID: \"02652db6-fe98-4300-80a1-fa65222ecf1b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cbpkz"
Sep 08 04:36:27.301717 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:36:27.301690    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cbpkz"
Sep 08 04:36:27.584424 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:36:27.584401    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cbpkz"]
Sep 08 04:36:27.587027 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:36:27.586998    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02652db6_fe98_4300_80a1_fa65222ecf1b.slice/crio-705d6a6b1b59d51065008236cf6376679d390e40450d467a56d7c2d759e655b7 WatchSource:0}: Error finding container 705d6a6b1b59d51065008236cf6376679d390e40450d467a56d7c2d759e655b7: Status 404 returned error can't find the container with id 705d6a6b1b59d51065008236cf6376679d390e40450d467a56d7c2d759e655b7
Sep 08 04:36:27.939812 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:36:27.939717    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cbpkz" event={"ID":"02652db6-fe98-4300-80a1-fa65222ecf1b","Type":"ContainerStarted","Data":"64c38af32652f5d10dd8cce7a4d76a5fbc2c845c2889cc0cfdf3a051a285e4b1"}
Sep 08 04:36:27.939812 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:36:27.939781    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cbpkz" event={"ID":"02652db6-fe98-4300-80a1-fa65222ecf1b","Type":"ContainerStarted","Data":"705d6a6b1b59d51065008236cf6376679d390e40450d467a56d7c2d759e655b7"}
Sep 08 04:36:27.939812 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:36:27.939813    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cbpkz"
Sep 08 04:36:27.965713 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:36:27.965669    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cbpkz" podStartSLOduration=1.96565506 podStartE2EDuration="1.96565506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:36:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:36:27.964203088 +0000 UTC m=+2147.749494324" watchObservedRunningTime="2026-09-08 04:36:27.96565506 +0000 UTC m=+2147.750946305"
Sep 08 04:36:38.947806 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:36:38.947728    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cbpkz"
Sep 08 04:38:30.085374 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:30.085343    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-cf5b5fd48-72nkh"]
Sep 08 04:38:30.089186 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:30.089168    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-cf5b5fd48-72nkh"
Sep 08 04:38:30.098284 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:30.098170    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-cf5b5fd48-72nkh"]
Sep 08 04:38:30.176105 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:30.176071    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvvfc\" (UniqueName: \"kubernetes.io/projected/e6e273ac-bd19-4626-8c45-68dc04a12883-kube-api-access-dvvfc\") pod \"maas-api-cf5b5fd48-72nkh\" (UID: \"e6e273ac-bd19-4626-8c45-68dc04a12883\") " pod="odh-ai-gateway-infra/maas-api-cf5b5fd48-72nkh"
Sep 08 04:38:30.176272 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:30.176136    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6e273ac-bd19-4626-8c45-68dc04a12883-maas-api-tls\") pod \"maas-api-cf5b5fd48-72nkh\" (UID: \"e6e273ac-bd19-4626-8c45-68dc04a12883\") " pod="odh-ai-gateway-infra/maas-api-cf5b5fd48-72nkh"
Sep 08 04:38:30.176272 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:30.176153    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6e273ac-bd19-4626-8c45-68dc04a12883-metrics-certs\") pod \"maas-api-cf5b5fd48-72nkh\" (UID: \"e6e273ac-bd19-4626-8c45-68dc04a12883\") " pod="odh-ai-gateway-infra/maas-api-cf5b5fd48-72nkh"
Sep 08 04:38:30.176272 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:30.176183    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6e273ac-bd19-4626-8c45-68dc04a12883-openshift-service-ca\") pod \"maas-api-cf5b5fd48-72nkh\" (UID: \"e6e273ac-bd19-4626-8c45-68dc04a12883\") " pod="odh-ai-gateway-infra/maas-api-cf5b5fd48-72nkh"
Sep 08 04:38:30.277143 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:30.277111    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvvfc\" (UniqueName: \"kubernetes.io/projected/e6e273ac-bd19-4626-8c45-68dc04a12883-kube-api-access-dvvfc\") pod \"maas-api-cf5b5fd48-72nkh\" (UID: \"e6e273ac-bd19-4626-8c45-68dc04a12883\") " pod="odh-ai-gateway-infra/maas-api-cf5b5fd48-72nkh"
Sep 08 04:38:30.277307 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:30.277170    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6e273ac-bd19-4626-8c45-68dc04a12883-maas-api-tls\") pod \"maas-api-cf5b5fd48-72nkh\" (UID: \"e6e273ac-bd19-4626-8c45-68dc04a12883\") " pod="odh-ai-gateway-infra/maas-api-cf5b5fd48-72nkh"
Sep 08 04:38:30.277307 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:30.277187    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6e273ac-bd19-4626-8c45-68dc04a12883-metrics-certs\") pod \"maas-api-cf5b5fd48-72nkh\" (UID: \"e6e273ac-bd19-4626-8c45-68dc04a12883\") " pod="odh-ai-gateway-infra/maas-api-cf5b5fd48-72nkh"
Sep 08 04:38:30.277307 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:30.277222    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6e273ac-bd19-4626-8c45-68dc04a12883-openshift-service-ca\") pod \"maas-api-cf5b5fd48-72nkh\" (UID: \"e6e273ac-bd19-4626-8c45-68dc04a12883\") " pod="odh-ai-gateway-infra/maas-api-cf5b5fd48-72nkh"
Sep 08 04:38:30.277833 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:30.277802    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6e273ac-bd19-4626-8c45-68dc04a12883-openshift-service-ca\") pod \"maas-api-cf5b5fd48-72nkh\" (UID: \"e6e273ac-bd19-4626-8c45-68dc04a12883\") " pod="odh-ai-gateway-infra/maas-api-cf5b5fd48-72nkh"
Sep 08 04:38:30.279867 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:30.279848    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6e273ac-bd19-4626-8c45-68dc04a12883-metrics-certs\") pod \"maas-api-cf5b5fd48-72nkh\" (UID: \"e6e273ac-bd19-4626-8c45-68dc04a12883\") " pod="odh-ai-gateway-infra/maas-api-cf5b5fd48-72nkh"
Sep 08 04:38:30.279955 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:30.279936    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6e273ac-bd19-4626-8c45-68dc04a12883-maas-api-tls\") pod \"maas-api-cf5b5fd48-72nkh\" (UID: \"e6e273ac-bd19-4626-8c45-68dc04a12883\") " pod="odh-ai-gateway-infra/maas-api-cf5b5fd48-72nkh"
Sep 08 04:38:30.284957 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:30.284936    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvvfc\" (UniqueName: \"kubernetes.io/projected/e6e273ac-bd19-4626-8c45-68dc04a12883-kube-api-access-dvvfc\") pod \"maas-api-cf5b5fd48-72nkh\" (UID: \"e6e273ac-bd19-4626-8c45-68dc04a12883\") " pod="odh-ai-gateway-infra/maas-api-cf5b5fd48-72nkh"
Sep 08 04:38:30.403361 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:30.403272    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-cf5b5fd48-72nkh"
Sep 08 04:38:30.679689 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:38:30.679658    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6e273ac_bd19_4626_8c45_68dc04a12883.slice/crio-33f2b2f53c581e5a79476380ba887703f89fdfbfe27263f467d003aa893796ea WatchSource:0}: Error finding container 33f2b2f53c581e5a79476380ba887703f89fdfbfe27263f467d003aa893796ea: Status 404 returned error can't find the container with id 33f2b2f53c581e5a79476380ba887703f89fdfbfe27263f467d003aa893796ea
Sep 08 04:38:30.681063 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:30.681039    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 04:38:30.681999 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:30.681975    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-cf5b5fd48-72nkh"]
Sep 08 04:38:31.641776 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:31.641737    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-cf5b5fd48-72nkh" event={"ID":"e6e273ac-bd19-4626-8c45-68dc04a12883","Type":"ContainerStarted","Data":"6c84630bdbfaac5946e27f737579af281cffe0d4977e7e38ef3c23687ba2873d"}
Sep 08 04:38:31.642184 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:31.641801    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-cf5b5fd48-72nkh" event={"ID":"e6e273ac-bd19-4626-8c45-68dc04a12883","Type":"ContainerStarted","Data":"33f2b2f53c581e5a79476380ba887703f89fdfbfe27263f467d003aa893796ea"}
Sep 08 04:38:31.642184 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:31.641831    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-cf5b5fd48-72nkh"
Sep 08 04:38:31.664036 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:31.663988    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-cf5b5fd48-72nkh" podStartSLOduration=1.271463378 podStartE2EDuration="1.66397346s" totalImagesPullingTime="392.510082ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:38:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:38:31.662483701 +0000 UTC m=+2271.447774939" watchObservedRunningTime="2026-09-08 04:38:31.66397346 +0000 UTC m=+2271.449264695"
Sep 08 04:38:37.656381 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:37.656347    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-cf5b5fd48-72nkh"
Sep 08 04:38:44.997358 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:44.997313    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7df9d55888-qznvn"]
Sep 08 04:38:44.997965 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:44.997911    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-7df9d55888-qznvn" podUID="d3b812cb-6afb-425f-aa81-b486b0ee995f" containerName="maas-api" containerID="cri-o://64bbd86fb74215e02d61cff31628c949263c8c6cc942fbb85da87370760324d1" gracePeriod=30
Sep 08 04:38:46.255093 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:46.255070    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7df9d55888-qznvn"
Sep 08 04:38:46.438254 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:46.438164    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3b812cb-6afb-425f-aa81-b486b0ee995f-openshift-service-ca\") pod \"d3b812cb-6afb-425f-aa81-b486b0ee995f\" (UID: \"d3b812cb-6afb-425f-aa81-b486b0ee995f\") "
Sep 08 04:38:46.438254 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:46.438213    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3b812cb-6afb-425f-aa81-b486b0ee995f-maas-api-tls\") pod \"d3b812cb-6afb-425f-aa81-b486b0ee995f\" (UID: \"d3b812cb-6afb-425f-aa81-b486b0ee995f\") "
Sep 08 04:38:46.438497 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:46.438262    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4s8j\" (UniqueName: \"kubernetes.io/projected/d3b812cb-6afb-425f-aa81-b486b0ee995f-kube-api-access-q4s8j\") pod \"d3b812cb-6afb-425f-aa81-b486b0ee995f\" (UID: \"d3b812cb-6afb-425f-aa81-b486b0ee995f\") "
Sep 08 04:38:46.438497 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:46.438311    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3b812cb-6afb-425f-aa81-b486b0ee995f-metrics-certs\") pod \"d3b812cb-6afb-425f-aa81-b486b0ee995f\" (UID: \"d3b812cb-6afb-425f-aa81-b486b0ee995f\") "
Sep 08 04:38:46.438651 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:46.438505    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3b812cb-6afb-425f-aa81-b486b0ee995f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d3b812cb-6afb-425f-aa81-b486b0ee995f" (UID: "d3b812cb-6afb-425f-aa81-b486b0ee995f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 04:38:46.438701 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:46.438663    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3b812cb-6afb-425f-aa81-b486b0ee995f-openshift-service-ca\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:38:46.440488 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:46.440459    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3b812cb-6afb-425f-aa81-b486b0ee995f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d3b812cb-6afb-425f-aa81-b486b0ee995f" (UID: "d3b812cb-6afb-425f-aa81-b486b0ee995f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:38:46.440621 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:46.440499    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3b812cb-6afb-425f-aa81-b486b0ee995f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d3b812cb-6afb-425f-aa81-b486b0ee995f" (UID: "d3b812cb-6afb-425f-aa81-b486b0ee995f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 04:38:46.440621 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:46.440508    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3b812cb-6afb-425f-aa81-b486b0ee995f-kube-api-access-q4s8j" (OuterVolumeSpecName: "kube-api-access-q4s8j") pod "d3b812cb-6afb-425f-aa81-b486b0ee995f" (UID: "d3b812cb-6afb-425f-aa81-b486b0ee995f"). InnerVolumeSpecName "kube-api-access-q4s8j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 04:38:46.540052 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:46.540012    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3b812cb-6afb-425f-aa81-b486b0ee995f-maas-api-tls\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:38:46.540052 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:46.540049    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4s8j\" (UniqueName: \"kubernetes.io/projected/d3b812cb-6afb-425f-aa81-b486b0ee995f-kube-api-access-q4s8j\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:38:46.540052 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:46.540061    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3b812cb-6afb-425f-aa81-b486b0ee995f-metrics-certs\") on node \"ip-10-0-143-35.ec2.internal\" DevicePath \"\""
Sep 08 04:38:46.729882 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:46.729798    2573 generic.go:356] "Generic (PLEG): container finished" podID="d3b812cb-6afb-425f-aa81-b486b0ee995f" containerID="64bbd86fb74215e02d61cff31628c949263c8c6cc942fbb85da87370760324d1" exitCode=0
Sep 08 04:38:46.729882 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:46.729842    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7df9d55888-qznvn"
Sep 08 04:38:46.730114 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:46.729884    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7df9d55888-qznvn" event={"ID":"d3b812cb-6afb-425f-aa81-b486b0ee995f","Type":"ContainerDied","Data":"64bbd86fb74215e02d61cff31628c949263c8c6cc942fbb85da87370760324d1"}
Sep 08 04:38:46.730114 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:46.729937    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7df9d55888-qznvn" event={"ID":"d3b812cb-6afb-425f-aa81-b486b0ee995f","Type":"ContainerDied","Data":"112d9dd91e91f2a2bfc2a2f370ab15b67c55703d1fec64cbe693f1511c2bfc29"}
Sep 08 04:38:46.730114 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:46.729968    2573 scope.go:117] "RemoveContainer" containerID="64bbd86fb74215e02d61cff31628c949263c8c6cc942fbb85da87370760324d1"
Sep 08 04:38:46.739250 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:46.739235    2573 scope.go:117] "RemoveContainer" containerID="64bbd86fb74215e02d61cff31628c949263c8c6cc942fbb85da87370760324d1"
Sep 08 04:38:46.739513 ip-10-0-143-35 kubenswrapper[2573]: E0908 04:38:46.739493    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64bbd86fb74215e02d61cff31628c949263c8c6cc942fbb85da87370760324d1\": container with ID starting with 64bbd86fb74215e02d61cff31628c949263c8c6cc942fbb85da87370760324d1 not found: ID does not exist" containerID="64bbd86fb74215e02d61cff31628c949263c8c6cc942fbb85da87370760324d1"
Sep 08 04:38:46.739631 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:46.739519    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64bbd86fb74215e02d61cff31628c949263c8c6cc942fbb85da87370760324d1"} err="failed to get container status \"64bbd86fb74215e02d61cff31628c949263c8c6cc942fbb85da87370760324d1\": rpc error: code = NotFound desc = could not find container \"64bbd86fb74215e02d61cff31628c949263c8c6cc942fbb85da87370760324d1\": container with ID starting with 64bbd86fb74215e02d61cff31628c949263c8c6cc942fbb85da87370760324d1 not found: ID does not exist"
Sep 08 04:38:46.746283 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:46.746244    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7df9d55888-qznvn"]
Sep 08 04:38:46.748802 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:46.748782    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-7df9d55888-qznvn"]
Sep 08 04:38:48.675081 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:38:48.675043    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3b812cb-6afb-425f-aa81-b486b0ee995f" path="/var/lib/kubelet/pods/d3b812cb-6afb-425f-aa81-b486b0ee995f/volumes"
Sep 08 04:39:10.391367 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:10.391333    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-87k45_601d1e25-b86c-48af-8ccf-c559677d0ead/manager/0.log"
Sep 08 04:39:10.523961 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:10.523930    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-28n8h_61de5c9f-f9dd-49be-ad8e-82cf48b61939/manager/0.log"
Sep 08 04:39:10.656419 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:10.656348    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-f86964c84-zdl62_15097bef-0b95-4523-8898-dc7fa3ce55a4/manager/0.log"
Sep 08 04:39:11.315812 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:11.315783    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d5d59f488-s2rhc_b4032b07-b8e9-44b4-860a-e910bd6b0e40/copy-manifests/0.log"
Sep 08 04:39:11.323079 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:11.323056    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d5d59f488-s2rhc_b4032b07-b8e9-44b4-860a-e910bd6b0e40/manager/0.log"
Sep 08 04:39:11.689353 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:11.689289    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-cf5b5fd48-72nkh_e6e273ac-bd19-4626-8c45-68dc04a12883/maas-api/0.log"
Sep 08 04:39:12.177053 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:12.177027    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-j5f6q_548cf291-e5ec-4ee7-8f77-4a7fe5f97373/postgres/0.log"
Sep 08 04:39:13.166994 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:13.166962    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-r7jjq_23c969cb-5c41-4f0d-ac5f-fcc42cfbde2a/manager/0.log"
Sep 08 04:39:13.281635 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:13.281612    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-89x5g_b9221c29-5a63-45d3-ab1a-e1d75b233c7c/manager/0.log"
Sep 08 04:39:13.534593 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:13.534545    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-cbpkz_02652db6-fe98-4300-80a1-fa65222ecf1b/manager/0.log"
Sep 08 04:39:13.778029 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:13.778002    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-g2nbs_cb3f218f-d35e-4265-85a7-002a8e710741/manager/0.log"
Sep 08 04:39:14.413714 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:14.413670    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5859ff6677-dkk9d_eb2ca6b2-6b27-451d-b4ec-32f62387e95e/kube-auth-proxy/0.log"
Sep 08 04:39:14.662344 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:14.662304    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-t6lf4_6ebf3915-eaae-4906-8fba-46f66c55d4e3/istio-proxy/1.log"
Sep 08 04:39:14.783787 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:14.783759    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-g6mbv_19d1b657-1b48-4e9c-9174-3052e1bc7b9e/payload-pre-processing/0.log"
Sep 08 04:39:14.904334 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:14.904306    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-72hb9_170d8dd1-15b0-4fb0-ab11-eefe97714cbd/payload-processing/0.log"
Sep 08 04:39:15.623295 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:15.623265    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-hxcmd_50ce2858-9e59-4c56-8a04-a406002f646e/main/0.log"
Sep 08 04:39:15.749071 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:15.749048    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-v9l9f_e881d4ce-00b4-4734-a653-b2c836b45d36/main/0.log"
Sep 08 04:39:15.869871 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:15.869846    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fww4mp_bd53c8a1-2244-4e34-98d8-7223e39590dd/main/0.log"
Sep 08 04:39:24.899390 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:24.899360    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-h6v7m_7446436d-a655-4644-91b2-d2071bf4e925/global-pull-secret-syncer/0.log"
Sep 08 04:39:25.051339 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:25.051308    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-b7xw7_a124d27d-8125-409b-a62b-769a35cdbe64/konnectivity-agent/0.log"
Sep 08 04:39:25.166582 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:25.166484    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-35.ec2.internal_7f5a837540d716e426e6051c25aec9eb/haproxy/0.log"
Sep 08 04:39:29.641398 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:29.641368    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-r7jjq_23c969cb-5c41-4f0d-ac5f-fcc42cfbde2a/manager/0.log"
Sep 08 04:39:29.680777 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:29.680751    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-89x5g_b9221c29-5a63-45d3-ab1a-e1d75b233c7c/manager/0.log"
Sep 08 04:39:29.749807 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:29.749783    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-cbpkz_02652db6-fe98-4300-80a1-fa65222ecf1b/manager/0.log"
Sep 08 04:39:29.831468 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:29.831439    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-g2nbs_cb3f218f-d35e-4265-85a7-002a8e710741/manager/0.log"
Sep 08 04:39:31.198120 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:31.198091    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f2e6796f-037a-4d49-9943-e1573a09c0b2/alertmanager/0.log"
Sep 08 04:39:31.221575 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:31.221537    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f2e6796f-037a-4d49-9943-e1573a09c0b2/config-reloader/0.log"
Sep 08 04:39:31.245799 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:31.245774    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f2e6796f-037a-4d49-9943-e1573a09c0b2/kube-rbac-proxy-web/0.log"
Sep 08 04:39:31.269358 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:31.269328    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f2e6796f-037a-4d49-9943-e1573a09c0b2/kube-rbac-proxy/0.log"
Sep 08 04:39:31.294370 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:31.294349    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f2e6796f-037a-4d49-9943-e1573a09c0b2/kube-rbac-proxy-metric/0.log"
Sep 08 04:39:31.318040 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:31.318014    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f2e6796f-037a-4d49-9943-e1573a09c0b2/prom-label-proxy/0.log"
Sep 08 04:39:31.361459 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:31.361436    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f2e6796f-037a-4d49-9943-e1573a09c0b2/init-config-reloader/0.log"
Sep 08 04:39:31.437865 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:31.437845    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-rh6pm_3ff040b2-1200-4e9f-95a9-7a98bbda02e7/kube-state-metrics/0.log"
Sep 08 04:39:31.461986 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:31.461959    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-rh6pm_3ff040b2-1200-4e9f-95a9-7a98bbda02e7/kube-rbac-proxy-main/0.log"
Sep 08 04:39:31.502316 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:31.502288    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-rh6pm_3ff040b2-1200-4e9f-95a9-7a98bbda02e7/kube-rbac-proxy-self/0.log"
Sep 08 04:39:31.533633 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:31.533608    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-57f4c8ddfc-l4w4v_b54d42b4-ebc7-41db-b7ac-b14b4de8eda3/metrics-server/0.log"
Sep 08 04:39:31.560652 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:31.560630    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-5c9t9_63e757a6-ea2d-4e05-9c42-9055591bd2dd/monitoring-plugin/0.log"
Sep 08 04:39:31.854415 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:31.854390    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-twm95_a4f27328-cc57-42ba-b5f9-43591a0d4018/node-exporter/0.log"
Sep 08 04:39:31.876072 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:31.876048    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-twm95_a4f27328-cc57-42ba-b5f9-43591a0d4018/kube-rbac-proxy/0.log"
Sep 08 04:39:31.904496 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:31.904474    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-twm95_a4f27328-cc57-42ba-b5f9-43591a0d4018/init-textfile/0.log"
Sep 08 04:39:31.944255 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:31.944228    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-hfks7_c3f8818d-3f43-4adc-b903-657942814226/kube-rbac-proxy-main/0.log"
Sep 08 04:39:31.966183 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:31.966163    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-hfks7_c3f8818d-3f43-4adc-b903-657942814226/kube-rbac-proxy-self/0.log"
Sep 08 04:39:31.989138 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:31.989113    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-hfks7_c3f8818d-3f43-4adc-b903-657942814226/openshift-state-metrics/0.log"
Sep 08 04:39:32.033021 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:32.032996    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a13eb3d2-522e-4c8d-af6d-fc137330cf5d/prometheus/0.log"
Sep 08 04:39:32.053910 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:32.053888    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a13eb3d2-522e-4c8d-af6d-fc137330cf5d/config-reloader/0.log"
Sep 08 04:39:32.079125 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:32.079099    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a13eb3d2-522e-4c8d-af6d-fc137330cf5d/thanos-sidecar/0.log"
Sep 08 04:39:32.100959 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:32.100894    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a13eb3d2-522e-4c8d-af6d-fc137330cf5d/kube-rbac-proxy-web/0.log"
Sep 08 04:39:32.125908 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:32.125886    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a13eb3d2-522e-4c8d-af6d-fc137330cf5d/kube-rbac-proxy/0.log"
Sep 08 04:39:32.151548 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:32.151530    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a13eb3d2-522e-4c8d-af6d-fc137330cf5d/kube-rbac-proxy-thanos/0.log"
Sep 08 04:39:32.173252 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:32.173232    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a13eb3d2-522e-4c8d-af6d-fc137330cf5d/init-config-reloader/0.log"
Sep 08 04:39:32.209633 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:32.209615    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-v9kft_e0b163fe-6d60-4468-939d-91540e48a582/prometheus-operator/0.log"
Sep 08 04:39:32.231690 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:32.231665    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-v9kft_e0b163fe-6d60-4468-939d-91540e48a582/kube-rbac-proxy/0.log"
Sep 08 04:39:32.255854 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:32.255836    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-mmmhp_33d98bab-6aac-4b0f-bac6-75228cbe87ba/prometheus-operator-admission-webhook/0.log"
Sep 08 04:39:32.289064 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:32.289045    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f797b7d7b-b7h6c_2d102228-2752-42c6-b8c5-73f802d06e4a/telemeter-client/0.log"
Sep 08 04:39:32.310063 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:32.310044    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f797b7d7b-b7h6c_2d102228-2752-42c6-b8c5-73f802d06e4a/reload/0.log"
Sep 08 04:39:32.330915 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:32.330894    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f797b7d7b-b7h6c_2d102228-2752-42c6-b8c5-73f802d06e4a/kube-rbac-proxy/0.log"
Sep 08 04:39:32.361215 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:32.361156    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c8fb8d787-rf72p_80c88ae8-b14a-44bc-b932-f9a52d521c2a/thanos-query/0.log"
Sep 08 04:39:32.382061 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:32.382041    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c8fb8d787-rf72p_80c88ae8-b14a-44bc-b932-f9a52d521c2a/kube-rbac-proxy-web/0.log"
Sep 08 04:39:32.402524 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:32.402507    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c8fb8d787-rf72p_80c88ae8-b14a-44bc-b932-f9a52d521c2a/kube-rbac-proxy/0.log"
Sep 08 04:39:32.425405 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:32.425387    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c8fb8d787-rf72p_80c88ae8-b14a-44bc-b932-f9a52d521c2a/prom-label-proxy/0.log"
Sep 08 04:39:32.448673 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:32.448655    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c8fb8d787-rf72p_80c88ae8-b14a-44bc-b932-f9a52d521c2a/kube-rbac-proxy-rules/0.log"
Sep 08 04:39:32.472105 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:32.472087    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c8fb8d787-rf72p_80c88ae8-b14a-44bc-b932-f9a52d521c2a/kube-rbac-proxy-metrics/0.log"
Sep 08 04:39:34.839456 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:34.839414    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cchdf/perf-node-gather-daemonset-wrs7f"]
Sep 08 04:39:34.839912 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:34.839898    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3b812cb-6afb-425f-aa81-b486b0ee995f" containerName="maas-api"
Sep 08 04:39:34.839956 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:34.839913    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3b812cb-6afb-425f-aa81-b486b0ee995f" containerName="maas-api"
Sep 08 04:39:34.840014 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:34.840004    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3b812cb-6afb-425f-aa81-b486b0ee995f" containerName="maas-api"
Sep 08 04:39:34.843427 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:34.843411    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cchdf/perf-node-gather-daemonset-wrs7f"
Sep 08 04:39:34.846082 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:34.846059    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cchdf\"/\"openshift-service-ca.crt\""
Sep 08 04:39:34.846828 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:34.846810    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-cchdf\"/\"default-dockercfg-lk299\""
Sep 08 04:39:34.846828 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:34.846820    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cchdf\"/\"kube-root-ca.crt\""
Sep 08 04:39:34.851764 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:34.851740    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cchdf/perf-node-gather-daemonset-wrs7f"]
Sep 08 04:39:34.984369 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:34.984330    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzs4m\" (UniqueName: \"kubernetes.io/projected/4fc7033c-1b4e-4def-b867-f8f8017371db-kube-api-access-fzs4m\") pod \"perf-node-gather-daemonset-wrs7f\" (UID: \"4fc7033c-1b4e-4def-b867-f8f8017371db\") " pod="openshift-must-gather-cchdf/perf-node-gather-daemonset-wrs7f"
Sep 08 04:39:34.984369 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:34.984374    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4fc7033c-1b4e-4def-b867-f8f8017371db-podres\") pod \"perf-node-gather-daemonset-wrs7f\" (UID: \"4fc7033c-1b4e-4def-b867-f8f8017371db\") " pod="openshift-must-gather-cchdf/perf-node-gather-daemonset-wrs7f"
Sep 08 04:39:34.984619 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:34.984486    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4fc7033c-1b4e-4def-b867-f8f8017371db-sys\") pod \"perf-node-gather-daemonset-wrs7f\" (UID: \"4fc7033c-1b4e-4def-b867-f8f8017371db\") " pod="openshift-must-gather-cchdf/perf-node-gather-daemonset-wrs7f"
Sep 08 04:39:34.984619 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:34.984520    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4fc7033c-1b4e-4def-b867-f8f8017371db-proc\") pod \"perf-node-gather-daemonset-wrs7f\" (UID: \"4fc7033c-1b4e-4def-b867-f8f8017371db\") " pod="openshift-must-gather-cchdf/perf-node-gather-daemonset-wrs7f"
Sep 08 04:39:34.984619 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:34.984539    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4fc7033c-1b4e-4def-b867-f8f8017371db-lib-modules\") pod \"perf-node-gather-daemonset-wrs7f\" (UID: \"4fc7033c-1b4e-4def-b867-f8f8017371db\") " pod="openshift-must-gather-cchdf/perf-node-gather-daemonset-wrs7f"
Sep 08 04:39:35.085197 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:35.085164    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4fc7033c-1b4e-4def-b867-f8f8017371db-sys\") pod \"perf-node-gather-daemonset-wrs7f\" (UID: \"4fc7033c-1b4e-4def-b867-f8f8017371db\") " pod="openshift-must-gather-cchdf/perf-node-gather-daemonset-wrs7f"
Sep 08 04:39:35.085379 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:35.085208    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4fc7033c-1b4e-4def-b867-f8f8017371db-proc\") pod \"perf-node-gather-daemonset-wrs7f\" (UID: \"4fc7033c-1b4e-4def-b867-f8f8017371db\") " pod="openshift-must-gather-cchdf/perf-node-gather-daemonset-wrs7f"
Sep 08 04:39:35.085379 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:35.085225    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4fc7033c-1b4e-4def-b867-f8f8017371db-lib-modules\") pod \"perf-node-gather-daemonset-wrs7f\" (UID: \"4fc7033c-1b4e-4def-b867-f8f8017371db\") " pod="openshift-must-gather-cchdf/perf-node-gather-daemonset-wrs7f"
Sep 08 04:39:35.085379 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:35.085300    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzs4m\" (UniqueName: \"kubernetes.io/projected/4fc7033c-1b4e-4def-b867-f8f8017371db-kube-api-access-fzs4m\") pod \"perf-node-gather-daemonset-wrs7f\" (UID: \"4fc7033c-1b4e-4def-b867-f8f8017371db\") " pod="openshift-must-gather-cchdf/perf-node-gather-daemonset-wrs7f"
Sep 08 04:39:35.085379 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:35.085302    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4fc7033c-1b4e-4def-b867-f8f8017371db-proc\") pod \"perf-node-gather-daemonset-wrs7f\" (UID: \"4fc7033c-1b4e-4def-b867-f8f8017371db\") " pod="openshift-must-gather-cchdf/perf-node-gather-daemonset-wrs7f"
Sep 08 04:39:35.085379 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:35.085302    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4fc7033c-1b4e-4def-b867-f8f8017371db-sys\") pod \"perf-node-gather-daemonset-wrs7f\" (UID: \"4fc7033c-1b4e-4def-b867-f8f8017371db\") " pod="openshift-must-gather-cchdf/perf-node-gather-daemonset-wrs7f"
Sep 08 04:39:35.085379 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:35.085328    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4fc7033c-1b4e-4def-b867-f8f8017371db-podres\") pod \"perf-node-gather-daemonset-wrs7f\" (UID: \"4fc7033c-1b4e-4def-b867-f8f8017371db\") " pod="openshift-must-gather-cchdf/perf-node-gather-daemonset-wrs7f"
Sep 08 04:39:35.085613 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:35.085411    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4fc7033c-1b4e-4def-b867-f8f8017371db-lib-modules\") pod \"perf-node-gather-daemonset-wrs7f\" (UID: \"4fc7033c-1b4e-4def-b867-f8f8017371db\") " pod="openshift-must-gather-cchdf/perf-node-gather-daemonset-wrs7f"
Sep 08 04:39:35.085613 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:35.085416    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4fc7033c-1b4e-4def-b867-f8f8017371db-podres\") pod \"perf-node-gather-daemonset-wrs7f\" (UID: \"4fc7033c-1b4e-4def-b867-f8f8017371db\") " pod="openshift-must-gather-cchdf/perf-node-gather-daemonset-wrs7f"
Sep 08 04:39:35.095984 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:35.095923    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzs4m\" (UniqueName: \"kubernetes.io/projected/4fc7033c-1b4e-4def-b867-f8f8017371db-kube-api-access-fzs4m\") pod \"perf-node-gather-daemonset-wrs7f\" (UID: \"4fc7033c-1b4e-4def-b867-f8f8017371db\") " pod="openshift-must-gather-cchdf/perf-node-gather-daemonset-wrs7f"
Sep 08 04:39:35.111093 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:35.111059    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-p9x5z_32b9b5a6-6468-4313-9b58-3c4daca3ab41/download-server/0.log"
Sep 08 04:39:35.154400 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:35.154374    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cchdf/perf-node-gather-daemonset-wrs7f"
Sep 08 04:39:35.424596 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:35.424546    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cchdf/perf-node-gather-daemonset-wrs7f"]
Sep 08 04:39:35.426298 ip-10-0-143-35 kubenswrapper[2573]: W0908 04:39:35.426275    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4fc7033c_1b4e_4def_b867_f8f8017371db.slice/crio-4345a3937c60e7188cdd140e4af1af85bf0b8719525fc20bcf70509b7fbfa7b3 WatchSource:0}: Error finding container 4345a3937c60e7188cdd140e4af1af85bf0b8719525fc20bcf70509b7fbfa7b3: Status 404 returned error can't find the container with id 4345a3937c60e7188cdd140e4af1af85bf0b8719525fc20bcf70509b7fbfa7b3
Sep 08 04:39:36.003207 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:36.003170    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cchdf/perf-node-gather-daemonset-wrs7f" event={"ID":"4fc7033c-1b4e-4def-b867-f8f8017371db","Type":"ContainerStarted","Data":"6d6a52de719f9e505e706b04ec36edd587bdfea5dd7a530d68eff55dbb96b103"}
Sep 08 04:39:36.003689 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:36.003235    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-cchdf/perf-node-gather-daemonset-wrs7f"
Sep 08 04:39:36.003689 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:36.003259    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cchdf/perf-node-gather-daemonset-wrs7f" event={"ID":"4fc7033c-1b4e-4def-b867-f8f8017371db","Type":"ContainerStarted","Data":"4345a3937c60e7188cdd140e4af1af85bf0b8719525fc20bcf70509b7fbfa7b3"}
Sep 08 04:39:36.019749 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:36.019700    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-cchdf/perf-node-gather-daemonset-wrs7f" podStartSLOduration=2.01968576 podStartE2EDuration="2.01968576s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 04:39:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:39:36.018224847 +0000 UTC m=+2335.803516074" watchObservedRunningTime="2026-09-08 04:39:36.01968576 +0000 UTC m=+2335.804976996"
Sep 08 04:39:37.013305 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:37.013279    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vj8wn_a1b995a0-28cf-4f60-aa01-9cf3c768f4d3/dns/0.log"
Sep 08 04:39:37.034405 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:37.034380    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vj8wn_a1b995a0-28cf-4f60-aa01-9cf3c768f4d3/kube-rbac-proxy/0.log"
Sep 08 04:39:37.104422 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:37.104391    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zkwhq_ab7d5093-fb91-4469-a88d-488d3ec56493/dns-node-resolver/0.log"
Sep 08 04:39:37.651679 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:37.651646    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m2x6p_3223e696-fb13-4dc2-a4fb-86ea4c014fa3/node-ca/0.log"
Sep 08 04:39:39.011199 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:39.011168    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5859ff6677-dkk9d_eb2ca6b2-6b27-451d-b4ec-32f62387e95e/kube-auth-proxy/0.log"
Sep 08 04:39:39.061174 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:39.061148    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-t6lf4_6ebf3915-eaae-4906-8fba-46f66c55d4e3/istio-proxy/0.log"
Sep 08 04:39:39.070952 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:39.070918    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-t6lf4_6ebf3915-eaae-4906-8fba-46f66c55d4e3/istio-proxy/1.log"
Sep 08 04:39:39.107244 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:39.107215    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-g6mbv_19d1b657-1b48-4e9c-9174-3052e1bc7b9e/payload-pre-processing/0.log"
Sep 08 04:39:39.141026 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:39.141000    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-72hb9_170d8dd1-15b0-4fb0-ab11-eefe97714cbd/payload-processing/0.log"
Sep 08 04:39:40.023294 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:40.023265    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-c9r58_67c20357-ed4c-4e0d-9c10-39a6acf1a312/serve-healthcheck-canary/0.log"
Sep 08 04:39:40.707844 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:40.707811    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xv8jz_e1cfc3e6-358d-4c0a-9fe0-ef347b598eed/kube-rbac-proxy/0.log"
Sep 08 04:39:40.731101 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:40.731077    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xv8jz_e1cfc3e6-358d-4c0a-9fe0-ef347b598eed/exporter/0.log"
Sep 08 04:39:40.752374 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:40.752352    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xv8jz_e1cfc3e6-358d-4c0a-9fe0-ef347b598eed/extractor/0.log"
Sep 08 04:39:42.020183 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:42.020157    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-cchdf/perf-node-gather-daemonset-wrs7f"
Sep 08 04:39:42.807574 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:42.807525    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-87k45_601d1e25-b86c-48af-8ccf-c559677d0ead/manager/0.log"
Sep 08 04:39:42.984342 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:42.984304    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-28n8h_61de5c9f-f9dd-49be-ad8e-82cf48b61939/manager/0.log"
Sep 08 04:39:43.030586 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:43.030524    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-f86964c84-zdl62_15097bef-0b95-4523-8898-dc7fa3ce55a4/manager/0.log"
Sep 08 04:39:43.377495 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:43.377456    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d5d59f488-s2rhc_b4032b07-b8e9-44b4-860a-e910bd6b0e40/manager/0.log"
Sep 08 04:39:43.397037 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:43.397018    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d5d59f488-s2rhc_b4032b07-b8e9-44b4-860a-e910bd6b0e40/copy-manifests/0.log"
Sep 08 04:39:45.462128 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:45.462098    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5859ff6677-dkk9d_eb2ca6b2-6b27-451d-b4ec-32f62387e95e/kube-auth-proxy/0.log"
Sep 08 04:39:45.497454 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:45.497425    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-t6lf4_6ebf3915-eaae-4906-8fba-46f66c55d4e3/istio-proxy/0.log"
Sep 08 04:39:45.506515 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:45.506491    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-t6lf4_6ebf3915-eaae-4906-8fba-46f66c55d4e3/istio-proxy/1.log"
Sep 08 04:39:45.528830 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:45.528806    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-g6mbv_19d1b657-1b48-4e9c-9174-3052e1bc7b9e/payload-pre-processing/0.log"
Sep 08 04:39:45.552907 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:45.552883    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-72hb9_170d8dd1-15b0-4fb0-ab11-eefe97714cbd/payload-processing/0.log"
Sep 08 04:39:47.438765 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:47.438739    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5859ff6677-dkk9d_eb2ca6b2-6b27-451d-b4ec-32f62387e95e/kube-auth-proxy/0.log"
Sep 08 04:39:47.474349 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:47.474312    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-t6lf4_6ebf3915-eaae-4906-8fba-46f66c55d4e3/istio-proxy/0.log"
Sep 08 04:39:47.484602 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:47.484549    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-t6lf4_6ebf3915-eaae-4906-8fba-46f66c55d4e3/istio-proxy/1.log"
Sep 08 04:39:47.511518 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:47.511484    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-g6mbv_19d1b657-1b48-4e9c-9174-3052e1bc7b9e/payload-pre-processing/0.log"
Sep 08 04:39:47.538060 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:47.538037    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-72hb9_170d8dd1-15b0-4fb0-ab11-eefe97714cbd/payload-processing/0.log"
Sep 08 04:39:51.374763 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:51.374734    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6qplb_53487bf6-e14b-41e1-ac17-51fcd3b3768f/kube-multus-additional-cni-plugins/0.log"
Sep 08 04:39:51.398961 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:51.398938    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6qplb_53487bf6-e14b-41e1-ac17-51fcd3b3768f/egress-router-binary-copy/0.log"
Sep 08 04:39:51.421163 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:51.421142    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6qplb_53487bf6-e14b-41e1-ac17-51fcd3b3768f/cni-plugins/0.log"
Sep 08 04:39:51.441374 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:51.441349    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6qplb_53487bf6-e14b-41e1-ac17-51fcd3b3768f/bond-cni-plugin/0.log"
Sep 08 04:39:51.461676 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:51.461659    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6qplb_53487bf6-e14b-41e1-ac17-51fcd3b3768f/routeoverride-cni/0.log"
Sep 08 04:39:51.481855 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:51.481839    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6qplb_53487bf6-e14b-41e1-ac17-51fcd3b3768f/whereabouts-cni-bincopy/0.log"
Sep 08 04:39:51.503607 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:51.503587    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6qplb_53487bf6-e14b-41e1-ac17-51fcd3b3768f/whereabouts-cni/0.log"
Sep 08 04:39:51.940456 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:51.940422    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wmm7p_64b3849f-b822-46f6-9926-0ec5a6997d65/kube-multus/0.log"
Sep 08 04:39:52.008267 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:52.008241    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kw824_1082908b-13b3-42fe-952e-7512558aa436/network-metrics-daemon/0.log"
Sep 08 04:39:52.029330 ip-10-0-143-35 kubenswrapper[2573]: I0908 04:39:52.029310    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kw824_1082908b-13b3-42fe-952e-7512558aa436/kube-rbac-proxy/0.log"