Jul 17 10:52:14.705751 ip-10-0-143-12 systemd[1]: Starting Kubernetes Kubelet...
Jul 17 10:52:15.154745 ip-10-0-143-12 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 10:52:15.154745 ip-10-0-143-12 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 17 10:52:15.154745 ip-10-0-143-12 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 10:52:15.154745 ip-10-0-143-12 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 17 10:52:15.154745 ip-10-0-143-12 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 10:52:15.154745 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.087591    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 17 10:52:15.154745 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094839    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 10:52:15.154745 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094852    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 10:52:15.154745 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094855    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 10:52:15.154745 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094858    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 10:52:15.154745 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094861    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 10:52:15.154745 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094864    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 10:52:15.154745 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094867    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 10:52:15.154745 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094869    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 10:52:15.178303 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094872    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 10:52:15.178303 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094874    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 10:52:15.178303 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094877    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 10:52:15.178303 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094879    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 10:52:15.178303 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094883    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 10:52:15.178303 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094885    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 10:52:15.178303 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094888    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 10:52:15.178303 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094890    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 10:52:15.178303 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094894    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 10:52:15.178303 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094898    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 10:52:15.178303 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094901    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 10:52:15.178303 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094904    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 10:52:15.178303 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094907    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 10:52:15.178303 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094909    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 10:52:15.178303 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094912    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 10:52:15.178303 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094915    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 10:52:15.178303 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094918    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 10:52:15.178303 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094922    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 10:52:15.178303 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094925    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 10:52:15.157037 ip-10-0-143-12 systemd[1]: Started Kubernetes Kubelet.
Jul 17 10:52:15.196553 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094927    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 10:52:15.196553 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094930    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 10:52:15.196553 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094933    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 10:52:15.196553 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094936    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 10:52:15.196553 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094939    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 10:52:15.196553 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094946    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 10:52:15.196553 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094951    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 10:52:15.196553 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094954    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 10:52:15.196553 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094956    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 10:52:15.196553 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094959    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 10:52:15.196553 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094961    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 10:52:15.196553 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094964    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 10:52:15.196553 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094966    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 10:52:15.196553 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094969    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 10:52:15.196553 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094972    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 10:52:15.196553 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094974    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 10:52:15.196553 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094976    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 10:52:15.196553 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094979    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 10:52:15.196553 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094981    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 10:52:15.196553 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094984    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 10:52:15.200277 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094987    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 10:52:15.200277 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094990    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 10:52:15.200277 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094992    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 10:52:15.200277 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094995    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 10:52:15.200277 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.094998    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 10:52:15.200277 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095000    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 10:52:15.200277 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095003    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 10:52:15.200277 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095006    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 10:52:15.200277 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095008    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 10:52:15.200277 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095011    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 10:52:15.200277 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095013    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 10:52:15.200277 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095016    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 10:52:15.200277 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095018    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 10:52:15.200277 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095021    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 10:52:15.200277 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095024    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 10:52:15.200277 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095026    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 10:52:15.200277 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095029    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 10:52:15.200277 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095032    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 10:52:15.200277 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095034    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 10:52:15.200277 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095037    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 10:52:15.368395 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095040    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 10:52:15.368395 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095042    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 10:52:15.368395 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095045    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 10:52:15.368395 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095047    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 10:52:15.368395 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095050    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 10:52:15.368395 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095052    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 10:52:15.368395 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095055    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 10:52:15.368395 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095057    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 10:52:15.368395 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095060    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 10:52:15.368395 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095062    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 10:52:15.368395 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095066    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 10:52:15.368395 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095069    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 10:52:15.368395 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095071    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 10:52:15.368395 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095073    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 10:52:15.368395 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095076    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 10:52:15.368395 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095078    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 10:52:15.368395 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095081    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 10:52:15.368395 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095084    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 10:52:15.368395 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095086    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 10:52:15.368395 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095089    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 10:52:15.387132 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095091    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 10:52:15.387132 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095093    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 10:52:15.387132 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095097    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 10:52:15.387132 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095101    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 10:52:15.387132 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095103    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 10:52:15.387132 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095106    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 10:52:15.387132 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095109    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 10:52:15.387132 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095112    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 10:52:15.387132 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095114    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 10:52:15.387132 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095117    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 10:52:15.387132 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095119    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 10:52:15.387132 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095122    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 10:52:15.387132 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095759    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 10:52:15.387132 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095766    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 10:52:15.387132 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095769    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 10:52:15.387132 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095771    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 10:52:15.387132 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095774    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 10:52:15.387132 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095777    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 10:52:15.387132 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095780    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 10:52:15.387132 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095782    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 10:52:15.387936 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095785    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 10:52:15.387936 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095787    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 10:52:15.387936 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095790    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 10:52:15.387936 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095793    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 10:52:15.387936 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095795    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 10:52:15.387936 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095798    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 10:52:15.387936 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095800    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 10:52:15.387936 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095803    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 10:52:15.387936 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095806    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 10:52:15.387936 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095809    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 10:52:15.387936 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095811    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 10:52:15.387936 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095813    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 10:52:15.387936 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095816    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 10:52:15.387936 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095818    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 10:52:15.387936 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095821    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 10:52:15.387936 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095825    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 10:52:15.387936 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095828    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 10:52:15.387936 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095831    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 10:52:15.387936 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095835    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 10:52:15.387936 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095838    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 10:52:15.390065 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095841    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 10:52:15.390065 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095845    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 10:52:15.390065 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095848    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 10:52:15.390065 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095853    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 10:52:15.390065 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095855    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 10:52:15.390065 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095858    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 10:52:15.390065 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095860    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 10:52:15.390065 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095863    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 10:52:15.390065 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095866    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 10:52:15.390065 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095868    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 10:52:15.390065 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095871    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 10:52:15.390065 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095873    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 10:52:15.390065 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095875    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 10:52:15.390065 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095878    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 10:52:15.390065 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095880    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 10:52:15.390065 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095883    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 10:52:15.390065 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095885    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 10:52:15.390065 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095888    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 10:52:15.390065 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095891    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 10:52:15.399861 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095893    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 10:52:15.399861 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095896    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 10:52:15.399861 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095899    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 10:52:15.399861 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095902    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 10:52:15.399861 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095904    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 10:52:15.399861 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095906    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 10:52:15.399861 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095909    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 10:52:15.399861 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095911    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 10:52:15.399861 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095914    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 10:52:15.399861 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095917    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 10:52:15.399861 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095920    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 10:52:15.399861 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095922    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 10:52:15.399861 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095924    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 10:52:15.399861 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095927    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 10:52:15.399861 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095929    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 10:52:15.399861 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095932    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 10:52:15.399861 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095937    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 10:52:15.399861 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095940    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 10:52:15.399861 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095942    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 10:52:15.399861 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095945    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 10:52:15.402867 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095947    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 10:52:15.402867 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095950    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 10:52:15.402867 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095952    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 10:52:15.402867 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095954    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 10:52:15.402867 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095957    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 10:52:15.402867 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095960    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 10:52:15.402867 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095963    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 10:52:15.402867 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095965    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 10:52:15.402867 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095967    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 10:52:15.402867 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095970    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 10:52:15.402867 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095972    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 10:52:15.402867 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095975    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 10:52:15.402867 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095978    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 10:52:15.402867 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095981    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 10:52:15.402867 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095983    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 10:52:15.402867 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095986    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 10:52:15.402867 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095989    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 10:52:15.402867 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095992    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 10:52:15.402867 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095995    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 10:52:15.402867 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095997    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 10:52:15.405192 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.095999    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 10:52:15.405192 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096002    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 10:52:15.405192 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096005    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 10:52:15.405192 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096007    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 10:52:15.405192 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096009    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 10:52:15.405192 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096012    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 10:52:15.405192 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096016    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 10:52:15.405192 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096019    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 10:52:15.405192 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096023    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 10:52:15.405192 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096026    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 10:52:15.405192 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096029    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 10:52:15.405192 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096031    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 10:52:15.405192 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096454    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 10:52:15.405192 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096460    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 10:52:15.405192 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096463    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 10:52:15.405192 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096466    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 10:52:15.405192 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096470    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 10:52:15.405192 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096474    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 10:52:15.405192 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096477    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 10:52:15.406200 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096480    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 10:52:15.406200 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096482    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 10:52:15.406200 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096485    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 10:52:15.406200 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096487    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 10:52:15.406200 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096490    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 10:52:15.406200 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096492    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 10:52:15.406200 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096495    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 10:52:15.406200 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096497    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 10:52:15.406200 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096500    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 10:52:15.406200 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096503    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 10:52:15.406200 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096505    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 10:52:15.406200 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096508    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 10:52:15.406200 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096510    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 10:52:15.406200 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096513    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 10:52:15.406200 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096517    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 10:52:15.406200 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096520    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 10:52:15.406200 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096522    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 10:52:15.406200 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096525    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 10:52:15.406200 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096528    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 10:52:15.406200 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096531    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 10:52:15.406813 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096533    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 10:52:15.406813 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096537    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 10:52:15.406813 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096539    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 10:52:15.406813 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096542    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 10:52:15.406813 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096544    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 10:52:15.406813 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096546    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 10:52:15.406813 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096549    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 10:52:15.406813 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096551    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 10:52:15.406813 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096555    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 10:52:15.406813 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096558    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 10:52:15.406813 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096561    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 10:52:15.406813 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096564    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 10:52:15.406813 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096567    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 10:52:15.406813 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096569    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 10:52:15.406813 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096572    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 10:52:15.406813 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096575    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 10:52:15.406813 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096577    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 10:52:15.406813 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096580    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 10:52:15.406813 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096582    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 10:52:15.408033 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096585    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 10:52:15.408033 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096588    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 10:52:15.408033 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096590    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 10:52:15.408033 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096594    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 10:52:15.408033 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096596    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 10:52:15.408033 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096599    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 10:52:15.408033 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096602    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 10:52:15.408033 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096605    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 10:52:15.408033 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096608    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 10:52:15.408033 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096611    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 10:52:15.408033 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096614    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 10:52:15.408033 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096618    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 10:52:15.408033 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096620    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 10:52:15.408033 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096623    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 10:52:15.408033 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096628    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 10:52:15.408033 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096630    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 10:52:15.408033 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096633    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 10:52:15.408033 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096636    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 10:52:15.408033 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096638    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 10:52:15.408688 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096641    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 10:52:15.408688 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096643    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 10:52:15.408688 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096646    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 10:52:15.408688 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096648    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 10:52:15.408688 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096651    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 10:52:15.408688 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096653    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 10:52:15.408688 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096655    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 10:52:15.408688 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096658    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 10:52:15.408688 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096660    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 10:52:15.408688 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096663    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 10:52:15.408688 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096665    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 10:52:15.408688 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096667    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 10:52:15.408688 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096670    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 10:52:15.408688 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096672    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 10:52:15.408688 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096676    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 10:52:15.408688 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096678    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 10:52:15.408688 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096681    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 10:52:15.408688 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096684    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 10:52:15.408688 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096686    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 10:52:15.408688 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096688    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 10:52:15.409298 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096692    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 10:52:15.409298 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096694    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 10:52:15.409298 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096697    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 10:52:15.409298 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096699    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 10:52:15.409298 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096701    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 10:52:15.409298 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096704    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 10:52:15.409298 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096706    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 10:52:15.409298 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096710    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 10:52:15.409298 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096713    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 10:52:15.409298 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096715    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 10:52:15.409298 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096718    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 10:52:15.409298 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096720    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 10:52:15.409298 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096723    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 10:52:15.409298 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.096725    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 10:52:15.409298 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096785    2563 flags.go:64] FLAG: --address="0.0.0.0"
Jul 17 10:52:15.409298 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096796    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 17 10:52:15.409298 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096801    2563 flags.go:64] FLAG: --anonymous-auth="true"
Jul 17 10:52:15.409298 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096805    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 17 10:52:15.409298 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096809    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 17 10:52:15.409298 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096812    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 17 10:52:15.409298 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096815    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 17 10:52:15.410038 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096819    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 17 10:52:15.410038 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096822    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 17 10:52:15.410038 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096825    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 17 10:52:15.410038 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096829    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 17 10:52:15.410038 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096832    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 17 10:52:15.410038 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096835    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 17 10:52:15.410038 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096838    2563 flags.go:64] FLAG: --cgroup-root=""
Jul 17 10:52:15.410038 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096840    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 17 10:52:15.410038 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096843    2563 flags.go:64] FLAG: --client-ca-file=""
Jul 17 10:52:15.410038 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096847    2563 flags.go:64] FLAG: --cloud-provider="external"
Jul 17 10:52:15.410038 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096849    2563 flags.go:64] FLAG: --cluster-dns="[]"
Jul 17 10:52:15.410038 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096855    2563 flags.go:64] FLAG: --cluster-domain=""
Jul 17 10:52:15.410038 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096858    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 17 10:52:15.410038 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096861    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 17 10:52:15.410038 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096864    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 17 10:52:15.410038 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096867    2563 flags.go:64] FLAG: --container-log-max-files="5"
Jul 17 10:52:15.410038 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096870    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 17 10:52:15.410038 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096873    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 17 10:52:15.410038 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096878    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 17 10:52:15.410038 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096881    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 17 10:52:15.410038 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096884    2563 flags.go:64] FLAG: --contention-profiling="false"
Jul 17 10:52:15.410038 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096887    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 17 10:52:15.410038 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096890    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 17 10:52:15.410038 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096892    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 17 10:52:15.410680 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096895    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 17 10:52:15.410680 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096899    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 17 10:52:15.410680 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096902    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 17 10:52:15.410680 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096904    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 17 10:52:15.410680 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096907    2563 flags.go:64] FLAG: --enable-load-reader="false"
Jul 17 10:52:15.410680 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096910    2563 flags.go:64] FLAG: --enable-server="true"
Jul 17 10:52:15.410680 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096913    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 17 10:52:15.410680 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096916    2563 flags.go:64] FLAG: --event-burst="100"
Jul 17 10:52:15.410680 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096919    2563 flags.go:64] FLAG: --event-qps="50"
Jul 17 10:52:15.410680 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096922    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 17 10:52:15.410680 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096925    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 17 10:52:15.410680 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096927    2563 flags.go:64] FLAG: --eviction-hard=""
Jul 17 10:52:15.410680 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096931    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 17 10:52:15.410680 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096934    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 17 10:52:15.410680 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096936    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 17 10:52:15.410680 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096939    2563 flags.go:64] FLAG: --eviction-soft=""
Jul 17 10:52:15.410680 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096942    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 17 10:52:15.410680 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096945    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 17 10:52:15.410680 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096948    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 17 10:52:15.410680 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096953    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 17 10:52:15.410680 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096956    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 17 10:52:15.410680 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096958    2563 flags.go:64] FLAG: --fail-swap-on="true"
Jul 17 10:52:15.410680 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096961    2563 flags.go:64] FLAG: --feature-gates=""
Jul 17 10:52:15.410680 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096964    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 17 10:52:15.410680 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096967    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 17 10:52:15.411478 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096970    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 17 10:52:15.411478 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096974    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 17 10:52:15.411478 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096977    2563 flags.go:64] FLAG: --healthz-port="10248"
Jul 17 10:52:15.411478 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096979    2563 flags.go:64] FLAG: --help="false"
Jul 17 10:52:15.411478 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096982    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-143-12.ec2.internal"
Jul 17 10:52:15.411478 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096985    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 17 10:52:15.411478 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096988    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 17 10:52:15.411478 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096991    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 17 10:52:15.411478 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096994    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 17 10:52:15.411478 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.096997    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 17 10:52:15.411478 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097000    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 17 10:52:15.411478 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097002    2563 flags.go:64] FLAG: --image-service-endpoint=""
Jul 17 10:52:15.411478 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097005    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 17 10:52:15.411478 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097008    2563 flags.go:64] FLAG: --kube-api-burst="100"
Jul 17 10:52:15.411478 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097011    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 17 10:52:15.411478 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097013    2563 flags.go:64] FLAG: --kube-api-qps="50"
Jul 17 10:52:15.411478 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097016    2563 flags.go:64] FLAG: --kube-reserved=""
Jul 17 10:52:15.411478 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097019    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 17 10:52:15.411478 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097021    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 17 10:52:15.411478 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097024    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 17 10:52:15.411478 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097027    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 17 10:52:15.411478 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097029    2563 flags.go:64] FLAG: --lock-file=""
Jul 17 10:52:15.411478 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097032    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 17 10:52:15.411478 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097035    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 17 10:52:15.412202 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097037    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 17 10:52:15.412202 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097042    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 17 10:52:15.412202 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097046    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 17 10:52:15.412202 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097049    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 17 10:52:15.412202 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097052    2563 flags.go:64] FLAG: --logging-format="text"
Jul 17 10:52:15.412202 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097055    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 17 10:52:15.412202 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097058    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 17 10:52:15.412202 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097060    2563 flags.go:64] FLAG: --manifest-url=""
Jul 17 10:52:15.412202 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097063    2563 flags.go:64] FLAG: --manifest-url-header=""
Jul 17 10:52:15.412202 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097068    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 17 10:52:15.412202 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097071    2563 flags.go:64] FLAG: --max-open-files="1000000"
Jul 17 10:52:15.412202 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097075    2563 flags.go:64] FLAG: --max-pods="110"
Jul 17 10:52:15.412202 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097077    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 17 10:52:15.412202 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097080    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 17 10:52:15.412202 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097083    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 17 10:52:15.412202 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097085    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 17 10:52:15.412202 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097088    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 17 10:52:15.412202 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097091    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 17 10:52:15.412202 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097094    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 17 10:52:15.412202 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097100    2563 flags.go:64] FLAG: --node-status-max-images="50"
Jul 17 10:52:15.412202 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097103    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 17 10:52:15.412202 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097106    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 17 10:52:15.412202 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097108    2563 flags.go:64] FLAG: --pod-cidr=""
Jul 17 10:52:15.412924 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097111    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 17 10:52:15.412924 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097116    2563 flags.go:64] FLAG: --pod-manifest-path=""
Jul 17 10:52:15.412924 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097119    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 17 10:52:15.412924 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097122    2563 flags.go:64] FLAG: --pods-per-core="0"
Jul 17 10:52:15.412924 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097124    2563 flags.go:64] FLAG: --port="10250"
Jul 17 10:52:15.412924 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097127    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 17 10:52:15.412924 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097130    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-073e3c21c0868a94b"
Jul 17 10:52:15.412924 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097133    2563 flags.go:64] FLAG: --qos-reserved=""
Jul 17 10:52:15.412924 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097136    2563 flags.go:64] FLAG: --read-only-port="10255"
Jul 17 10:52:15.412924 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097139    2563 flags.go:64] FLAG: --register-node="true"
Jul 17 10:52:15.412924 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097142    2563 flags.go:64] FLAG: --register-with-taints=""
Jul 17 10:52:15.412924 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097146    2563 flags.go:64] FLAG: --registry-burst="10"
Jul 17 10:52:15.412924 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097153    2563 flags.go:64] FLAG: --registry-qps="5"
Jul 17 10:52:15.412924 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097156    2563 flags.go:64] FLAG: --reserved-cpus=""
Jul 17 10:52:15.412924 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097159    2563 flags.go:64] FLAG: --reserved-memory=""
Jul 17 10:52:15.412924 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097162    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 17 10:52:15.412924 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097165    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 17 10:52:15.412924 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097168    2563 flags.go:64] FLAG: --rotate-certificates="false"
Jul 17 10:52:15.412924 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097171    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 17 10:52:15.412924 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097176    2563 flags.go:64] FLAG: --runonce="false"
Jul 17 10:52:15.412924 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097179    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 17 10:52:15.412924 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097182    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 17 10:52:15.412924 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097185    2563 flags.go:64] FLAG: --seccomp-default="false"
Jul 17 10:52:15.412924 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097187    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 17 10:52:15.412924 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097190    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 17 10:52:15.414125 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097193    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 17 10:52:15.414125 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097196    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 17 10:52:15.414125 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097199    2563 flags.go:64] FLAG: --storage-driver-password="root"
Jul 17 10:52:15.414125 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097202    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 17 10:52:15.414125 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097204    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 17 10:52:15.414125 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097207    2563 flags.go:64] FLAG: --storage-driver-user="root"
Jul 17 10:52:15.414125 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097210    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 17 10:52:15.414125 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097212    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 17 10:52:15.414125 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097215    2563 flags.go:64] FLAG: --system-cgroups=""
Jul 17 10:52:15.414125 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097218    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 17 10:52:15.414125 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097223    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 17 10:52:15.414125 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097225    2563 flags.go:64] FLAG: --tls-cert-file=""
Jul 17 10:52:15.414125 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097228    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 17 10:52:15.414125 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097233    2563 flags.go:64] FLAG: --tls-min-version=""
Jul 17 10:52:15.414125 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097235    2563 flags.go:64] FLAG: --tls-private-key-file=""
Jul 17 10:52:15.414125 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097238    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 17 10:52:15.414125 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097241    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 17 10:52:15.414125 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097244    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 17 10:52:15.414125 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097247    2563 flags.go:64] FLAG: --v="2"
Jul 17 10:52:15.414125 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097251    2563 flags.go:64] FLAG: --version="false"
Jul 17 10:52:15.414125 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097255    2563 flags.go:64] FLAG: --vmodule=""
Jul 17 10:52:15.414125 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097258    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 17 10:52:15.414125 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.097262    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 17 10:52:15.414125 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097383    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 10:52:15.414125 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097387    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 10:52:15.540147 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097390    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 10:52:15.540147 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097394    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 10:52:15.540147 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097396    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 10:52:15.540147 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097399    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 10:52:15.540147 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097401    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 10:52:15.540147 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097403    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 10:52:15.540147 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097406    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 10:52:15.540147 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097408    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 10:52:15.540147 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097411    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 10:52:15.540147 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097414    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 10:52:15.540147 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097418    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 10:52:15.540147 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097421    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 10:52:15.540147 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097424    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 10:52:15.540147 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097441    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 10:52:15.540147 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097444    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 10:52:15.540147 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097447    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 10:52:15.540147 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097450    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 10:52:15.540147 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097453    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 10:52:15.540147 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097455    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 10:52:15.545223 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097458    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 10:52:15.545223 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097460    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 10:52:15.545223 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097462    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 10:52:15.545223 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097465    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 10:52:15.545223 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097477    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 10:52:15.545223 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097480    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 10:52:15.545223 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097483    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 10:52:15.545223 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097486    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 10:52:15.545223 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097489    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 10:52:15.545223 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097492    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 10:52:15.545223 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097512    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 10:52:15.545223 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097515    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 10:52:15.545223 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097517    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 10:52:15.545223 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097520    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 10:52:15.545223 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097524    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 10:52:15.545223 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097527    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 10:52:15.545223 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097530    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 10:52:15.545223 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097532    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 10:52:15.545223 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097534    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 10:52:15.545223 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097537    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 10:52:15.545800 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097539    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 10:52:15.545800 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097542    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 10:52:15.545800 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097544    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 10:52:15.545800 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097547    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 10:52:15.545800 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097549    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 10:52:15.545800 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097552    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 10:52:15.545800 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097554    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 10:52:15.545800 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097557    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 10:52:15.545800 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097559    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 10:52:15.545800 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097562    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 10:52:15.545800 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097564    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 10:52:15.545800 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097566    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 10:52:15.545800 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097569    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 10:52:15.545800 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097571    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 10:52:15.545800 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097575    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 10:52:15.545800 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097578    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 10:52:15.545800 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097582    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 10:52:15.545800 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097585    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 10:52:15.545800 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097589    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 10:52:15.546276 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097605    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 10:52:15.546276 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097609    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 10:52:15.546276 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097612    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 10:52:15.546276 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097615    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 10:52:15.546276 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097618    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 10:52:15.546276 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097621    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 10:52:15.546276 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097624    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 10:52:15.546276 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097628    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 10:52:15.546276 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097631    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 10:52:15.546276 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097633    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 10:52:15.546276 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097636    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 10:52:15.546276 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097639    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 10:52:15.546276 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097642    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 10:52:15.546276 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097644    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 10:52:15.546276 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097647    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 10:52:15.546276 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097649    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 10:52:15.546276 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097651    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 10:52:15.546276 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097654    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 10:52:15.546276 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097656    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 10:52:15.546276 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097659    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 10:52:15.546838 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097662    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 10:52:15.546838 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097664    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 10:52:15.546838 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097667    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 10:52:15.546838 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097669    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 10:52:15.546838 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097672    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 10:52:15.546838 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097674    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 10:52:15.546838 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097677    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 10:52:15.546838 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097679    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 10:52:15.546838 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097682    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 10:52:15.546838 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097684    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 10:52:15.546838 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097687    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 10:52:15.546838 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097691    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 10:52:15.546838 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097694    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 10:52:15.546838 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097696    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 10:52:15.546838 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097699    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 10:52:15.546838 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097701    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 10:52:15.546838 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097705    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 10:52:15.546838 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097707    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 10:52:15.546838 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.097710    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 10:52:15.547305 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.098615    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 10:52:15.547305 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.104447    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 17 10:52:15.547305 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.104466    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 17 10:52:15.547305 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.104484    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 17 10:52:15.547305 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.104489    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 17 10:52:15.547305 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104543    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 10:52:15.547305 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104547    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 10:52:15.547305 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104551    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 10:52:15.547305 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104553    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 10:52:15.547305 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104556    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 10:52:15.547305 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104559    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 10:52:15.547305 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104561    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 10:52:15.547305 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104564    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 10:52:15.547305 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104566    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 10:52:15.547305 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104569    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 10:52:15.547758 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104571    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 10:52:15.547758 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104573    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 10:52:15.547758 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104576    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 10:52:15.547758 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104579    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 10:52:15.547758 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104581    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 10:52:15.547758 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104584    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 10:52:15.547758 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104586    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 10:52:15.547758 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104589    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 10:52:15.547758 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104591    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 10:52:15.547758 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104594    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 10:52:15.547758 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104596    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 10:52:15.547758 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104599    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 10:52:15.547758 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104602    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 10:52:15.547758 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104605    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 10:52:15.547758 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104608    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 10:52:15.547758 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104610    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 10:52:15.547758 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104613    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 10:52:15.547758 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104615    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 10:52:15.547758 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104618    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 10:52:15.547758 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104621    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 10:52:15.547758 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104624    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 10:52:15.548296 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104626    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 10:52:15.548296 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104633    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 10:52:15.548296 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104635    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 10:52:15.548296 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104639    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 10:52:15.548296 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104643    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 10:52:15.548296 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104646    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 10:52:15.548296 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104648    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 10:52:15.548296 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104651    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 10:52:15.548296 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104665    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 10:52:15.548296 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104669    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 10:52:15.548296 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104671    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 10:52:15.548296 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104675    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 10:52:15.548296 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104678    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 10:52:15.548296 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104681    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 10:52:15.548296 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104684    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 10:52:15.548296 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104687    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 10:52:15.548296 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104689    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 10:52:15.548296 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104692    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 10:52:15.548812 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104694    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 10:52:15.548812 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104697    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 10:52:15.548812 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104699    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 10:52:15.548812 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104701    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 10:52:15.548812 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104704    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 10:52:15.548812 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104706    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 10:52:15.548812 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104708    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 10:52:15.548812 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104711    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 10:52:15.548812 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104713    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 10:52:15.548812 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104716    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 10:52:15.548812 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104718    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 10:52:15.548812 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104720    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 10:52:15.548812 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104724    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 10:52:15.548812 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104727    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 10:52:15.548812 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104730    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 10:52:15.548812 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104733    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 10:52:15.548812 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104736    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 10:52:15.548812 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104738    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 10:52:15.548812 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104741    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 10:52:15.548812 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104743    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 10:52:15.549317 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104745    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 10:52:15.549317 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104748    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 10:52:15.549317 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104750    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 10:52:15.549317 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104752    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 10:52:15.549317 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104755    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 10:52:15.549317 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104757    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 10:52:15.549317 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104760    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 10:52:15.549317 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104762    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 10:52:15.549317 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104765    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 10:52:15.549317 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104767    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 10:52:15.549317 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104770    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 10:52:15.549317 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104773    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 10:52:15.549317 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104793    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 10:52:15.549317 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104796    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 10:52:15.549317 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104798    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 10:52:15.549317 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104801    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 10:52:15.549317 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104803    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 10:52:15.549317 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104806    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 10:52:15.549317 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104808    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 10:52:15.549864 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104810    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 10:52:15.549864 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104813    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 10:52:15.549864 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104815    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 10:52:15.549864 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104818    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 10:52:15.549864 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104820    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 10:52:15.549864 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104824    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 10:52:15.549864 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104826    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 10:52:15.549864 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104830    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 10:52:15.549864 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104834    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 10:52:15.549864 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104836    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 10:52:15.549864 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104838    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 10:52:15.549864 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.104843    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 10:52:15.549864 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104943    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 10:52:15.549864 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104946    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 10:52:15.549864 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104949    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 10:52:15.550260 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104952    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 10:52:15.550260 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104955    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 10:52:15.550260 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104957    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 10:52:15.550260 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104959    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 10:52:15.550260 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104962    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 10:52:15.550260 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104964    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 10:52:15.550260 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104966    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 10:52:15.550260 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104969    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 10:52:15.550260 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104971    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 10:52:15.550260 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104974    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 10:52:15.550260 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104977    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 10:52:15.550260 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104979    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 10:52:15.550260 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104982    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 10:52:15.550260 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104985    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 10:52:15.550260 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104989    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 10:52:15.550260 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104991    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 10:52:15.550260 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104994    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 10:52:15.550260 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.104997    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 10:52:15.550260 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105000    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 10:52:15.550794 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105003    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 10:52:15.550794 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105007    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 10:52:15.550794 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105009    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 10:52:15.550794 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105013    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 10:52:15.550794 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105016    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 10:52:15.550794 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105019    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 10:52:15.550794 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105022    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 10:52:15.550794 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105026    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 10:52:15.550794 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105028    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 10:52:15.550794 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105031    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 10:52:15.550794 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105033    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 10:52:15.550794 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105036    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 10:52:15.550794 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105038    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 10:52:15.550794 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105041    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 10:52:15.550794 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105044    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 10:52:15.550794 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105046    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 10:52:15.550794 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105048    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 10:52:15.550794 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105051    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 10:52:15.550794 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105053    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 10:52:15.551248 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105056    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 10:52:15.551248 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105058    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 10:52:15.551248 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105060    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 10:52:15.551248 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105063    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 10:52:15.551248 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105065    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 10:52:15.551248 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105068    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 10:52:15.551248 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105070    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 10:52:15.551248 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105073    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 10:52:15.551248 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105075    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 10:52:15.551248 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105077    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 10:52:15.551248 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105080    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 10:52:15.551248 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105082    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 10:52:15.551248 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105085    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 10:52:15.551248 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105087    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 10:52:15.551248 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105090    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 10:52:15.551248 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105092    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 10:52:15.551248 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105097    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 10:52:15.551248 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105100    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 10:52:15.551248 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105102    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 10:52:15.551248 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105104    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 10:52:15.551776 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105108    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 10:52:15.551776 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105111    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 10:52:15.551776 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105113    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 10:52:15.551776 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105116    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 10:52:15.551776 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105118    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 10:52:15.551776 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105121    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 10:52:15.551776 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105123    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 10:52:15.551776 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105126    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 10:52:15.551776 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105128    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 10:52:15.551776 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105131    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 10:52:15.551776 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105133    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 10:52:15.551776 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105136    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 10:52:15.551776 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105138    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 10:52:15.551776 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105141    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 10:52:15.551776 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105143    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 10:52:15.551776 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105146    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 10:52:15.551776 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105148    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 10:52:15.551776 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105150    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 10:52:15.551776 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105153    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 10:52:15.551776 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105155    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 10:52:15.552274 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105158    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 10:52:15.552274 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105160    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 10:52:15.552274 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105162    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 10:52:15.552274 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105165    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 10:52:15.552274 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105167    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 10:52:15.552274 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105170    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 10:52:15.552274 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105172    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 10:52:15.552274 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105175    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 10:52:15.552274 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105178    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 10:52:15.552274 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105181    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 10:52:15.552274 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105183    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 10:52:15.552274 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105185    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 10:52:15.552274 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105189    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 10:52:15.552274 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105192    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 10:52:15.552274 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105195    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 10:52:15.552274 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105198    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 10:52:15.552274 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105202    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 10:52:15.552274 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:15.105204    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 10:52:15.552760 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.105209    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 10:52:15.552760 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.105293    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 17 10:52:15.552760 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.107424    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 17 10:52:15.552760 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.108785    2563 server.go:1019] "Starting client certificate rotation"
Jul 17 10:52:15.552760 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.108879    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 17 10:52:15.552760 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.108908    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 17 10:52:15.552760 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.110954    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 17 10:52:15.552760 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.115226    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 17 10:52:15.552760 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.125534    2563 log.go:25] "Validated CRI v1 runtime API"
Jul 17 10:52:15.552760 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.127483    2563 log.go:25] "Validated CRI v1 image API"
Jul 17 10:52:15.552760 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.129322    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 17 10:52:15.552760 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.132100    2563 fs.go:135] Filesystem UUIDs: map[4e5d44df-e72b-4ec1-8395-de66ce99cce6:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 87bef8e1-939c-4a46-b089-914bce8a73c9:/dev/nvme0n1p4]
Jul 17 10:52:15.553105 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.132115    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 17 10:52:15.553205 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.136784    2563 manager.go:216] Machine: {Timestamp:2026-07-17 10:52:15.135727007 +0000 UTC m=+0.316759959 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3254974 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec215db72fec05c754b4382abfab3449 SystemUUID:ec215db7-2fec-05c7-54b4-382abfab3449 BootID:32dc5db6-a384-4fca-ada1-fedbce09da6b Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d7:8b:88:a2:fb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d7:8b:88:a2:fb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6a:90:45:67:b3:e1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 17 10:52:15.553205 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.136886    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 17 10:52:15.553205 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.136953    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 17 10:52:15.553205 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.139749    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 17 10:52:15.553205 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.139773    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-12.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 17 10:52:15.553205 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.140054    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 17 10:52:15.553205 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.140423    2563 topology_manager.go:138] "Creating topology manager with none policy"
Jul 17 10:52:15.553463 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.140447    2563 container_manager_linux.go:309] "Creating device plugin manager"
Jul 17 10:52:15.553463 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.140455    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 17 10:52:15.553463 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.141049    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 17 10:52:15.553463 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.142261    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 17 10:52:15.553463 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.145939    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 17 10:52:15.553463 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.146084    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 17 10:52:15.553463 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.146112    2563 kubelet.go:486] "Attempting to sync node with API server"
Jul 17 10:52:15.553463 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.146123    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 17 10:52:15.553463 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.146145    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 17 10:52:15.553463 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.146206    2563 kubelet.go:398] "Adding apiserver pod source"
Jul 17 10:52:15.553463 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.146220    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 17 10:52:15.553463 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.146673    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 17 10:52:15.553463 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.146688    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 17 10:52:15.553463 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.148724    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 17 10:52:15.553463 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.150208    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 17 10:52:15.553463 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.150236    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 17 10:52:15.553463 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.151185    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 17 10:52:15.553463 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.151197    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 17 10:52:15.553463 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.151203    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 17 10:52:15.553463 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.151207    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 17 10:52:15.553463 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.151216    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 17 10:52:15.553463 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.151221    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 17 10:52:15.553463 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.151229    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 17 10:52:15.553463 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.151233    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 17 10:52:15.553463 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.151240    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 17 10:52:15.553463 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.151246    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 17 10:52:15.553463 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.151254    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 17 10:52:15.553463 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.151259    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 17 10:52:15.553463 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.152055    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 17 10:52:15.553463 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.152062    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 17 10:52:15.553463 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.155075    2563 server.go:1268] "Started kubelet"
Jul 17 10:52:15.553463 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.155397    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 17 10:52:15.553463 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.155486    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 17 10:52:15.553463 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.155984    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 17 10:52:15.553463 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.156990    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-12.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 17 10:52:15.553463 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:15.157338    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 17 10:52:15.553463 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:15.157459    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-12.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 17 10:52:15.553463 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.157936    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 17 10:52:15.553463 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.159851    2563 server.go:310] "Adding debug handlers to kubelet server"
Jul 17 10:52:15.685079 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:15.160936    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 17 10:52:15.685079 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:15.164151    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-12.ec2.internal.18c30e3d9cc8de00  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-12.ec2.internal,UID:ip-10-0-143-12.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-12.ec2.internal,},FirstTimestamp:2026-07-17 10:52:15.155052032 +0000 UTC m=+0.336085040,LastTimestamp:2026-07-17 10:52:15.155052032 +0000 UTC m=+0.336085040,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-12.ec2.internal,}"
Jul 17 10:52:15.685079 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.165511    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 17 10:52:15.685079 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.165517    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 17 10:52:15.685079 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:15.165584    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-12.ec2.internal\" not found"
Jul 17 10:52:15.685079 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.166044    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 17 10:52:15.685079 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.166059    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 17 10:52:15.685079 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.166058    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 17 10:52:15.685079 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.166201    2563 reconstruct.go:97] "Volume reconstruction finished"
Jul 17 10:52:15.685079 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.166209    2563 reconciler.go:29] "Reconciler: start to sync state"
Jul 17 10:52:15.685079 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.166447    2563 factory.go:153] Registering CRI-O factory
Jul 17 10:52:15.685079 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.166470    2563 factory.go:223] Registration of the crio container factory successfully
Jul 17 10:52:15.685079 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.166540    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 17 10:52:15.685079 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.166550    2563 factory.go:55] Registering systemd factory
Jul 17 10:52:15.685079 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.166558    2563 factory.go:223] Registration of the systemd container factory successfully
Jul 17 10:52:15.685079 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.166580    2563 factory.go:103] Registering Raw factory
Jul 17 10:52:15.685079 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.166592    2563 manager.go:1196] Started watching for new ooms in manager
Jul 17 10:52:15.685079 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.167003    2563 manager.go:349] Starting recovery of all containers
Jul 17 10:52:15.685079 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.173231    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 17 10:52:15.685079 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.178626    2563 manager.go:354] Recovery completed
Jul 17 10:52:15.685079 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:15.178707    2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-12.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 17 10:52:15.685079 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:15.178620    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 17 10:52:15.685079 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.183692    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 10:52:15.685079 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.185272    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 10:52:15.685079 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.185296    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 10:52:15.685079 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.185306    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-12.ec2.internal" event="NodeHasSufficientPID"
Jul 17 10:52:15.685079 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.185829    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 17 10:52:15.685079 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.185837    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 17 10:52:15.685079 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.185855    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 17 10:52:15.685079 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.185837    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 10:52:15.685079 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.186544    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 10:52:15.685079 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.186564    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 10:52:15.685079 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.186574    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-12.ec2.internal" event="NodeHasSufficientPID"
Jul 17 10:52:15.686671 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.187995    2563 policy_none.go:49] "None policy: Start"
Jul 17 10:52:15.686671 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.188007    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 17 10:52:15.686671 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.188016    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 17 10:52:15.686671 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.190015    2563 policy_none.go:47] "Start"
Jul 17 10:52:15.686671 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:15.195594    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-12.ec2.internal.18c30e3d9e962ead  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-12.ec2.internal,UID:ip-10-0-143-12.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-12.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-12.ec2.internal,},FirstTimestamp:2026-07-17 10:52:15.185284781 +0000 UTC m=+0.366317736,LastTimestamp:2026-07-17 10:52:15.185284781 +0000 UTC m=+0.366317736,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-12.ec2.internal,}"
Jul 17 10:52:15.686671 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:15.197589    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-12.ec2.internal.18c30e3d9e966da2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-12.ec2.internal,UID:ip-10-0-143-12.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-12.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-12.ec2.internal,},FirstTimestamp:2026-07-17 10:52:15.185300898 +0000 UTC m=+0.366333852,LastTimestamp:2026-07-17 10:52:15.185300898 +0000 UTC m=+0.366333852,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-12.ec2.internal,}"
Jul 17 10:52:15.686671 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.198947    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kqhqn"
Jul 17 10:52:15.686671 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.206626    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kqhqn"
Jul 17 10:52:15.686671 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:15.207411    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-12.ec2.internal.18c30e3d9e9690bd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-12.ec2.internal,UID:ip-10-0-143-12.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-12.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-12.ec2.internal,},FirstTimestamp:2026-07-17 10:52:15.185309885 +0000 UTC m=+0.366342838,LastTimestamp:2026-07-17 10:52:15.185309885 +0000 UTC m=+0.366342838,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-12.ec2.internal,}"
Jul 17 10:52:15.686671 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.234016    2563 manager.go:337] "Starting Device Plugin manager"
Jul 17 10:52:15.686671 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:15.234039    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 17 10:52:15.686671 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.234047    2563 server.go:87] "Starting device plugin registration server"
Jul 17 10:52:15.686671 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.234256    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 17 10:52:15.686671 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.234267    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 17 10:52:15.686671 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.234362    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 17 10:52:15.686671 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.234491    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 17 10:52:15.686671 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.234500    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 17 10:52:15.686671 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:15.234797    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 17 10:52:15.686671 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:15.234839    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-12.ec2.internal\" not found"
Jul 17 10:52:15.686671 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.258500    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 17 10:52:15.686671 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.258540    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 17 10:52:15.687244 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.258559    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 17 10:52:15.687244 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:15.258592    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 17 10:52:15.687244 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.260950    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 10:52:15.687244 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.335379    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 10:52:15.687244 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.336232    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 10:52:15.687244 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.336255    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 10:52:15.687244 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.336268    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-12.ec2.internal" event="NodeHasSufficientPID"
Jul 17 10:52:15.687244 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.336291    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-12.ec2.internal"
Jul 17 10:52:15.687244 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.345821    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-12.ec2.internal"
Jul 17 10:52:15.687244 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:15.345842    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-12.ec2.internal\": node \"ip-10-0-143-12.ec2.internal\" not found"
Jul 17 10:52:15.687244 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.359533    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-12.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-12.ec2.internal"]
Jul 17 10:52:15.687244 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.359585    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 10:52:15.687244 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.360894    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 10:52:15.687244 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.360918    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 10:52:15.687244 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.360930    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-12.ec2.internal" event="NodeHasSufficientPID"
Jul 17 10:52:15.687244 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.363055    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 10:52:15.687244 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.363191    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-12.ec2.internal"
Jul 17 10:52:15.687244 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.363215    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 10:52:15.687244 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.363702    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 10:52:15.687244 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.363721    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 10:52:15.687244 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.363745    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 10:52:15.687244 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.363754    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-12.ec2.internal" event="NodeHasSufficientPID"
Jul 17 10:52:15.687244 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.363726    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 10:52:15.687244 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.363811    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-12.ec2.internal" event="NodeHasSufficientPID"
Jul 17 10:52:15.687244 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.366010    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-12.ec2.internal"
Jul 17 10:52:15.687244 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.366034    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 10:52:15.687244 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.366625    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 10:52:15.687244 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.366653    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 10:52:15.687244 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.366666    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-12.ec2.internal" event="NodeHasSufficientPID"
Jul 17 10:52:15.687244 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.367901    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8156c76681f600ec67b24c4f53df05a0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-12.ec2.internal\" (UID: \"8156c76681f600ec67b24c4f53df05a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-12.ec2.internal"
Jul 17 10:52:15.688724 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.367926    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8156c76681f600ec67b24c4f53df05a0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-12.ec2.internal\" (UID: \"8156c76681f600ec67b24c4f53df05a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-12.ec2.internal"
Jul 17 10:52:15.688724 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.367945    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/37f630f90b2f531885effe9035c04ad9-config\") pod \"kube-apiserver-proxy-ip-10-0-143-12.ec2.internal\" (UID: \"37f630f90b2f531885effe9035c04ad9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-12.ec2.internal"
Jul 17 10:52:15.688724 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:15.370054    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-12.ec2.internal\" not found"
Jul 17 10:52:15.688724 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:15.409810    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-12.ec2.internal\" not found" node="ip-10-0-143-12.ec2.internal"
Jul 17 10:52:15.688724 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:15.414105    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-12.ec2.internal\" not found" node="ip-10-0-143-12.ec2.internal"
Jul 17 10:52:15.688724 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.468148    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8156c76681f600ec67b24c4f53df05a0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-12.ec2.internal\" (UID: \"8156c76681f600ec67b24c4f53df05a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-12.ec2.internal"
Jul 17 10:52:15.688724 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.468167    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8156c76681f600ec67b24c4f53df05a0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-12.ec2.internal\" (UID: \"8156c76681f600ec67b24c4f53df05a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-12.ec2.internal"
Jul 17 10:52:15.688724 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.468183    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/37f630f90b2f531885effe9035c04ad9-config\") pod \"kube-apiserver-proxy-ip-10-0-143-12.ec2.internal\" (UID: \"37f630f90b2f531885effe9035c04ad9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-12.ec2.internal"
Jul 17 10:52:15.688724 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.468217    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/37f630f90b2f531885effe9035c04ad9-config\") pod \"kube-apiserver-proxy-ip-10-0-143-12.ec2.internal\" (UID: \"37f630f90b2f531885effe9035c04ad9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-12.ec2.internal"
Jul 17 10:52:15.688724 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.468241    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8156c76681f600ec67b24c4f53df05a0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-12.ec2.internal\" (UID: \"8156c76681f600ec67b24c4f53df05a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-12.ec2.internal"
Jul 17 10:52:15.688724 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.468253    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8156c76681f600ec67b24c4f53df05a0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-12.ec2.internal\" (UID: \"8156c76681f600ec67b24c4f53df05a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-12.ec2.internal"
Jul 17 10:52:15.688724 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:15.470412    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-12.ec2.internal\" not found"
Jul 17 10:52:15.688724 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:15.575544    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-12.ec2.internal\" not found"
Jul 17 10:52:15.688724 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:15.676597    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-12.ec2.internal\" not found"
Jul 17 10:52:15.763337 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.711755    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-12.ec2.internal"
Jul 17 10:52:15.763337 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:15.717372    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-12.ec2.internal"
Jul 17 10:52:15.896181 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:15.777395    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-12.ec2.internal\" not found"
Jul 17 10:52:15.896181 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:15.877853    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-12.ec2.internal\" not found"
Jul 17 10:52:16.067476 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:15.978377    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-12.ec2.internal\" not found"
Jul 17 10:52:16.232052 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:16.078796    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-12.ec2.internal\" not found"
Jul 17 10:52:16.232052 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:16.107938    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 17 10:52:16.232052 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:16.108033    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 17 10:52:16.232052 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:16.169236    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 10:52:16.232052 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:16.180768    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 10:52:16.232052 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:16.192393    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 10:52:16.232052 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:16.211210    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-16 10:47:15 +0000 UTC" deadline="2028-01-24 20:40:40.162183643 +0000 UTC"
Jul 17 10:52:16.232052 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:16.211232    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13353h48m23.950954337s"
Jul 17 10:52:16.378966 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:16.266596    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-12.ec2.internal"
Jul 17 10:52:16.378966 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:16.289023    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 17 10:52:16.378966 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:16.290029    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-12.ec2.internal"
Jul 17 10:52:16.378966 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:16.318996    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 17 10:52:16.510864 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:16.431206    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8156c76681f600ec67b24c4f53df05a0.slice/crio-313f7730ed0283128328e0fb99e89ddcf916c8100fbca4bacab5053b5445e135 WatchSource:0}: Error finding container 313f7730ed0283128328e0fb99e89ddcf916c8100fbca4bacab5053b5445e135: Status 404 returned error can't find the container with id 313f7730ed0283128328e0fb99e89ddcf916c8100fbca4bacab5053b5445e135
Jul 17 10:52:16.510864 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:16.431971    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37f630f90b2f531885effe9035c04ad9.slice/crio-66e07661267a45d4f797bf88dc3e6121d0332876106590eecffbee122469402e WatchSource:0}: Error finding container 66e07661267a45d4f797bf88dc3e6121d0332876106590eecffbee122469402e: Status 404 returned error can't find the container with id 66e07661267a45d4f797bf88dc3e6121d0332876106590eecffbee122469402e
Jul 17 10:52:16.510864 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:16.440339    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 10:52:17.123121 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.072058    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 10:52:17.222897 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.147973    2563 apiserver.go:52] "Watching apiserver"
Jul 17 10:52:17.222897 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.156929    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 17 10:52:17.222897 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.158093    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-j9v7m","kube-system/kube-apiserver-proxy-ip-10-0-143-12.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg467","openshift-cluster-node-tuning-operator/tuned-dw8x2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-12.ec2.internal","openshift-multus/multus-xkhv5","openshift-multus/network-metrics-daemon-mdvfl","openshift-dns/node-resolver-rsv5j","openshift-image-registry/node-ca-bpdts","openshift-multus/multus-additional-cni-plugins-vkxxl","openshift-network-diagnostics/network-check-target-t9qnx","openshift-network-operator/iptables-alerter-r6kvv","openshift-ovn-kubernetes/ovnkube-node-xdrhl","kube-system/global-pull-secret-syncer-tw6nz"]
Jul 17 10:52:17.222897 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.160647    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j9v7m"
Jul 17 10:52:17.222897 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.163406    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 17 10:52:17.222897 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.163425    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 17 10:52:17.222897 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.163450    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9x5n6\""
Jul 17 10:52:17.222897 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.163566    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg467"
Jul 17 10:52:17.222897 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.165704    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 17 10:52:17.222897 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.165862    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.222897 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.166198    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 17 10:52:17.222897 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.166321    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 17 10:52:17.222897 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.166422    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-d4spl\""
Jul 17 10:52:17.222897 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.166480    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 17 10:52:17.222897 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.168226    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.222897 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.168452    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-v2j8r\""
Jul 17 10:52:17.222897 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.168767    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 17 10:52:17.222897 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.168965    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 17 10:52:17.222897 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.170671    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdvfl"
Jul 17 10:52:17.222897 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:17.170751    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdvfl" podUID="8037abbc-75d6-42df-9cad-5c1340e0341e"
Jul 17 10:52:17.222897 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.171049    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 17 10:52:17.222897 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.171285    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9fdpn\""
Jul 17 10:52:17.222897 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.171388    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 17 10:52:17.222897 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.172154    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 17 10:52:17.222897 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.172629    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 17 10:52:17.222897 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.174261    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rsv5j"
Jul 17 10:52:17.222897 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.176577    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 17 10:52:17.224392 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.176639    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lvb6d\""
Jul 17 10:52:17.224392 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.176656    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 17 10:52:17.224392 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.177130    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bpdts"
Jul 17 10:52:17.224392 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.177217    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 17 10:52:17.224392 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.179341    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 17 10:52:17.224392 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.179574    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-br8zw\""
Jul 17 10:52:17.224392 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.179639    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 17 10:52:17.224392 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.179578    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 17 10:52:17.224392 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.180055    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vkxxl"
Jul 17 10:52:17.224392 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.182818    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 17 10:52:17.224392 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.182981    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2be15062-4e09-486c-a294-60039db2b5fe-multus-conf-dir\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.224392 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.183000    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e30ba440-b1f4-466d-912e-89c364980c7c-konnectivity-ca\") pod \"konnectivity-agent-j9v7m\" (UID: \"e30ba440-b1f4-466d-912e-89c364980c7c\") " pod="kube-system/konnectivity-agent-j9v7m"
Jul 17 10:52:17.224392 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.183021    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd0a96e7-6c27-431c-9982-595c92b18d3c-etc-kubernetes\") pod \"tuned-dw8x2\" (UID: \"dd0a96e7-6c27-431c-9982-595c92b18d3c\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.224392 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.183035    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dd0a96e7-6c27-431c-9982-595c92b18d3c-run\") pod \"tuned-dw8x2\" (UID: \"dd0a96e7-6c27-431c-9982-595c92b18d3c\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.224392 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.183050    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dd0a96e7-6c27-431c-9982-595c92b18d3c-etc-tuned\") pod \"tuned-dw8x2\" (UID: \"dd0a96e7-6c27-431c-9982-595c92b18d3c\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.224392 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.183063    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2be15062-4e09-486c-a294-60039db2b5fe-host-run-multus-certs\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.224392 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.183077    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d-etc-selinux\") pod \"aws-ebs-csi-driver-node-jg467\" (UID: \"3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg467"
Jul 17 10:52:17.224392 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.183098    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2szhr\""
Jul 17 10:52:17.224392 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.183092    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d-sys-fs\") pod \"aws-ebs-csi-driver-node-jg467\" (UID: \"3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg467"
Jul 17 10:52:17.224392 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.183148    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd0a96e7-6c27-431c-9982-595c92b18d3c-sys\") pod \"tuned-dw8x2\" (UID: \"dd0a96e7-6c27-431c-9982-595c92b18d3c\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.226206 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.183181    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dd0a96e7-6c27-431c-9982-595c92b18d3c-lib-modules\") pod \"tuned-dw8x2\" (UID: \"dd0a96e7-6c27-431c-9982-595c92b18d3c\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.226206 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.183228    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2be15062-4e09-486c-a294-60039db2b5fe-multus-cni-dir\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.226206 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.183266    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2be15062-4e09-486c-a294-60039db2b5fe-host-var-lib-kubelet\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.226206 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.183292    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2be15062-4e09-486c-a294-60039db2b5fe-multus-daemon-config\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.226206 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.183311    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ks4l\" (UniqueName: \"kubernetes.io/projected/2be15062-4e09-486c-a294-60039db2b5fe-kube-api-access-8ks4l\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.226206 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.183352    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dd0a96e7-6c27-431c-9982-595c92b18d3c-etc-sysconfig\") pod \"tuned-dw8x2\" (UID: \"dd0a96e7-6c27-431c-9982-595c92b18d3c\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.226206 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.183381    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dd0a96e7-6c27-431c-9982-595c92b18d3c-etc-sysctl-d\") pod \"tuned-dw8x2\" (UID: \"dd0a96e7-6c27-431c-9982-595c92b18d3c\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.226206 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.183419    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dd0a96e7-6c27-431c-9982-595c92b18d3c-etc-systemd\") pod \"tuned-dw8x2\" (UID: \"dd0a96e7-6c27-431c-9982-595c92b18d3c\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.226206 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.183467    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jd42\" (UniqueName: \"kubernetes.io/projected/dd0a96e7-6c27-431c-9982-595c92b18d3c-kube-api-access-8jd42\") pod \"tuned-dw8x2\" (UID: \"dd0a96e7-6c27-431c-9982-595c92b18d3c\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.226206 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.183538    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e30ba440-b1f4-466d-912e-89c364980c7c-agent-certs\") pod \"konnectivity-agent-j9v7m\" (UID: \"e30ba440-b1f4-466d-912e-89c364980c7c\") " pod="kube-system/konnectivity-agent-j9v7m"
Jul 17 10:52:17.226206 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.183571    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w48jt\" (UniqueName: \"kubernetes.io/projected/3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d-kube-api-access-w48jt\") pod \"aws-ebs-csi-driver-node-jg467\" (UID: \"3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg467"
Jul 17 10:52:17.226206 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.183598    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dd0a96e7-6c27-431c-9982-595c92b18d3c-etc-sysctl-conf\") pod \"tuned-dw8x2\" (UID: \"dd0a96e7-6c27-431c-9982-595c92b18d3c\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.226206 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.183647    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2be15062-4e09-486c-a294-60039db2b5fe-os-release\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.226206 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.183696    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2be15062-4e09-486c-a294-60039db2b5fe-multus-socket-dir-parent\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.226882 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.183724    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2be15062-4e09-486c-a294-60039db2b5fe-host-var-lib-cni-multus\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.226882 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.183749    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jg467\" (UID: \"3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg467"
Jul 17 10:52:17.226882 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.183751    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9qnx"
Jul 17 10:52:17.226882 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.183784    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d-socket-dir\") pod \"aws-ebs-csi-driver-node-jg467\" (UID: \"3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg467"
Jul 17 10:52:17.226882 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.183804    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d-device-dir\") pod \"aws-ebs-csi-driver-node-jg467\" (UID: \"3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg467"
Jul 17 10:52:17.226882 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.183818    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd0a96e7-6c27-431c-9982-595c92b18d3c-host\") pod \"tuned-dw8x2\" (UID: \"dd0a96e7-6c27-431c-9982-595c92b18d3c\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.226882 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:17.183822    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9qnx" podUID="ccf5dfd9-3981-4994-98cc-2edbc2b755b6"
Jul 17 10:52:17.226882 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.183835    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2be15062-4e09-486c-a294-60039db2b5fe-system-cni-dir\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.226882 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.183856    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2be15062-4e09-486c-a294-60039db2b5fe-cni-binary-copy\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.226882 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.183878    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2be15062-4e09-486c-a294-60039db2b5fe-etc-kubernetes\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.226882 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.183918    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2be15062-4e09-486c-a294-60039db2b5fe-host-run-netns\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.226882 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.183940    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2be15062-4e09-486c-a294-60039db2b5fe-hostroot\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.226882 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.183971    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d-registration-dir\") pod \"aws-ebs-csi-driver-node-jg467\" (UID: \"3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg467"
Jul 17 10:52:17.226882 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.183991    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dd0a96e7-6c27-431c-9982-595c92b18d3c-etc-modprobe-d\") pod \"tuned-dw8x2\" (UID: \"dd0a96e7-6c27-431c-9982-595c92b18d3c\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.228209 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.184006    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd0a96e7-6c27-431c-9982-595c92b18d3c-var-lib-kubelet\") pod \"tuned-dw8x2\" (UID: \"dd0a96e7-6c27-431c-9982-595c92b18d3c\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.228209 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.184026    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2be15062-4e09-486c-a294-60039db2b5fe-cnibin\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.228209 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.184058    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2be15062-4e09-486c-a294-60039db2b5fe-host-run-k8s-cni-cncf-io\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.228209 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.184112    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd0a96e7-6c27-431c-9982-595c92b18d3c-tmp\") pod \"tuned-dw8x2\" (UID: \"dd0a96e7-6c27-431c-9982-595c92b18d3c\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.228209 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.184144    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2be15062-4e09-486c-a294-60039db2b5fe-host-var-lib-cni-bin\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.228209 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.184993    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 17 10:52:17.228209 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.187842    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r6kvv"
Jul 17 10:52:17.228209 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.190184    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 17 10:52:17.228209 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.190590    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9cgqn\""
Jul 17 10:52:17.228209 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.190786    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 17 10:52:17.228209 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.191150    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 17 10:52:17.228209 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.213376    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nc575"
Jul 17 10:52:17.228209 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.216969    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.228209 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.219695    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tw6nz"
Jul 17 10:52:17.228209 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:17.219747    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tw6nz" podUID="ca964baf-243f-4cb7-a20e-3c802e627f2c"
Jul 17 10:52:17.228209 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.219841    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pd87q\""
Jul 17 10:52:17.228209 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.220029    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 17 10:52:17.228209 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.220056    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 17 10:52:17.228209 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.220119    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 17 10:52:17.228209 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.220248    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 17 10:52:17.228209 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.220464    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 17 10:52:17.228209 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.220882    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nc575"
Jul 17 10:52:17.228209 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.220962    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 17 10:52:17.365144 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.268551    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 17 10:52:17.365144 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.271150    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-12.ec2.internal" event={"ID":"37f630f90b2f531885effe9035c04ad9","Type":"ContainerStarted","Data":"66e07661267a45d4f797bf88dc3e6121d0332876106590eecffbee122469402e"}
Jul 17 10:52:17.365144 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.271196    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-12.ec2.internal" event={"ID":"8156c76681f600ec67b24c4f53df05a0","Type":"ContainerStarted","Data":"313f7730ed0283128328e0fb99e89ddcf916c8100fbca4bacab5053b5445e135"}
Jul 17 10:52:17.365144 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.285055    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2be15062-4e09-486c-a294-60039db2b5fe-host-var-lib-cni-multus\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.365144 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.285096    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jg467\" (UID: \"3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg467"
Jul 17 10:52:17.365144 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.285122    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d-socket-dir\") pod \"aws-ebs-csi-driver-node-jg467\" (UID: \"3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg467"
Jul 17 10:52:17.365144 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.285185    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2be15062-4e09-486c-a294-60039db2b5fe-host-var-lib-cni-multus\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.365144 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.285206    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jg467\" (UID: \"3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg467"
Jul 17 10:52:17.365144 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.285233    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2be15062-4e09-486c-a294-60039db2b5fe-system-cni-dir\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.365144 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.285249    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d-socket-dir\") pod \"aws-ebs-csi-driver-node-jg467\" (UID: \"3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg467"
Jul 17 10:52:17.365144 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.285253    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2be15062-4e09-486c-a294-60039db2b5fe-cni-binary-copy\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.365144 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.285300    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85a21320-4c6f-4b3a-9d2b-3701c891a810-system-cni-dir\") pod \"multus-additional-cni-plugins-vkxxl\" (UID: \"85a21320-4c6f-4b3a-9d2b-3701c891a810\") " pod="openshift-multus/multus-additional-cni-plugins-vkxxl"
Jul 17 10:52:17.365144 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.285326    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-host-kubelet\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.365144 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.285349    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-etc-openvswitch\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.365144 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.285348    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2be15062-4e09-486c-a294-60039db2b5fe-system-cni-dir\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.367139 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.285376    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2be15062-4e09-486c-a294-60039db2b5fe-host-run-netns\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.367139 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.285415    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2be15062-4e09-486c-a294-60039db2b5fe-host-run-netns\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.367139 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.285445    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5b4b\" (UniqueName: \"kubernetes.io/projected/d1260e44-4d64-4569-b0ce-78f616f8b412-kube-api-access-h5b4b\") pod \"node-ca-bpdts\" (UID: \"d1260e44-4d64-4569-b0ce-78f616f8b412\") " pod="openshift-image-registry/node-ca-bpdts"
Jul 17 10:52:17.367139 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.285499    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/85a21320-4c6f-4b3a-9d2b-3701c891a810-cnibin\") pod \"multus-additional-cni-plugins-vkxxl\" (UID: \"85a21320-4c6f-4b3a-9d2b-3701c891a810\") " pod="openshift-multus/multus-additional-cni-plugins-vkxxl"
Jul 17 10:52:17.367139 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.285531    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ca964baf-243f-4cb7-a20e-3c802e627f2c-dbus\") pod \"global-pull-secret-syncer-tw6nz\" (UID: \"ca964baf-243f-4cb7-a20e-3c802e627f2c\") " pod="kube-system/global-pull-secret-syncer-tw6nz"
Jul 17 10:52:17.367139 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.285575    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a90ca9ac-e3c6-452c-89d5-64d3f4c9b1e9-tmp-dir\") pod \"node-resolver-rsv5j\" (UID: \"a90ca9ac-e3c6-452c-89d5-64d3f4c9b1e9\") " pod="openshift-dns/node-resolver-rsv5j"
Jul 17 10:52:17.367139 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.285607    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-host-slash\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.367139 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.285649    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d-registration-dir\") pod \"aws-ebs-csi-driver-node-jg467\" (UID: \"3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg467"
Jul 17 10:52:17.367139 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.285706    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd0a96e7-6c27-431c-9982-595c92b18d3c-var-lib-kubelet\") pod \"tuned-dw8x2\" (UID: \"dd0a96e7-6c27-431c-9982-595c92b18d3c\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.367139 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.285732    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2be15062-4e09-486c-a294-60039db2b5fe-host-run-k8s-cni-cncf-io\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.367139 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.285758    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d1260e44-4d64-4569-b0ce-78f616f8b412-serviceca\") pod \"node-ca-bpdts\" (UID: \"d1260e44-4d64-4569-b0ce-78f616f8b412\") " pod="openshift-image-registry/node-ca-bpdts"
Jul 17 10:52:17.367139 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.285774    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d-registration-dir\") pod \"aws-ebs-csi-driver-node-jg467\" (UID: \"3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg467"
Jul 17 10:52:17.367139 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.285782    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8037abbc-75d6-42df-9cad-5c1340e0341e-metrics-certs\") pod \"network-metrics-daemon-mdvfl\" (UID: \"8037abbc-75d6-42df-9cad-5c1340e0341e\") " pod="openshift-multus/network-metrics-daemon-mdvfl"
Jul 17 10:52:17.367139 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.285774    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd0a96e7-6c27-431c-9982-595c92b18d3c-var-lib-kubelet\") pod \"tuned-dw8x2\" (UID: \"dd0a96e7-6c27-431c-9982-595c92b18d3c\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.367809 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.285817    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2be15062-4e09-486c-a294-60039db2b5fe-cni-binary-copy\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.367809 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.285844    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.367809 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.285823    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2be15062-4e09-486c-a294-60039db2b5fe-host-run-k8s-cni-cncf-io\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.367809 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.285870    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/48cc1998-ebc5-4702-8b08-027479580e57-env-overrides\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.367809 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.285910    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd0a96e7-6c27-431c-9982-595c92b18d3c-tmp\") pod \"tuned-dw8x2\" (UID: \"dd0a96e7-6c27-431c-9982-595c92b18d3c\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.367809 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.285933    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2be15062-4e09-486c-a294-60039db2b5fe-multus-conf-dir\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.367809 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.285949    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d1260e44-4d64-4569-b0ce-78f616f8b412-host\") pod \"node-ca-bpdts\" (UID: \"d1260e44-4d64-4569-b0ce-78f616f8b412\") " pod="openshift-image-registry/node-ca-bpdts"
Jul 17 10:52:17.367809 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.285965    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/85a21320-4c6f-4b3a-9d2b-3701c891a810-os-release\") pod \"multus-additional-cni-plugins-vkxxl\" (UID: \"85a21320-4c6f-4b3a-9d2b-3701c891a810\") " pod="openshift-multus/multus-additional-cni-plugins-vkxxl"
Jul 17 10:52:17.367809 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.286000    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/48cc1998-ebc5-4702-8b08-027479580e57-ovn-node-metrics-cert\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.367809 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.286035    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e30ba440-b1f4-466d-912e-89c364980c7c-konnectivity-ca\") pod \"konnectivity-agent-j9v7m\" (UID: \"e30ba440-b1f4-466d-912e-89c364980c7c\") " pod="kube-system/konnectivity-agent-j9v7m"
Jul 17 10:52:17.367809 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.286076    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd0a96e7-6c27-431c-9982-595c92b18d3c-etc-kubernetes\") pod \"tuned-dw8x2\" (UID: \"dd0a96e7-6c27-431c-9982-595c92b18d3c\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.367809 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.286107    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2be15062-4e09-486c-a294-60039db2b5fe-multus-conf-dir\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.367809 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.286131    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd0a96e7-6c27-431c-9982-595c92b18d3c-etc-kubernetes\") pod \"tuned-dw8x2\" (UID: \"dd0a96e7-6c27-431c-9982-595c92b18d3c\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.367809 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.286174    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dd0a96e7-6c27-431c-9982-595c92b18d3c-etc-tuned\") pod \"tuned-dw8x2\" (UID: \"dd0a96e7-6c27-431c-9982-595c92b18d3c\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.369149 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.286229    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2be15062-4e09-486c-a294-60039db2b5fe-host-run-multus-certs\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.369149 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.286261    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 17 10:52:17.369149 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.286282    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ms7z\" (UniqueName: \"kubernetes.io/projected/85a21320-4c6f-4b3a-9d2b-3701c891a810-kube-api-access-6ms7z\") pod \"multus-additional-cni-plugins-vkxxl\" (UID: \"85a21320-4c6f-4b3a-9d2b-3701c891a810\") " pod="openshift-multus/multus-additional-cni-plugins-vkxxl"
Jul 17 10:52:17.369149 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.286308    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d-etc-selinux\") pod \"aws-ebs-csi-driver-node-jg467\" (UID: \"3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg467"
Jul 17 10:52:17.369149 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.286329    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2be15062-4e09-486c-a294-60039db2b5fe-multus-cni-dir\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.369149 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.286343    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2be15062-4e09-486c-a294-60039db2b5fe-host-run-multus-certs\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.369149 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.286388    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2be15062-4e09-486c-a294-60039db2b5fe-multus-daemon-config\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.369149 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.286468    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ks4l\" (UniqueName: \"kubernetes.io/projected/2be15062-4e09-486c-a294-60039db2b5fe-kube-api-access-8ks4l\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.369149 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.286488    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d-etc-selinux\") pod \"aws-ebs-csi-driver-node-jg467\" (UID: \"3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg467"
Jul 17 10:52:17.369149 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.286503    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/85a21320-4c6f-4b3a-9d2b-3701c891a810-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vkxxl\" (UID: \"85a21320-4c6f-4b3a-9d2b-3701c891a810\") " pod="openshift-multus/multus-additional-cni-plugins-vkxxl"
Jul 17 10:52:17.369149 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.286526    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2be15062-4e09-486c-a294-60039db2b5fe-multus-cni-dir\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.369149 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.286594    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e30ba440-b1f4-466d-912e-89c364980c7c-konnectivity-ca\") pod \"konnectivity-agent-j9v7m\" (UID: \"e30ba440-b1f4-466d-912e-89c364980c7c\") " pod="kube-system/konnectivity-agent-j9v7m"
Jul 17 10:52:17.369149 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.286703    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjv4v\" (UniqueName: \"kubernetes.io/projected/a90ca9ac-e3c6-452c-89d5-64d3f4c9b1e9-kube-api-access-sjv4v\") pod \"node-resolver-rsv5j\" (UID: \"a90ca9ac-e3c6-452c-89d5-64d3f4c9b1e9\") " pod="openshift-dns/node-resolver-rsv5j"
Jul 17 10:52:17.369149 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.286725    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-log-socket\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.369736 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.286742    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dd0a96e7-6c27-431c-9982-595c92b18d3c-etc-sysctl-d\") pod \"tuned-dw8x2\" (UID: \"dd0a96e7-6c27-431c-9982-595c92b18d3c\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.369736 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.286770    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-host-cni-bin\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.369736 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.286798    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2be15062-4e09-486c-a294-60039db2b5fe-multus-socket-dir-parent\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.369736 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.286848    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2be15062-4e09-486c-a294-60039db2b5fe-multus-socket-dir-parent\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.369736 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.286848    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dd0a96e7-6c27-431c-9982-595c92b18d3c-etc-sysctl-d\") pod \"tuned-dw8x2\" (UID: \"dd0a96e7-6c27-431c-9982-595c92b18d3c\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.369736 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.286855    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e0f3591-65a5-481e-a4a0-81f3a07aa904-host-slash\") pod \"iptables-alerter-r6kvv\" (UID: \"3e0f3591-65a5-481e-a4a0-81f3a07aa904\") " pod="openshift-network-operator/iptables-alerter-r6kvv"
Jul 17 10:52:17.369736 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.286882    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2be15062-4e09-486c-a294-60039db2b5fe-multus-daemon-config\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.369736 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.286885    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-run-systemd\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.369736 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.286936    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-host-run-ovn-kubernetes\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.369736 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.287021    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-host-cni-netd\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.369736 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.287049    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d-device-dir\") pod \"aws-ebs-csi-driver-node-jg467\" (UID: \"3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg467"
Jul 17 10:52:17.369736 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.287069    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd0a96e7-6c27-431c-9982-595c92b18d3c-host\") pod \"tuned-dw8x2\" (UID: \"dd0a96e7-6c27-431c-9982-595c92b18d3c\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.369736 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.287091    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2be15062-4e09-486c-a294-60039db2b5fe-etc-kubernetes\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.369736 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.287115    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/85a21320-4c6f-4b3a-9d2b-3701c891a810-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vkxxl\" (UID: \"85a21320-4c6f-4b3a-9d2b-3701c891a810\") " pod="openshift-multus/multus-additional-cni-plugins-vkxxl"
Jul 17 10:52:17.370420 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.287156    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8wcn\" (UniqueName: \"kubernetes.io/projected/3e0f3591-65a5-481e-a4a0-81f3a07aa904-kube-api-access-g8wcn\") pod \"iptables-alerter-r6kvv\" (UID: \"3e0f3591-65a5-481e-a4a0-81f3a07aa904\") " pod="openshift-network-operator/iptables-alerter-r6kvv"
Jul 17 10:52:17.370420 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.287180    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2be15062-4e09-486c-a294-60039db2b5fe-etc-kubernetes\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.370420 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.287182    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ca964baf-243f-4cb7-a20e-3c802e627f2c-kubelet-config\") pod \"global-pull-secret-syncer-tw6nz\" (UID: \"ca964baf-243f-4cb7-a20e-3c802e627f2c\") " pod="kube-system/global-pull-secret-syncer-tw6nz"
Jul 17 10:52:17.370420 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.287219    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9vfq\" (UniqueName: \"kubernetes.io/projected/8037abbc-75d6-42df-9cad-5c1340e0341e-kube-api-access-q9vfq\") pod \"network-metrics-daemon-mdvfl\" (UID: \"8037abbc-75d6-42df-9cad-5c1340e0341e\") " pod="openshift-multus/network-metrics-daemon-mdvfl"
Jul 17 10:52:17.370420 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.287229    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d-device-dir\") pod \"aws-ebs-csi-driver-node-jg467\" (UID: \"3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg467"
Jul 17 10:52:17.370420 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.287184    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd0a96e7-6c27-431c-9982-595c92b18d3c-host\") pod \"tuned-dw8x2\" (UID: \"dd0a96e7-6c27-431c-9982-595c92b18d3c\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.370420 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.287261    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-systemd-units\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.370420 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.287306    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2be15062-4e09-486c-a294-60039db2b5fe-hostroot\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.370420 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.287327    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a90ca9ac-e3c6-452c-89d5-64d3f4c9b1e9-hosts-file\") pod \"node-resolver-rsv5j\" (UID: \"a90ca9ac-e3c6-452c-89d5-64d3f4c9b1e9\") " pod="openshift-dns/node-resolver-rsv5j"
Jul 17 10:52:17.370420 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.287366    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2be15062-4e09-486c-a294-60039db2b5fe-hostroot\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.370420 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.287391    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-host-run-netns\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.370420 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.287425    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/48cc1998-ebc5-4702-8b08-027479580e57-ovnkube-config\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.370420 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.287473    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dd0a96e7-6c27-431c-9982-595c92b18d3c-etc-modprobe-d\") pod \"tuned-dw8x2\" (UID: \"dd0a96e7-6c27-431c-9982-595c92b18d3c\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.370420 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.287500    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2be15062-4e09-486c-a294-60039db2b5fe-cnibin\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.370999 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.287528    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqvqj\" (UniqueName: \"kubernetes.io/projected/ccf5dfd9-3981-4994-98cc-2edbc2b755b6-kube-api-access-pqvqj\") pod \"network-check-target-t9qnx\" (UID: \"ccf5dfd9-3981-4994-98cc-2edbc2b755b6\") " pod="openshift-network-diagnostics/network-check-target-t9qnx"
Jul 17 10:52:17.370999 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.287555    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-node-log\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.370999 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.287609    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2be15062-4e09-486c-a294-60039db2b5fe-host-var-lib-cni-bin\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.370999 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.287648    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3e0f3591-65a5-481e-a4a0-81f3a07aa904-iptables-alerter-script\") pod \"iptables-alerter-r6kvv\" (UID: \"3e0f3591-65a5-481e-a4a0-81f3a07aa904\") " pod="openshift-network-operator/iptables-alerter-r6kvv"
Jul 17 10:52:17.370999 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.287673    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2be15062-4e09-486c-a294-60039db2b5fe-cnibin\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.370999 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.287675    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-run-openvswitch\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.370999 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.287714    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dd0a96e7-6c27-431c-9982-595c92b18d3c-run\") pod \"tuned-dw8x2\" (UID: \"dd0a96e7-6c27-431c-9982-595c92b18d3c\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.370999 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.287622    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dd0a96e7-6c27-431c-9982-595c92b18d3c-etc-modprobe-d\") pod \"tuned-dw8x2\" (UID: \"dd0a96e7-6c27-431c-9982-595c92b18d3c\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.370999 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.287715    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2be15062-4e09-486c-a294-60039db2b5fe-host-var-lib-cni-bin\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.370999 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.287742    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-var-lib-openvswitch\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.370999 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.287770    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d-sys-fs\") pod \"aws-ebs-csi-driver-node-jg467\" (UID: \"3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg467"
Jul 17 10:52:17.370999 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.287777    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dd0a96e7-6c27-431c-9982-595c92b18d3c-run\") pod \"tuned-dw8x2\" (UID: \"dd0a96e7-6c27-431c-9982-595c92b18d3c\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.370999 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.287801    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd0a96e7-6c27-431c-9982-595c92b18d3c-sys\") pod \"tuned-dw8x2\" (UID: \"dd0a96e7-6c27-431c-9982-595c92b18d3c\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.370999 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.287825    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d-sys-fs\") pod \"aws-ebs-csi-driver-node-jg467\" (UID: \"3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg467"
Jul 17 10:52:17.371780 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.287825    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dd0a96e7-6c27-431c-9982-595c92b18d3c-lib-modules\") pod \"tuned-dw8x2\" (UID: \"dd0a96e7-6c27-431c-9982-595c92b18d3c\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.371780 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.287864    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2be15062-4e09-486c-a294-60039db2b5fe-host-var-lib-kubelet\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.371780 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.287878    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd0a96e7-6c27-431c-9982-595c92b18d3c-sys\") pod \"tuned-dw8x2\" (UID: \"dd0a96e7-6c27-431c-9982-595c92b18d3c\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.371780 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.287891    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/85a21320-4c6f-4b3a-9d2b-3701c891a810-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vkxxl\" (UID: \"85a21320-4c6f-4b3a-9d2b-3701c891a810\") " pod="openshift-multus/multus-additional-cni-plugins-vkxxl"
Jul 17 10:52:17.371780 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.287923    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2be15062-4e09-486c-a294-60039db2b5fe-host-var-lib-kubelet\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.371780 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.287917    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-run-ovn\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.371780 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.287956    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dd0a96e7-6c27-431c-9982-595c92b18d3c-etc-sysconfig\") pod \"tuned-dw8x2\" (UID: \"dd0a96e7-6c27-431c-9982-595c92b18d3c\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.371780 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.287979    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dd0a96e7-6c27-431c-9982-595c92b18d3c-etc-systemd\") pod \"tuned-dw8x2\" (UID: \"dd0a96e7-6c27-431c-9982-595c92b18d3c\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.371780 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.288003    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jd42\" (UniqueName: \"kubernetes.io/projected/dd0a96e7-6c27-431c-9982-595c92b18d3c-kube-api-access-8jd42\") pod \"tuned-dw8x2\" (UID: \"dd0a96e7-6c27-431c-9982-595c92b18d3c\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.371780 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.288027    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/85a21320-4c6f-4b3a-9d2b-3701c891a810-cni-binary-copy\") pod \"multus-additional-cni-plugins-vkxxl\" (UID: \"85a21320-4c6f-4b3a-9d2b-3701c891a810\") " pod="openshift-multus/multus-additional-cni-plugins-vkxxl"
Jul 17 10:52:17.371780 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.288077    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dd0a96e7-6c27-431c-9982-595c92b18d3c-lib-modules\") pod \"tuned-dw8x2\" (UID: \"dd0a96e7-6c27-431c-9982-595c92b18d3c\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.371780 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.288085    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca964baf-243f-4cb7-a20e-3c802e627f2c-original-pull-secret\") pod \"global-pull-secret-syncer-tw6nz\" (UID: \"ca964baf-243f-4cb7-a20e-3c802e627f2c\") " pod="kube-system/global-pull-secret-syncer-tw6nz"
Jul 17 10:52:17.371780 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.288113    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/48cc1998-ebc5-4702-8b08-027479580e57-ovnkube-script-lib\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.371780 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.288127    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dd0a96e7-6c27-431c-9982-595c92b18d3c-etc-sysconfig\") pod \"tuned-dw8x2\" (UID: \"dd0a96e7-6c27-431c-9982-595c92b18d3c\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.372307 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.288140    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbb7l\" (UniqueName: \"kubernetes.io/projected/48cc1998-ebc5-4702-8b08-027479580e57-kube-api-access-wbb7l\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.372307 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.288167    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e30ba440-b1f4-466d-912e-89c364980c7c-agent-certs\") pod \"konnectivity-agent-j9v7m\" (UID: \"e30ba440-b1f4-466d-912e-89c364980c7c\") " pod="kube-system/konnectivity-agent-j9v7m"
Jul 17 10:52:17.372307 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.288244    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dd0a96e7-6c27-431c-9982-595c92b18d3c-etc-systemd\") pod \"tuned-dw8x2\" (UID: \"dd0a96e7-6c27-431c-9982-595c92b18d3c\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.372307 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.288245    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w48jt\" (UniqueName: \"kubernetes.io/projected/3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d-kube-api-access-w48jt\") pod \"aws-ebs-csi-driver-node-jg467\" (UID: \"3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg467"
Jul 17 10:52:17.372307 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.288279    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dd0a96e7-6c27-431c-9982-595c92b18d3c-etc-sysctl-conf\") pod \"tuned-dw8x2\" (UID: \"dd0a96e7-6c27-431c-9982-595c92b18d3c\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.372307 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.288306    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2be15062-4e09-486c-a294-60039db2b5fe-os-release\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.372307 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.288417    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2be15062-4e09-486c-a294-60039db2b5fe-os-release\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.372307 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.288452    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dd0a96e7-6c27-431c-9982-595c92b18d3c-etc-sysctl-conf\") pod \"tuned-dw8x2\" (UID: \"dd0a96e7-6c27-431c-9982-595c92b18d3c\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.372307 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.289966    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd0a96e7-6c27-431c-9982-595c92b18d3c-tmp\") pod \"tuned-dw8x2\" (UID: \"dd0a96e7-6c27-431c-9982-595c92b18d3c\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.372307 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.290085    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dd0a96e7-6c27-431c-9982-595c92b18d3c-etc-tuned\") pod \"tuned-dw8x2\" (UID: \"dd0a96e7-6c27-431c-9982-595c92b18d3c\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.372307 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.291014    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e30ba440-b1f4-466d-912e-89c364980c7c-agent-certs\") pod \"konnectivity-agent-j9v7m\" (UID: \"e30ba440-b1f4-466d-912e-89c364980c7c\") " pod="kube-system/konnectivity-agent-j9v7m"
Jul 17 10:52:17.372307 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.296192    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ks4l\" (UniqueName: \"kubernetes.io/projected/2be15062-4e09-486c-a294-60039db2b5fe-kube-api-access-8ks4l\") pod \"multus-xkhv5\" (UID: \"2be15062-4e09-486c-a294-60039db2b5fe\") " pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.372307 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.296862    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w48jt\" (UniqueName: \"kubernetes.io/projected/3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d-kube-api-access-w48jt\") pod \"aws-ebs-csi-driver-node-jg467\" (UID: \"3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg467"
Jul 17 10:52:17.372307 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.297300    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jd42\" (UniqueName: \"kubernetes.io/projected/dd0a96e7-6c27-431c-9982-595c92b18d3c-kube-api-access-8jd42\") pod \"tuned-dw8x2\" (UID: \"dd0a96e7-6c27-431c-9982-595c92b18d3c\") " pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.486669 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.388527    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/48cc1998-ebc5-4702-8b08-027479580e57-ovn-node-metrics-cert\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.486669 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.388556    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ms7z\" (UniqueName: \"kubernetes.io/projected/85a21320-4c6f-4b3a-9d2b-3701c891a810-kube-api-access-6ms7z\") pod \"multus-additional-cni-plugins-vkxxl\" (UID: \"85a21320-4c6f-4b3a-9d2b-3701c891a810\") " pod="openshift-multus/multus-additional-cni-plugins-vkxxl"
Jul 17 10:52:17.486669 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.388577    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/85a21320-4c6f-4b3a-9d2b-3701c891a810-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vkxxl\" (UID: \"85a21320-4c6f-4b3a-9d2b-3701c891a810\") " pod="openshift-multus/multus-additional-cni-plugins-vkxxl"
Jul 17 10:52:17.486669 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.388599    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjv4v\" (UniqueName: \"kubernetes.io/projected/a90ca9ac-e3c6-452c-89d5-64d3f4c9b1e9-kube-api-access-sjv4v\") pod \"node-resolver-rsv5j\" (UID: \"a90ca9ac-e3c6-452c-89d5-64d3f4c9b1e9\") " pod="openshift-dns/node-resolver-rsv5j"
Jul 17 10:52:17.486669 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.388624    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-log-socket\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.486669 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.388649    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-host-cni-bin\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.486669 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.388687    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-log-socket\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.486669 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.388717    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-host-cni-bin\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.486669 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.388745    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e0f3591-65a5-481e-a4a0-81f3a07aa904-host-slash\") pod \"iptables-alerter-r6kvv\" (UID: \"3e0f3591-65a5-481e-a4a0-81f3a07aa904\") " pod="openshift-network-operator/iptables-alerter-r6kvv"
Jul 17 10:52:17.486669 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.388773    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-run-systemd\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.486669 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.388929    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-host-run-ovn-kubernetes\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.486669 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.389253    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-run-systemd\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.486669 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.389090    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e0f3591-65a5-481e-a4a0-81f3a07aa904-host-slash\") pod \"iptables-alerter-r6kvv\" (UID: \"3e0f3591-65a5-481e-a4a0-81f3a07aa904\") " pod="openshift-network-operator/iptables-alerter-r6kvv"
Jul 17 10:52:17.486669 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.388798    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-host-run-ovn-kubernetes\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.489173 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.389429    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-host-cni-netd\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.489173 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.389484    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/85a21320-4c6f-4b3a-9d2b-3701c891a810-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vkxxl\" (UID: \"85a21320-4c6f-4b3a-9d2b-3701c891a810\") " pod="openshift-multus/multus-additional-cni-plugins-vkxxl"
Jul 17 10:52:17.489173 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.389511    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8wcn\" (UniqueName: \"kubernetes.io/projected/3e0f3591-65a5-481e-a4a0-81f3a07aa904-kube-api-access-g8wcn\") pod \"iptables-alerter-r6kvv\" (UID: \"3e0f3591-65a5-481e-a4a0-81f3a07aa904\") " pod="openshift-network-operator/iptables-alerter-r6kvv"
Jul 17 10:52:17.489173 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.389530    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-host-cni-netd\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.489173 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.389550    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ca964baf-243f-4cb7-a20e-3c802e627f2c-kubelet-config\") pod \"global-pull-secret-syncer-tw6nz\" (UID: \"ca964baf-243f-4cb7-a20e-3c802e627f2c\") " pod="kube-system/global-pull-secret-syncer-tw6nz"
Jul 17 10:52:17.489173 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.389694    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/85a21320-4c6f-4b3a-9d2b-3701c891a810-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vkxxl\" (UID: \"85a21320-4c6f-4b3a-9d2b-3701c891a810\") " pod="openshift-multus/multus-additional-cni-plugins-vkxxl"
Jul 17 10:52:17.489173 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.389702    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/85a21320-4c6f-4b3a-9d2b-3701c891a810-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vkxxl\" (UID: \"85a21320-4c6f-4b3a-9d2b-3701c891a810\") " pod="openshift-multus/multus-additional-cni-plugins-vkxxl"
Jul 17 10:52:17.489173 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.389749    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9vfq\" (UniqueName: \"kubernetes.io/projected/8037abbc-75d6-42df-9cad-5c1340e0341e-kube-api-access-q9vfq\") pod \"network-metrics-daemon-mdvfl\" (UID: \"8037abbc-75d6-42df-9cad-5c1340e0341e\") " pod="openshift-multus/network-metrics-daemon-mdvfl"
Jul 17 10:52:17.489173 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.389886    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-systemd-units\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.489173 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.389945    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a90ca9ac-e3c6-452c-89d5-64d3f4c9b1e9-hosts-file\") pod \"node-resolver-rsv5j\" (UID: \"a90ca9ac-e3c6-452c-89d5-64d3f4c9b1e9\") " pod="openshift-dns/node-resolver-rsv5j"
Jul 17 10:52:17.489173 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.389966    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ca964baf-243f-4cb7-a20e-3c802e627f2c-kubelet-config\") pod \"global-pull-secret-syncer-tw6nz\" (UID: \"ca964baf-243f-4cb7-a20e-3c802e627f2c\") " pod="kube-system/global-pull-secret-syncer-tw6nz"
Jul 17 10:52:17.489173 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.390015    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a90ca9ac-e3c6-452c-89d5-64d3f4c9b1e9-hosts-file\") pod \"node-resolver-rsv5j\" (UID: \"a90ca9ac-e3c6-452c-89d5-64d3f4c9b1e9\") " pod="openshift-dns/node-resolver-rsv5j"
Jul 17 10:52:17.489173 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.390149    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-host-run-netns\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.489173 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.390194    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/48cc1998-ebc5-4702-8b08-027479580e57-ovnkube-config\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.489853 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.390230    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqvqj\" (UniqueName: \"kubernetes.io/projected/ccf5dfd9-3981-4994-98cc-2edbc2b755b6-kube-api-access-pqvqj\") pod \"network-check-target-t9qnx\" (UID: \"ccf5dfd9-3981-4994-98cc-2edbc2b755b6\") " pod="openshift-network-diagnostics/network-check-target-t9qnx"
Jul 17 10:52:17.489853 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.390234    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-systemd-units\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.489853 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.390263    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-node-log\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.489853 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.390293    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3e0f3591-65a5-481e-a4a0-81f3a07aa904-iptables-alerter-script\") pod \"iptables-alerter-r6kvv\" (UID: \"3e0f3591-65a5-481e-a4a0-81f3a07aa904\") " pod="openshift-network-operator/iptables-alerter-r6kvv"
Jul 17 10:52:17.489853 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.390323    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-run-openvswitch\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.489853 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.390351    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-host-run-netns\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.489853 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.390353    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-var-lib-openvswitch\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.489853 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.390396    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-var-lib-openvswitch\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.489853 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.390405    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/85a21320-4c6f-4b3a-9d2b-3701c891a810-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vkxxl\" (UID: \"85a21320-4c6f-4b3a-9d2b-3701c891a810\") " pod="openshift-multus/multus-additional-cni-plugins-vkxxl"
Jul 17 10:52:17.489853 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.390439    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-run-ovn\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.489853 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.390474    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-node-log\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.489853 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.390488    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/85a21320-4c6f-4b3a-9d2b-3701c891a810-cni-binary-copy\") pod \"multus-additional-cni-plugins-vkxxl\" (UID: \"85a21320-4c6f-4b3a-9d2b-3701c891a810\") " pod="openshift-multus/multus-additional-cni-plugins-vkxxl"
Jul 17 10:52:17.489853 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.390523    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca964baf-243f-4cb7-a20e-3c802e627f2c-original-pull-secret\") pod \"global-pull-secret-syncer-tw6nz\" (UID: \"ca964baf-243f-4cb7-a20e-3c802e627f2c\") " pod="kube-system/global-pull-secret-syncer-tw6nz"
Jul 17 10:52:17.489853 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.390543    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-run-openvswitch\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.491879 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.390558    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/48cc1998-ebc5-4702-8b08-027479580e57-ovnkube-script-lib\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.491879 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.390588    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-run-ovn\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.491879 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.390590    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbb7l\" (UniqueName: \"kubernetes.io/projected/48cc1998-ebc5-4702-8b08-027479580e57-kube-api-access-wbb7l\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.491879 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.390905    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/48cc1998-ebc5-4702-8b08-027479580e57-ovnkube-config\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.491879 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:17.391034    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 10:52:17.491879 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:17.391137    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca964baf-243f-4cb7-a20e-3c802e627f2c-original-pull-secret podName:ca964baf-243f-4cb7-a20e-3c802e627f2c nodeName:}" failed. No retries permitted until 2026-07-17 10:52:17.891103694 +0000 UTC m=+3.072136635 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca964baf-243f-4cb7-a20e-3c802e627f2c-original-pull-secret") pod "global-pull-secret-syncer-tw6nz" (UID: "ca964baf-243f-4cb7-a20e-3c802e627f2c") : object "kube-system"/"original-pull-secret" not registered
Jul 17 10:52:17.491879 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.391735    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/85a21320-4c6f-4b3a-9d2b-3701c891a810-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vkxxl\" (UID: \"85a21320-4c6f-4b3a-9d2b-3701c891a810\") " pod="openshift-multus/multus-additional-cni-plugins-vkxxl"
Jul 17 10:52:17.491879 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.391816    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/85a21320-4c6f-4b3a-9d2b-3701c891a810-cni-binary-copy\") pod \"multus-additional-cni-plugins-vkxxl\" (UID: \"85a21320-4c6f-4b3a-9d2b-3701c891a810\") " pod="openshift-multus/multus-additional-cni-plugins-vkxxl"
Jul 17 10:52:17.491879 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.391870    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85a21320-4c6f-4b3a-9d2b-3701c891a810-system-cni-dir\") pod \"multus-additional-cni-plugins-vkxxl\" (UID: \"85a21320-4c6f-4b3a-9d2b-3701c891a810\") " pod="openshift-multus/multus-additional-cni-plugins-vkxxl"
Jul 17 10:52:17.491879 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.391907    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-host-kubelet\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.491879 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.391941    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-etc-openvswitch\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.491879 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.391972    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5b4b\" (UniqueName: \"kubernetes.io/projected/d1260e44-4d64-4569-b0ce-78f616f8b412-kube-api-access-h5b4b\") pod \"node-ca-bpdts\" (UID: \"d1260e44-4d64-4569-b0ce-78f616f8b412\") " pod="openshift-image-registry/node-ca-bpdts"
Jul 17 10:52:17.491879 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.392002    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/85a21320-4c6f-4b3a-9d2b-3701c891a810-cnibin\") pod \"multus-additional-cni-plugins-vkxxl\" (UID: \"85a21320-4c6f-4b3a-9d2b-3701c891a810\") " pod="openshift-multus/multus-additional-cni-plugins-vkxxl"
Jul 17 10:52:17.491879 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.392032    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ca964baf-243f-4cb7-a20e-3c802e627f2c-dbus\") pod \"global-pull-secret-syncer-tw6nz\" (UID: \"ca964baf-243f-4cb7-a20e-3c802e627f2c\") " pod="kube-system/global-pull-secret-syncer-tw6nz"
Jul 17 10:52:17.492793 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.392060    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a90ca9ac-e3c6-452c-89d5-64d3f4c9b1e9-tmp-dir\") pod \"node-resolver-rsv5j\" (UID: \"a90ca9ac-e3c6-452c-89d5-64d3f4c9b1e9\") " pod="openshift-dns/node-resolver-rsv5j"
Jul 17 10:52:17.492793 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.392089    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-host-slash\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.492793 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.392115    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d1260e44-4d64-4569-b0ce-78f616f8b412-serviceca\") pod \"node-ca-bpdts\" (UID: \"d1260e44-4d64-4569-b0ce-78f616f8b412\") " pod="openshift-image-registry/node-ca-bpdts"
Jul 17 10:52:17.492793 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.392126    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/48cc1998-ebc5-4702-8b08-027479580e57-ovn-node-metrics-cert\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.492793 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.392142    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8037abbc-75d6-42df-9cad-5c1340e0341e-metrics-certs\") pod \"network-metrics-daemon-mdvfl\" (UID: \"8037abbc-75d6-42df-9cad-5c1340e0341e\") " pod="openshift-multus/network-metrics-daemon-mdvfl"
Jul 17 10:52:17.492793 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.392197    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.492793 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.392228    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-etc-openvswitch\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.492793 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.392233    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/48cc1998-ebc5-4702-8b08-027479580e57-ovnkube-script-lib\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.492793 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.392239    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/48cc1998-ebc5-4702-8b08-027479580e57-env-overrides\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.492793 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.392356    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ca964baf-243f-4cb7-a20e-3c802e627f2c-dbus\") pod \"global-pull-secret-syncer-tw6nz\" (UID: \"ca964baf-243f-4cb7-a20e-3c802e627f2c\") " pod="kube-system/global-pull-secret-syncer-tw6nz"
Jul 17 10:52:17.492793 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.392403    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/85a21320-4c6f-4b3a-9d2b-3701c891a810-cnibin\") pod \"multus-additional-cni-plugins-vkxxl\" (UID: \"85a21320-4c6f-4b3a-9d2b-3701c891a810\") " pod="openshift-multus/multus-additional-cni-plugins-vkxxl"
Jul 17 10:52:17.492793 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.392442    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.492793 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.392491    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-host-slash\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.492793 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.392492    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d1260e44-4d64-4569-b0ce-78f616f8b412-host\") pod \"node-ca-bpdts\" (UID: \"d1260e44-4d64-4569-b0ce-78f616f8b412\") " pod="openshift-image-registry/node-ca-bpdts"
Jul 17 10:52:17.492793 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.392547    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/48cc1998-ebc5-4702-8b08-027479580e57-host-kubelet\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.494083 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.392549    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/85a21320-4c6f-4b3a-9d2b-3701c891a810-os-release\") pod \"multus-additional-cni-plugins-vkxxl\" (UID: \"85a21320-4c6f-4b3a-9d2b-3701c891a810\") " pod="openshift-multus/multus-additional-cni-plugins-vkxxl"
Jul 17 10:52:17.494083 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.392614    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/85a21320-4c6f-4b3a-9d2b-3701c891a810-os-release\") pod \"multus-additional-cni-plugins-vkxxl\" (UID: \"85a21320-4c6f-4b3a-9d2b-3701c891a810\") " pod="openshift-multus/multus-additional-cni-plugins-vkxxl"
Jul 17 10:52:17.494083 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:17.392657    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 10:52:17.494083 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:17.392715    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8037abbc-75d6-42df-9cad-5c1340e0341e-metrics-certs podName:8037abbc-75d6-42df-9cad-5c1340e0341e nodeName:}" failed. No retries permitted until 2026-07-17 10:52:17.892699562 +0000 UTC m=+3.073732506 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8037abbc-75d6-42df-9cad-5c1340e0341e-metrics-certs") pod "network-metrics-daemon-mdvfl" (UID: "8037abbc-75d6-42df-9cad-5c1340e0341e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 10:52:17.494083 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.392712    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/48cc1998-ebc5-4702-8b08-027479580e57-env-overrides\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.494083 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.392760    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85a21320-4c6f-4b3a-9d2b-3701c891a810-system-cni-dir\") pod \"multus-additional-cni-plugins-vkxxl\" (UID: \"85a21320-4c6f-4b3a-9d2b-3701c891a810\") " pod="openshift-multus/multus-additional-cni-plugins-vkxxl"
Jul 17 10:52:17.494083 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.392807    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d1260e44-4d64-4569-b0ce-78f616f8b412-host\") pod \"node-ca-bpdts\" (UID: \"d1260e44-4d64-4569-b0ce-78f616f8b412\") " pod="openshift-image-registry/node-ca-bpdts"
Jul 17 10:52:17.494083 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.392992    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a90ca9ac-e3c6-452c-89d5-64d3f4c9b1e9-tmp-dir\") pod \"node-resolver-rsv5j\" (UID: \"a90ca9ac-e3c6-452c-89d5-64d3f4c9b1e9\") " pod="openshift-dns/node-resolver-rsv5j"
Jul 17 10:52:17.494083 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.393026    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d1260e44-4d64-4569-b0ce-78f616f8b412-serviceca\") pod \"node-ca-bpdts\" (UID: \"d1260e44-4d64-4569-b0ce-78f616f8b412\") " pod="openshift-image-registry/node-ca-bpdts"
Jul 17 10:52:17.494083 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.393905    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3e0f3591-65a5-481e-a4a0-81f3a07aa904-iptables-alerter-script\") pod \"iptables-alerter-r6kvv\" (UID: \"3e0f3591-65a5-481e-a4a0-81f3a07aa904\") " pod="openshift-network-operator/iptables-alerter-r6kvv"
Jul 17 10:52:17.494083 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.398688    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ms7z\" (UniqueName: \"kubernetes.io/projected/85a21320-4c6f-4b3a-9d2b-3701c891a810-kube-api-access-6ms7z\") pod \"multus-additional-cni-plugins-vkxxl\" (UID: \"85a21320-4c6f-4b3a-9d2b-3701c891a810\") " pod="openshift-multus/multus-additional-cni-plugins-vkxxl"
Jul 17 10:52:17.494083 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.400678    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjv4v\" (UniqueName: \"kubernetes.io/projected/a90ca9ac-e3c6-452c-89d5-64d3f4c9b1e9-kube-api-access-sjv4v\") pod \"node-resolver-rsv5j\" (UID: \"a90ca9ac-e3c6-452c-89d5-64d3f4c9b1e9\") " pod="openshift-dns/node-resolver-rsv5j"
Jul 17 10:52:17.494083 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.401927    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8wcn\" (UniqueName: \"kubernetes.io/projected/3e0f3591-65a5-481e-a4a0-81f3a07aa904-kube-api-access-g8wcn\") pod \"iptables-alerter-r6kvv\" (UID: \"3e0f3591-65a5-481e-a4a0-81f3a07aa904\") " pod="openshift-network-operator/iptables-alerter-r6kvv"
Jul 17 10:52:17.494083 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:17.402960    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 10:52:17.494083 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:17.402977    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 10:52:17.495048 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:17.402991    2563 projected.go:196] Error preparing data for projected volume kube-api-access-pqvqj for pod openshift-network-diagnostics/network-check-target-t9qnx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 10:52:17.495048 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:17.403059    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ccf5dfd9-3981-4994-98cc-2edbc2b755b6-kube-api-access-pqvqj podName:ccf5dfd9-3981-4994-98cc-2edbc2b755b6 nodeName:}" failed. No retries permitted until 2026-07-17 10:52:17.90304464 +0000 UTC m=+3.084077601 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pqvqj" (UniqueName: "kubernetes.io/projected/ccf5dfd9-3981-4994-98cc-2edbc2b755b6-kube-api-access-pqvqj") pod "network-check-target-t9qnx" (UID: "ccf5dfd9-3981-4994-98cc-2edbc2b755b6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 10:52:17.495048 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.403220    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9vfq\" (UniqueName: \"kubernetes.io/projected/8037abbc-75d6-42df-9cad-5c1340e0341e-kube-api-access-q9vfq\") pod \"network-metrics-daemon-mdvfl\" (UID: \"8037abbc-75d6-42df-9cad-5c1340e0341e\") " pod="openshift-multus/network-metrics-daemon-mdvfl"
Jul 17 10:52:17.495048 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.405275    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5b4b\" (UniqueName: \"kubernetes.io/projected/d1260e44-4d64-4569-b0ce-78f616f8b412-kube-api-access-h5b4b\") pod \"node-ca-bpdts\" (UID: \"d1260e44-4d64-4569-b0ce-78f616f8b412\") " pod="openshift-image-registry/node-ca-bpdts"
Jul 17 10:52:17.495048 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.405523    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbb7l\" (UniqueName: \"kubernetes.io/projected/48cc1998-ebc5-4702-8b08-027479580e57-kube-api-access-wbb7l\") pod \"ovnkube-node-xdrhl\" (UID: \"48cc1998-ebc5-4702-8b08-027479580e57\") " pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.495048 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.481728    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg467"
Jul 17 10:52:17.495048 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.483844    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j9v7m"
Jul 17 10:52:17.495048 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.493113    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dw8x2"
Jul 17 10:52:17.495929 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.495707    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xkhv5"
Jul 17 10:52:17.643312 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.503492    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rsv5j"
Jul 17 10:52:17.643312 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.510023    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bpdts"
Jul 17 10:52:17.643312 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.517913    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vkxxl"
Jul 17 10:52:17.643312 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.530686    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r6kvv"
Jul 17 10:52:17.643312 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.538583    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:17.743888 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:17.731946    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda90ca9ac_e3c6_452c_89d5_64d3f4c9b1e9.slice/crio-185fa00ba87ad50379c868802b9d30f40b3225074b8e34455363820d6bb0c263 WatchSource:0}: Error finding container 185fa00ba87ad50379c868802b9d30f40b3225074b8e34455363820d6bb0c263: Status 404 returned error can't find the container with id 185fa00ba87ad50379c868802b9d30f40b3225074b8e34455363820d6bb0c263
Jul 17 10:52:17.743888 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:17.735963    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85a21320_4c6f_4b3a_9d2b_3701c891a810.slice/crio-fa25ee294472e7bc153419918903ea8943191f63d12b4c0d222f7cf1e680dd7b WatchSource:0}: Error finding container fa25ee294472e7bc153419918903ea8943191f63d12b4c0d222f7cf1e680dd7b: Status 404 returned error can't find the container with id fa25ee294472e7bc153419918903ea8943191f63d12b4c0d222f7cf1e680dd7b
Jul 17 10:52:17.743888 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:17.737656    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48cc1998_ebc5_4702_8b08_027479580e57.slice/crio-7c4710d34fe68a95d8da59b1dd8dec9dea232ea849f9592b30ce24089a993f25 WatchSource:0}: Error finding container 7c4710d34fe68a95d8da59b1dd8dec9dea232ea849f9592b30ce24089a993f25: Status 404 returned error can't find the container with id 7c4710d34fe68a95d8da59b1dd8dec9dea232ea849f9592b30ce24089a993f25
Jul 17 10:52:17.743888 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:17.738602    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e0f3591_65a5_481e_a4a0_81f3a07aa904.slice/crio-8b914eed33b1a7a1c29ef05500949adb0c0a4a571bc7d8dde1773b8f72e8d10b WatchSource:0}: Error finding container 8b914eed33b1a7a1c29ef05500949adb0c0a4a571bc7d8dde1773b8f72e8d10b: Status 404 returned error can't find the container with id 8b914eed33b1a7a1c29ef05500949adb0c0a4a571bc7d8dde1773b8f72e8d10b
Jul 17 10:52:17.743888 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:17.741141    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode30ba440_b1f4_466d_912e_89c364980c7c.slice/crio-1e30700fbd6a8077b12da4cc095ea8e6d413fd3fa18040f371cee95d6f556d7a WatchSource:0}: Error finding container 1e30700fbd6a8077b12da4cc095ea8e6d413fd3fa18040f371cee95d6f556d7a: Status 404 returned error can't find the container with id 1e30700fbd6a8077b12da4cc095ea8e6d413fd3fa18040f371cee95d6f556d7a
Jul 17 10:52:17.743888 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:17.741601    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1260e44_4d64_4569_b0ce_78f616f8b412.slice/crio-22b40167bdefba9daa27352bc732f7cb7a7e7c67452f7bf0d4ca7b997d1d206c WatchSource:0}: Error finding container 22b40167bdefba9daa27352bc732f7cb7a7e7c67452f7bf0d4ca7b997d1d206c: Status 404 returned error can't find the container with id 22b40167bdefba9daa27352bc732f7cb7a7e7c67452f7bf0d4ca7b997d1d206c
Jul 17 10:52:17.744665 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:17.744521    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2be15062_4e09_486c_a294_60039db2b5fe.slice/crio-abecd3dd6267ebea93a5e1a4495a741927ac1e430904281b270e97e3dee30f78 WatchSource:0}: Error finding container abecd3dd6267ebea93a5e1a4495a741927ac1e430904281b270e97e3dee30f78: Status 404 returned error can't find the container with id abecd3dd6267ebea93a5e1a4495a741927ac1e430904281b270e97e3dee30f78
Jul 17 10:52:17.875849 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:17.747363    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f6bbb0f_1d4c_43cb_bda0_9e5d3387153d.slice/crio-246e2717fffc2ac79b4ba95d42f4e28867bbfa2f85f93600da223fea243d6bdf WatchSource:0}: Error finding container 246e2717fffc2ac79b4ba95d42f4e28867bbfa2f85f93600da223fea243d6bdf: Status 404 returned error can't find the container with id 246e2717fffc2ac79b4ba95d42f4e28867bbfa2f85f93600da223fea243d6bdf
Jul 17 10:52:17.875849 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:17.747866    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd0a96e7_6c27_431c_9982_595c92b18d3c.slice/crio-84cbaef8e4f32b4ef5c86b59cda1681bdb49fae17ff24dac092b7137a37c8eb1 WatchSource:0}: Error finding container 84cbaef8e4f32b4ef5c86b59cda1681bdb49fae17ff24dac092b7137a37c8eb1: Status 404 returned error can't find the container with id 84cbaef8e4f32b4ef5c86b59cda1681bdb49fae17ff24dac092b7137a37c8eb1
Jul 17 10:52:17.896445 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.896419    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca964baf-243f-4cb7-a20e-3c802e627f2c-original-pull-secret\") pod \"global-pull-secret-syncer-tw6nz\" (UID: \"ca964baf-243f-4cb7-a20e-3c802e627f2c\") " pod="kube-system/global-pull-secret-syncer-tw6nz"
Jul 17 10:52:17.897088 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.896472    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8037abbc-75d6-42df-9cad-5c1340e0341e-metrics-certs\") pod \"network-metrics-daemon-mdvfl\" (UID: \"8037abbc-75d6-42df-9cad-5c1340e0341e\") " pod="openshift-multus/network-metrics-daemon-mdvfl"
Jul 17 10:52:17.897088 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:17.896610    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 10:52:17.897088 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:17.896649    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 10:52:17.897088 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:17.896681    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca964baf-243f-4cb7-a20e-3c802e627f2c-original-pull-secret podName:ca964baf-243f-4cb7-a20e-3c802e627f2c nodeName:}" failed. No retries permitted until 2026-07-17 10:52:18.89665989 +0000 UTC m=+4.077692837 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca964baf-243f-4cb7-a20e-3c802e627f2c-original-pull-secret") pod "global-pull-secret-syncer-tw6nz" (UID: "ca964baf-243f-4cb7-a20e-3c802e627f2c") : object "kube-system"/"original-pull-secret" not registered
Jul 17 10:52:17.897088 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:17.896701    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8037abbc-75d6-42df-9cad-5c1340e0341e-metrics-certs podName:8037abbc-75d6-42df-9cad-5c1340e0341e nodeName:}" failed. No retries permitted until 2026-07-17 10:52:18.89669137 +0000 UTC m=+4.077724314 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8037abbc-75d6-42df-9cad-5c1340e0341e-metrics-certs") pod "network-metrics-daemon-mdvfl" (UID: "8037abbc-75d6-42df-9cad-5c1340e0341e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 10:52:17.996827 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:17.996765    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqvqj\" (UniqueName: \"kubernetes.io/projected/ccf5dfd9-3981-4994-98cc-2edbc2b755b6-kube-api-access-pqvqj\") pod \"network-check-target-t9qnx\" (UID: \"ccf5dfd9-3981-4994-98cc-2edbc2b755b6\") " pod="openshift-network-diagnostics/network-check-target-t9qnx"
Jul 17 10:52:17.996938 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:17.996926    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 10:52:17.997005 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:17.996941    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 10:52:17.997005 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:17.996951    2563 projected.go:196] Error preparing data for projected volume kube-api-access-pqvqj for pod openshift-network-diagnostics/network-check-target-t9qnx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 10:52:17.997110 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:17.997015    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ccf5dfd9-3981-4994-98cc-2edbc2b755b6-kube-api-access-pqvqj podName:ccf5dfd9-3981-4994-98cc-2edbc2b755b6 nodeName:}" failed. No retries permitted until 2026-07-17 10:52:18.99700112 +0000 UTC m=+4.178034061 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pqvqj" (UniqueName: "kubernetes.io/projected/ccf5dfd9-3981-4994-98cc-2edbc2b755b6-kube-api-access-pqvqj") pod "network-check-target-t9qnx" (UID: "ccf5dfd9-3981-4994-98cc-2edbc2b755b6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 10:52:18.224552 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:18.224490    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 10:47:17 +0000 UTC" deadline="2028-01-12 14:21:33.615508253 +0000 UTC"
Jul 17 10:52:18.224552 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:18.224551    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13059h29m15.390961183s"
Jul 17 10:52:18.259114 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:18.259054    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdvfl"
Jul 17 10:52:18.259238 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:18.259187    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdvfl" podUID="8037abbc-75d6-42df-9cad-5c1340e0341e"
Jul 17 10:52:18.276377 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:18.276342    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vkxxl" event={"ID":"85a21320-4c6f-4b3a-9d2b-3701c891a810","Type":"ContainerStarted","Data":"fa25ee294472e7bc153419918903ea8943191f63d12b4c0d222f7cf1e680dd7b"}
Jul 17 10:52:18.281645 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:18.281607    2563 generic.go:356] "Generic (PLEG): container finished" podID="8156c76681f600ec67b24c4f53df05a0" containerID="121095c8d819d7425c04bc0a9cfd36abc4c1308dbf77a7b2c117cc913524019d" exitCode=0
Jul 17 10:52:18.281742 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:18.281697    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-12.ec2.internal" event={"ID":"8156c76681f600ec67b24c4f53df05a0","Type":"ContainerDied","Data":"121095c8d819d7425c04bc0a9cfd36abc4c1308dbf77a7b2c117cc913524019d"}
Jul 17 10:52:18.294686 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:18.294529    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bpdts" event={"ID":"d1260e44-4d64-4569-b0ce-78f616f8b412","Type":"ContainerStarted","Data":"22b40167bdefba9daa27352bc732f7cb7a7e7c67452f7bf0d4ca7b997d1d206c"}
Jul 17 10:52:18.298783 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:18.298719    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j9v7m" event={"ID":"e30ba440-b1f4-466d-912e-89c364980c7c","Type":"ContainerStarted","Data":"1e30700fbd6a8077b12da4cc095ea8e6d413fd3fa18040f371cee95d6f556d7a"}
Jul 17 10:52:18.308149 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:18.308084    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r6kvv" event={"ID":"3e0f3591-65a5-481e-a4a0-81f3a07aa904","Type":"ContainerStarted","Data":"8b914eed33b1a7a1c29ef05500949adb0c0a4a571bc7d8dde1773b8f72e8d10b"}
Jul 17 10:52:18.334871 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:18.334750    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl" event={"ID":"48cc1998-ebc5-4702-8b08-027479580e57","Type":"ContainerStarted","Data":"7c4710d34fe68a95d8da59b1dd8dec9dea232ea849f9592b30ce24089a993f25"}
Jul 17 10:52:18.344523 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:18.344463    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rsv5j" event={"ID":"a90ca9ac-e3c6-452c-89d5-64d3f4c9b1e9","Type":"ContainerStarted","Data":"185fa00ba87ad50379c868802b9d30f40b3225074b8e34455363820d6bb0c263"}
Jul 17 10:52:18.352447 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:18.352383    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dw8x2" event={"ID":"dd0a96e7-6c27-431c-9982-595c92b18d3c","Type":"ContainerStarted","Data":"84cbaef8e4f32b4ef5c86b59cda1681bdb49fae17ff24dac092b7137a37c8eb1"}
Jul 17 10:52:18.358528 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:18.358497    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg467" event={"ID":"3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d","Type":"ContainerStarted","Data":"246e2717fffc2ac79b4ba95d42f4e28867bbfa2f85f93600da223fea243d6bdf"}
Jul 17 10:52:18.363195 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:18.363170    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xkhv5" event={"ID":"2be15062-4e09-486c-a294-60039db2b5fe","Type":"ContainerStarted","Data":"abecd3dd6267ebea93a5e1a4495a741927ac1e430904281b270e97e3dee30f78"}
Jul 17 10:52:18.904606 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:18.903853    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca964baf-243f-4cb7-a20e-3c802e627f2c-original-pull-secret\") pod \"global-pull-secret-syncer-tw6nz\" (UID: \"ca964baf-243f-4cb7-a20e-3c802e627f2c\") " pod="kube-system/global-pull-secret-syncer-tw6nz"
Jul 17 10:52:18.904606 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:18.904156    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 10:52:18.904606 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:18.904169    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8037abbc-75d6-42df-9cad-5c1340e0341e-metrics-certs\") pod \"network-metrics-daemon-mdvfl\" (UID: \"8037abbc-75d6-42df-9cad-5c1340e0341e\") " pod="openshift-multus/network-metrics-daemon-mdvfl"
Jul 17 10:52:18.904606 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:18.904229    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca964baf-243f-4cb7-a20e-3c802e627f2c-original-pull-secret podName:ca964baf-243f-4cb7-a20e-3c802e627f2c nodeName:}" failed. No retries permitted until 2026-07-17 10:52:20.90420768 +0000 UTC m=+6.085240630 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca964baf-243f-4cb7-a20e-3c802e627f2c-original-pull-secret") pod "global-pull-secret-syncer-tw6nz" (UID: "ca964baf-243f-4cb7-a20e-3c802e627f2c") : object "kube-system"/"original-pull-secret" not registered
Jul 17 10:52:18.904606 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:18.904296    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 10:52:18.904606 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:18.904347    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8037abbc-75d6-42df-9cad-5c1340e0341e-metrics-certs podName:8037abbc-75d6-42df-9cad-5c1340e0341e nodeName:}" failed. No retries permitted until 2026-07-17 10:52:20.904330872 +0000 UTC m=+6.085363820 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8037abbc-75d6-42df-9cad-5c1340e0341e-metrics-certs") pod "network-metrics-daemon-mdvfl" (UID: "8037abbc-75d6-42df-9cad-5c1340e0341e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 10:52:19.005632 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:19.005601    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqvqj\" (UniqueName: \"kubernetes.io/projected/ccf5dfd9-3981-4994-98cc-2edbc2b755b6-kube-api-access-pqvqj\") pod \"network-check-target-t9qnx\" (UID: \"ccf5dfd9-3981-4994-98cc-2edbc2b755b6\") " pod="openshift-network-diagnostics/network-check-target-t9qnx"
Jul 17 10:52:19.005806 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:19.005790    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 10:52:19.005874 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:19.005813    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 10:52:19.005874 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:19.005826    2563 projected.go:196] Error preparing data for projected volume kube-api-access-pqvqj for pod openshift-network-diagnostics/network-check-target-t9qnx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 10:52:19.005970 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:19.005879    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ccf5dfd9-3981-4994-98cc-2edbc2b755b6-kube-api-access-pqvqj podName:ccf5dfd9-3981-4994-98cc-2edbc2b755b6 nodeName:}" failed. No retries permitted until 2026-07-17 10:52:21.005861612 +0000 UTC m=+6.186894557 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pqvqj" (UniqueName: "kubernetes.io/projected/ccf5dfd9-3981-4994-98cc-2edbc2b755b6-kube-api-access-pqvqj") pod "network-check-target-t9qnx" (UID: "ccf5dfd9-3981-4994-98cc-2edbc2b755b6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 10:52:19.225666 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:19.225577    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 10:47:17 +0000 UTC" deadline="2028-02-08 20:18:41.825160134 +0000 UTC"
Jul 17 10:52:19.225666 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:19.225614    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13713h26m22.599549536s"
Jul 17 10:52:19.261865 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:19.261834    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9qnx"
Jul 17 10:52:19.262009 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:19.261957    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9qnx" podUID="ccf5dfd9-3981-4994-98cc-2edbc2b755b6"
Jul 17 10:52:19.262400 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:19.262379    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tw6nz"
Jul 17 10:52:19.262531 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:19.262486    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tw6nz" podUID="ca964baf-243f-4cb7-a20e-3c802e627f2c"
Jul 17 10:52:19.372059 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:19.372020    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-12.ec2.internal" event={"ID":"8156c76681f600ec67b24c4f53df05a0","Type":"ContainerStarted","Data":"0dc1f7229c2c8fe99c6bb8d0e82c1487b96fd6ccd8ede46000e4466666533f63"}
Jul 17 10:52:19.393901 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:19.393739    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-12.ec2.internal" podStartSLOduration=3.393721206 podStartE2EDuration="3.393721206s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:52:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:52:19.392745956 +0000 UTC m=+4.573778950" watchObservedRunningTime="2026-07-17 10:52:19.393721206 +0000 UTC m=+4.574754172"
Jul 17 10:52:20.258966 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:20.258933    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdvfl"
Jul 17 10:52:20.259417 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:20.259074    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdvfl" podUID="8037abbc-75d6-42df-9cad-5c1340e0341e"
Jul 17 10:52:20.921357 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:20.921316    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca964baf-243f-4cb7-a20e-3c802e627f2c-original-pull-secret\") pod \"global-pull-secret-syncer-tw6nz\" (UID: \"ca964baf-243f-4cb7-a20e-3c802e627f2c\") " pod="kube-system/global-pull-secret-syncer-tw6nz"
Jul 17 10:52:20.921536 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:20.921382    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8037abbc-75d6-42df-9cad-5c1340e0341e-metrics-certs\") pod \"network-metrics-daemon-mdvfl\" (UID: \"8037abbc-75d6-42df-9cad-5c1340e0341e\") " pod="openshift-multus/network-metrics-daemon-mdvfl"
Jul 17 10:52:20.921612 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:20.921555    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 10:52:20.921668 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:20.921621    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8037abbc-75d6-42df-9cad-5c1340e0341e-metrics-certs podName:8037abbc-75d6-42df-9cad-5c1340e0341e nodeName:}" failed. No retries permitted until 2026-07-17 10:52:24.921600756 +0000 UTC m=+10.102633716 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8037abbc-75d6-42df-9cad-5c1340e0341e-metrics-certs") pod "network-metrics-daemon-mdvfl" (UID: "8037abbc-75d6-42df-9cad-5c1340e0341e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 10:52:20.922055 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:20.922035    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 10:52:20.922140 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:20.922095    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca964baf-243f-4cb7-a20e-3c802e627f2c-original-pull-secret podName:ca964baf-243f-4cb7-a20e-3c802e627f2c nodeName:}" failed. No retries permitted until 2026-07-17 10:52:24.922078475 +0000 UTC m=+10.103111420 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca964baf-243f-4cb7-a20e-3c802e627f2c-original-pull-secret") pod "global-pull-secret-syncer-tw6nz" (UID: "ca964baf-243f-4cb7-a20e-3c802e627f2c") : object "kube-system"/"original-pull-secret" not registered
Jul 17 10:52:21.022496 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:21.022411    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqvqj\" (UniqueName: \"kubernetes.io/projected/ccf5dfd9-3981-4994-98cc-2edbc2b755b6-kube-api-access-pqvqj\") pod \"network-check-target-t9qnx\" (UID: \"ccf5dfd9-3981-4994-98cc-2edbc2b755b6\") " pod="openshift-network-diagnostics/network-check-target-t9qnx"
Jul 17 10:52:21.022713 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:21.022666    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 10:52:21.022713 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:21.022686    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 10:52:21.022713 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:21.022698    2563 projected.go:196] Error preparing data for projected volume kube-api-access-pqvqj for pod openshift-network-diagnostics/network-check-target-t9qnx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 10:52:21.022897 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:21.022753    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ccf5dfd9-3981-4994-98cc-2edbc2b755b6-kube-api-access-pqvqj podName:ccf5dfd9-3981-4994-98cc-2edbc2b755b6 nodeName:}" failed. No retries permitted until 2026-07-17 10:52:25.022735808 +0000 UTC m=+10.203768754 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pqvqj" (UniqueName: "kubernetes.io/projected/ccf5dfd9-3981-4994-98cc-2edbc2b755b6-kube-api-access-pqvqj") pod "network-check-target-t9qnx" (UID: "ccf5dfd9-3981-4994-98cc-2edbc2b755b6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 10:52:21.261365 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:21.261328    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9qnx"
Jul 17 10:52:21.261832 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:21.261463    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9qnx" podUID="ccf5dfd9-3981-4994-98cc-2edbc2b755b6"
Jul 17 10:52:21.261832 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:21.261537    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tw6nz"
Jul 17 10:52:21.261832 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:21.261656    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tw6nz" podUID="ca964baf-243f-4cb7-a20e-3c802e627f2c"
Jul 17 10:52:22.258977 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:22.258922    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdvfl"
Jul 17 10:52:22.259173 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:22.259075    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdvfl" podUID="8037abbc-75d6-42df-9cad-5c1340e0341e"
Jul 17 10:52:23.260257 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:23.259740    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9qnx"
Jul 17 10:52:23.260257 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:23.259875    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9qnx" podUID="ccf5dfd9-3981-4994-98cc-2edbc2b755b6"
Jul 17 10:52:23.261101 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:23.260519    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tw6nz"
Jul 17 10:52:23.261101 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:23.260636    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tw6nz" podUID="ca964baf-243f-4cb7-a20e-3c802e627f2c"
Jul 17 10:52:24.259759 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:24.259682    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdvfl"
Jul 17 10:52:24.259922 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:24.259829    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdvfl" podUID="8037abbc-75d6-42df-9cad-5c1340e0341e"
Jul 17 10:52:24.958029 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:24.957986    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca964baf-243f-4cb7-a20e-3c802e627f2c-original-pull-secret\") pod \"global-pull-secret-syncer-tw6nz\" (UID: \"ca964baf-243f-4cb7-a20e-3c802e627f2c\") " pod="kube-system/global-pull-secret-syncer-tw6nz"
Jul 17 10:52:24.958529 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:24.958040    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8037abbc-75d6-42df-9cad-5c1340e0341e-metrics-certs\") pod \"network-metrics-daemon-mdvfl\" (UID: \"8037abbc-75d6-42df-9cad-5c1340e0341e\") " pod="openshift-multus/network-metrics-daemon-mdvfl"
Jul 17 10:52:24.958529 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:24.958182    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 10:52:24.958529 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:24.958242    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8037abbc-75d6-42df-9cad-5c1340e0341e-metrics-certs podName:8037abbc-75d6-42df-9cad-5c1340e0341e nodeName:}" failed. No retries permitted until 2026-07-17 10:52:32.95822377 +0000 UTC m=+18.139256712 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8037abbc-75d6-42df-9cad-5c1340e0341e-metrics-certs") pod "network-metrics-daemon-mdvfl" (UID: "8037abbc-75d6-42df-9cad-5c1340e0341e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 10:52:24.958742 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:24.958674    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 10:52:24.958742 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:24.958731    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca964baf-243f-4cb7-a20e-3c802e627f2c-original-pull-secret podName:ca964baf-243f-4cb7-a20e-3c802e627f2c nodeName:}" failed. No retries permitted until 2026-07-17 10:52:32.958714823 +0000 UTC m=+18.139747783 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca964baf-243f-4cb7-a20e-3c802e627f2c-original-pull-secret") pod "global-pull-secret-syncer-tw6nz" (UID: "ca964baf-243f-4cb7-a20e-3c802e627f2c") : object "kube-system"/"original-pull-secret" not registered
Jul 17 10:52:25.058515 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:25.058478    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqvqj\" (UniqueName: \"kubernetes.io/projected/ccf5dfd9-3981-4994-98cc-2edbc2b755b6-kube-api-access-pqvqj\") pod \"network-check-target-t9qnx\" (UID: \"ccf5dfd9-3981-4994-98cc-2edbc2b755b6\") " pod="openshift-network-diagnostics/network-check-target-t9qnx"
Jul 17 10:52:25.059087 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:25.058660    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 10:52:25.059087 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:25.058689    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 10:52:25.059087 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:25.058703    2563 projected.go:196] Error preparing data for projected volume kube-api-access-pqvqj for pod openshift-network-diagnostics/network-check-target-t9qnx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 10:52:25.059087 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:25.058762    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ccf5dfd9-3981-4994-98cc-2edbc2b755b6-kube-api-access-pqvqj podName:ccf5dfd9-3981-4994-98cc-2edbc2b755b6 nodeName:}" failed. No retries permitted until 2026-07-17 10:52:33.058742818 +0000 UTC m=+18.239775784 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pqvqj" (UniqueName: "kubernetes.io/projected/ccf5dfd9-3981-4994-98cc-2edbc2b755b6-kube-api-access-pqvqj") pod "network-check-target-t9qnx" (UID: "ccf5dfd9-3981-4994-98cc-2edbc2b755b6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 10:52:25.259766 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:25.259689    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9qnx"
Jul 17 10:52:25.259944 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:25.259816    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9qnx" podUID="ccf5dfd9-3981-4994-98cc-2edbc2b755b6"
Jul 17 10:52:25.261097 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:25.261063    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tw6nz"
Jul 17 10:52:25.261230 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:25.261165    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tw6nz" podUID="ca964baf-243f-4cb7-a20e-3c802e627f2c"
Jul 17 10:52:26.259891 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:26.259664    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdvfl"
Jul 17 10:52:26.259891 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:26.259802    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdvfl" podUID="8037abbc-75d6-42df-9cad-5c1340e0341e"
Jul 17 10:52:27.259560 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:27.259340    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9qnx"
Jul 17 10:52:27.259560 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:27.259460    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9qnx" podUID="ccf5dfd9-3981-4994-98cc-2edbc2b755b6"
Jul 17 10:52:27.259560 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:27.259500    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tw6nz"
Jul 17 10:52:27.259841 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:27.259661    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tw6nz" podUID="ca964baf-243f-4cb7-a20e-3c802e627f2c"
Jul 17 10:52:28.259684 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:28.259652    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdvfl"
Jul 17 10:52:28.260098 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:28.259793    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdvfl" podUID="8037abbc-75d6-42df-9cad-5c1340e0341e"
Jul 17 10:52:29.259417 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:29.259372    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tw6nz"
Jul 17 10:52:29.259501 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:29.259377    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9qnx"
Jul 17 10:52:29.259501 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:29.259473    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tw6nz" podUID="ca964baf-243f-4cb7-a20e-3c802e627f2c"
Jul 17 10:52:29.259576 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:29.259529    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9qnx" podUID="ccf5dfd9-3981-4994-98cc-2edbc2b755b6"
Jul 17 10:52:30.258896 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:30.258862    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdvfl"
Jul 17 10:52:30.259271 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:30.258975    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdvfl" podUID="8037abbc-75d6-42df-9cad-5c1340e0341e"
Jul 17 10:52:31.259157 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:31.259089    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tw6nz"
Jul 17 10:52:31.259157 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:31.259107    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9qnx"
Jul 17 10:52:31.259669 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:31.259215    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tw6nz" podUID="ca964baf-243f-4cb7-a20e-3c802e627f2c"
Jul 17 10:52:31.259669 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:31.259349    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9qnx" podUID="ccf5dfd9-3981-4994-98cc-2edbc2b755b6"
Jul 17 10:52:32.259586 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:32.259553    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdvfl"
Jul 17 10:52:32.260049 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:32.259675    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdvfl" podUID="8037abbc-75d6-42df-9cad-5c1340e0341e"
Jul 17 10:52:33.023963 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:33.023932    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8037abbc-75d6-42df-9cad-5c1340e0341e-metrics-certs\") pod \"network-metrics-daemon-mdvfl\" (UID: \"8037abbc-75d6-42df-9cad-5c1340e0341e\") " pod="openshift-multus/network-metrics-daemon-mdvfl"
Jul 17 10:52:33.024113 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:33.023994    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca964baf-243f-4cb7-a20e-3c802e627f2c-original-pull-secret\") pod \"global-pull-secret-syncer-tw6nz\" (UID: \"ca964baf-243f-4cb7-a20e-3c802e627f2c\") " pod="kube-system/global-pull-secret-syncer-tw6nz"
Jul 17 10:52:33.024113 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:33.024091    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 10:52:33.024113 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:33.024103    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 10:52:33.024249 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:33.024139    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca964baf-243f-4cb7-a20e-3c802e627f2c-original-pull-secret podName:ca964baf-243f-4cb7-a20e-3c802e627f2c nodeName:}" failed. No retries permitted until 2026-07-17 10:52:49.024127059 +0000 UTC m=+34.205159999 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca964baf-243f-4cb7-a20e-3c802e627f2c-original-pull-secret") pod "global-pull-secret-syncer-tw6nz" (UID: "ca964baf-243f-4cb7-a20e-3c802e627f2c") : object "kube-system"/"original-pull-secret" not registered
Jul 17 10:52:33.024249 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:33.024166    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8037abbc-75d6-42df-9cad-5c1340e0341e-metrics-certs podName:8037abbc-75d6-42df-9cad-5c1340e0341e nodeName:}" failed. No retries permitted until 2026-07-17 10:52:49.024148289 +0000 UTC m=+34.205181246 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8037abbc-75d6-42df-9cad-5c1340e0341e-metrics-certs") pod "network-metrics-daemon-mdvfl" (UID: "8037abbc-75d6-42df-9cad-5c1340e0341e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 10:52:33.124509 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:33.124476    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqvqj\" (UniqueName: \"kubernetes.io/projected/ccf5dfd9-3981-4994-98cc-2edbc2b755b6-kube-api-access-pqvqj\") pod \"network-check-target-t9qnx\" (UID: \"ccf5dfd9-3981-4994-98cc-2edbc2b755b6\") " pod="openshift-network-diagnostics/network-check-target-t9qnx"
Jul 17 10:52:33.124660 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:33.124641    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 10:52:33.124709 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:33.124665    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 10:52:33.124709 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:33.124675    2563 projected.go:196] Error preparing data for projected volume kube-api-access-pqvqj for pod openshift-network-diagnostics/network-check-target-t9qnx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 10:52:33.124788 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:33.124729    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ccf5dfd9-3981-4994-98cc-2edbc2b755b6-kube-api-access-pqvqj podName:ccf5dfd9-3981-4994-98cc-2edbc2b755b6 nodeName:}" failed. No retries permitted until 2026-07-17 10:52:49.124711301 +0000 UTC m=+34.305744259 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pqvqj" (UniqueName: "kubernetes.io/projected/ccf5dfd9-3981-4994-98cc-2edbc2b755b6-kube-api-access-pqvqj") pod "network-check-target-t9qnx" (UID: "ccf5dfd9-3981-4994-98cc-2edbc2b755b6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 10:52:33.258971 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:33.258948    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tw6nz"
Jul 17 10:52:33.259139 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:33.259061    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tw6nz" podUID="ca964baf-243f-4cb7-a20e-3c802e627f2c"
Jul 17 10:52:33.259204 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:33.259151    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9qnx"
Jul 17 10:52:33.259249 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:33.259233    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9qnx" podUID="ccf5dfd9-3981-4994-98cc-2edbc2b755b6"
Jul 17 10:52:34.259177 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:34.259144    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdvfl"
Jul 17 10:52:34.259584 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:34.259247    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdvfl" podUID="8037abbc-75d6-42df-9cad-5c1340e0341e"
Jul 17 10:52:35.259525 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:35.259489    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tw6nz"
Jul 17 10:52:35.259968 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:35.259584    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tw6nz" podUID="ca964baf-243f-4cb7-a20e-3c802e627f2c"
Jul 17 10:52:35.259968 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:35.259602    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9qnx"
Jul 17 10:52:35.259968 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:35.259742    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9qnx" podUID="ccf5dfd9-3981-4994-98cc-2edbc2b755b6"
Jul 17 10:52:36.259299 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:36.259272    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdvfl"
Jul 17 10:52:36.259464 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:36.259379    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdvfl" podUID="8037abbc-75d6-42df-9cad-5c1340e0341e"
Jul 17 10:52:37.259815 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:37.259779    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9qnx"
Jul 17 10:52:37.260147 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:37.259892    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9qnx" podUID="ccf5dfd9-3981-4994-98cc-2edbc2b755b6"
Jul 17 10:52:37.260209 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:37.259779    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tw6nz"
Jul 17 10:52:37.260334 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:37.260289    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tw6nz" podUID="ca964baf-243f-4cb7-a20e-3c802e627f2c"
Jul 17 10:52:37.411716 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:37.411497    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bpdts" event={"ID":"d1260e44-4d64-4569-b0ce-78f616f8b412","Type":"ContainerStarted","Data":"9712845ede309a67d56b072199c7917969dfac64e7e327597f5a8ddaa3b6208d"}
Jul 17 10:52:37.413032 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:37.413005    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j9v7m" event={"ID":"e30ba440-b1f4-466d-912e-89c364980c7c","Type":"ContainerStarted","Data":"f9d74b5eddbe4a958520e69fe0aafc254dada2a04e4218d497537fa350673342"}
Jul 17 10:52:37.414642 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:37.414616    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl" event={"ID":"48cc1998-ebc5-4702-8b08-027479580e57","Type":"ContainerStarted","Data":"adbd02047aeb03db78ace45a3df91abe0199a1cdacfc9903e671e64e60dcb528"}
Jul 17 10:52:37.416132 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:37.416076    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rsv5j" event={"ID":"a90ca9ac-e3c6-452c-89d5-64d3f4c9b1e9","Type":"ContainerStarted","Data":"13c5c7df64aa1e69002b8c03eb75d0fb5c0ac045a773ae6a258989dc3cf8dc1a"}
Jul 17 10:52:37.417527 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:37.417498    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dw8x2" event={"ID":"dd0a96e7-6c27-431c-9982-595c92b18d3c","Type":"ContainerStarted","Data":"c629c9918166f858cbf8c0a4095d590011aded135e6939bdfdd95b6629e08266"}
Jul 17 10:52:37.418834 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:37.418812    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg467" event={"ID":"3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d","Type":"ContainerStarted","Data":"cb04a5843a16881542488b649a153c6fb3ec264f406004f9cf95fe44f05369d7"}
Jul 17 10:52:37.420122 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:37.420105    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xkhv5" event={"ID":"2be15062-4e09-486c-a294-60039db2b5fe","Type":"ContainerStarted","Data":"189d189c52b7b822a10ab2722422d9b663797c086af89c783afa32478f50a8c9"}
Jul 17 10:52:37.422169 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:37.422137    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vkxxl" event={"ID":"85a21320-4c6f-4b3a-9d2b-3701c891a810","Type":"ContainerStarted","Data":"3b7e0b7a28e8c32897e793a9cd10385f260865c352e259b924b8ade7467d45a4"}
Jul 17 10:52:37.423595 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:37.423529    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-12.ec2.internal" event={"ID":"37f630f90b2f531885effe9035c04ad9","Type":"ContainerStarted","Data":"0fd37b521bdfe7c52d4476c1de7cdb60ade5341ff8c1ab170d9e6d94cd898d46"}
Jul 17 10:52:37.436593 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:37.436543    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-j9v7m" podStartSLOduration=2.203810805 podStartE2EDuration="21.436526478s" totalImagesPullingTime="19.232715673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:52:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:52:37.43593519 +0000 UTC m=+22.616968152" watchObservedRunningTime="2026-07-17 10:52:37.436526478 +0000 UTC m=+22.617559439"
Jul 17 10:52:37.466633 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:37.466562    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rsv5j" podStartSLOduration=2.222404267 podStartE2EDuration="21.466546187s" totalImagesPullingTime="19.24414192s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:52:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:52:37.451320774 +0000 UTC m=+22.632353735" watchObservedRunningTime="2026-07-17 10:52:37.466546187 +0000 UTC m=+22.647579146"
Jul 17 10:52:37.466751 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:37.466678    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bpdts" podStartSLOduration=2.235188205 podStartE2EDuration="21.466669723s" totalImagesPullingTime="19.231481518s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:52:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:52:37.466602047 +0000 UTC m=+22.647635010" watchObservedRunningTime="2026-07-17 10:52:37.466669723 +0000 UTC m=+22.647702686"
Jul 17 10:52:37.480620 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:37.480584    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-12.ec2.internal" podStartSLOduration=21.480571173 podStartE2EDuration="21.480571173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:52:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:52:37.480071844 +0000 UTC m=+22.661104806" watchObservedRunningTime="2026-07-17 10:52:37.480571173 +0000 UTC m=+22.661604134"
Jul 17 10:52:37.496076 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:37.496031    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dw8x2" podStartSLOduration=2.144073531 podStartE2EDuration="21.496001394s" totalImagesPullingTime="19.351927863s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:52:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:52:37.495101083 +0000 UTC m=+22.676134047" watchObservedRunningTime="2026-07-17 10:52:37.496001394 +0000 UTC m=+22.677034377"
Jul 17 10:52:37.514354 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:37.514304    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xkhv5" podStartSLOduration=2.162368699 podStartE2EDuration="21.514288487s" totalImagesPullingTime="19.351919788s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:52:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:52:37.513930691 +0000 UTC m=+22.694963670" watchObservedRunningTime="2026-07-17 10:52:37.514288487 +0000 UTC m=+22.695321448"
Jul 17 10:52:38.259112 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:38.258902    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdvfl"
Jul 17 10:52:38.259275 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:38.259234    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdvfl" podUID="8037abbc-75d6-42df-9cad-5c1340e0341e"
Jul 17 10:52:38.429470 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:38.429448    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xdrhl_48cc1998-ebc5-4702-8b08-027479580e57/ovn-acl-logging/0.log"
Jul 17 10:52:38.430100 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:38.429772    2563 generic.go:356] "Generic (PLEG): container finished" podID="48cc1998-ebc5-4702-8b08-027479580e57" containerID="3e619260f75627276fde594c7750d0d9573a3c5a0a6496b0a19125ba08a389b3" exitCode=1
Jul 17 10:52:38.430100 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:38.429845    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl" event={"ID":"48cc1998-ebc5-4702-8b08-027479580e57","Type":"ContainerStarted","Data":"94fb037acd2fae7735ed1e1fecd6e4627cc3aecda2a5671adb0ad1b60c827d2f"}
Jul 17 10:52:38.430100 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:38.429906    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl" event={"ID":"48cc1998-ebc5-4702-8b08-027479580e57","Type":"ContainerStarted","Data":"02ca79195cc0e244a6f2467540c9d8cac2342c816d7b985a34fe350d4748f7e2"}
Jul 17 10:52:38.430100 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:38.429946    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl" event={"ID":"48cc1998-ebc5-4702-8b08-027479580e57","Type":"ContainerStarted","Data":"178393317faa40fdb18f2e50a52708fea687f324e8b69e77ca65a287f2c8cb6a"}
Jul 17 10:52:38.430100 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:38.429975    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl" event={"ID":"48cc1998-ebc5-4702-8b08-027479580e57","Type":"ContainerStarted","Data":"6b8e8029e9eb759947ec19c4b72bea82f57d9775be338ce382c26281b4a15823"}
Jul 17 10:52:38.430100 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:38.430013    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl" event={"ID":"48cc1998-ebc5-4702-8b08-027479580e57","Type":"ContainerDied","Data":"3e619260f75627276fde594c7750d0d9573a3c5a0a6496b0a19125ba08a389b3"}
Jul 17 10:52:38.431112 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:38.431086    2563 generic.go:356] "Generic (PLEG): container finished" podID="85a21320-4c6f-4b3a-9d2b-3701c891a810" containerID="3b7e0b7a28e8c32897e793a9cd10385f260865c352e259b924b8ade7467d45a4" exitCode=0
Jul 17 10:52:38.431240 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:38.431163    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vkxxl" event={"ID":"85a21320-4c6f-4b3a-9d2b-3701c891a810","Type":"ContainerDied","Data":"3b7e0b7a28e8c32897e793a9cd10385f260865c352e259b924b8ade7467d45a4"}
Jul 17 10:52:38.720799 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:38.720779    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 17 10:52:39.246855 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:39.246751    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-17T10:52:38.720795024Z","UUID":"58451ec8-d23a-4bf1-97f2-2528c4a79c9e","Handler":null,"Name":"","Endpoint":""}
Jul 17 10:52:39.248059 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:39.248039    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 17 10:52:39.248186 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:39.248082    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 17 10:52:39.259723 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:39.259700    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tw6nz"
Jul 17 10:52:39.259840 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:39.259818    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tw6nz" podUID="ca964baf-243f-4cb7-a20e-3c802e627f2c"
Jul 17 10:52:39.259901 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:39.259882    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9qnx"
Jul 17 10:52:39.260008 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:39.259988    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9qnx" podUID="ccf5dfd9-3981-4994-98cc-2edbc2b755b6"
Jul 17 10:52:39.435289 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:39.435237    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r6kvv" event={"ID":"3e0f3591-65a5-481e-a4a0-81f3a07aa904","Type":"ContainerStarted","Data":"d764dff993c155036ba32c19f02ae1d05519a412c6048d1a1f273af2beb9b061"}
Jul 17 10:52:39.437819 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:39.437797    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg467" event={"ID":"3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d","Type":"ContainerStarted","Data":"c4e9315f7a3e8035749ff6780c22c8e0e7b1bb9a827dc428c8fabdc5c6861996"}
Jul 17 10:52:39.451343 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:39.451298    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-r6kvv" podStartSLOduration=4.089985908 podStartE2EDuration="23.45128145s" totalImagesPullingTime="19.361295542s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:52:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:52:39.450909239 +0000 UTC m=+24.631942202" watchObservedRunningTime="2026-07-17 10:52:39.45128145 +0000 UTC m=+24.632314413"
Jul 17 10:52:40.234720 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:40.234528    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-j9v7m"
Jul 17 10:52:40.235110 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:40.235086    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-j9v7m"
Jul 17 10:52:40.258723 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:40.258701    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdvfl"
Jul 17 10:52:40.258836 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:40.258815    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdvfl" podUID="8037abbc-75d6-42df-9cad-5c1340e0341e"
Jul 17 10:52:40.443134 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:40.443107    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xdrhl_48cc1998-ebc5-4702-8b08-027479580e57/ovn-acl-logging/0.log"
Jul 17 10:52:40.443611 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:40.443573    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl" event={"ID":"48cc1998-ebc5-4702-8b08-027479580e57","Type":"ContainerStarted","Data":"f4c515cabe1baa22055724fb82d311fc8719b2cce9b6064cd356cb87c6c94f7b"}
Jul 17 10:52:40.445884 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:40.445812    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg467" event={"ID":"3f6bbb0f-1d4c-43cb-bda0-9e5d3387153d","Type":"ContainerStarted","Data":"0cbb546e7e3d1f2cc7e3791fb387464ea71251827c8af7abe7c27daff3ee8594"}
Jul 17 10:52:40.446283 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:40.446260    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-j9v7m"
Jul 17 10:52:40.446699 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:40.446674    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-j9v7m"
Jul 17 10:52:40.485485 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:40.485401    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg467" podStartSLOduration=2.731323771 podStartE2EDuration="24.485386338s" totalImagesPullingTime="21.754062567s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:52:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:52:40.46781321 +0000 UTC m=+25.648846174" watchObservedRunningTime="2026-07-17 10:52:40.485386338 +0000 UTC m=+25.666419301"
Jul 17 10:52:41.259502 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:41.259473    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9qnx"
Jul 17 10:52:41.259692 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:41.259583    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tw6nz"
Jul 17 10:52:41.259692 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:41.259585    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9qnx" podUID="ccf5dfd9-3981-4994-98cc-2edbc2b755b6"
Jul 17 10:52:41.259692 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:41.259660    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tw6nz" podUID="ca964baf-243f-4cb7-a20e-3c802e627f2c"
Jul 17 10:52:42.259344 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:42.259307    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdvfl"
Jul 17 10:52:42.259888 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:42.259463    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdvfl" podUID="8037abbc-75d6-42df-9cad-5c1340e0341e"
Jul 17 10:52:43.264513 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:43.264322    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tw6nz"
Jul 17 10:52:43.265026 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:43.264369    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9qnx"
Jul 17 10:52:43.265026 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:43.264592    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tw6nz" podUID="ca964baf-243f-4cb7-a20e-3c802e627f2c"
Jul 17 10:52:43.265026 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:43.264660    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9qnx" podUID="ccf5dfd9-3981-4994-98cc-2edbc2b755b6"
Jul 17 10:52:43.453661 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:43.453622    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vkxxl" event={"ID":"85a21320-4c6f-4b3a-9d2b-3701c891a810","Type":"ContainerStarted","Data":"e528973ae405874fc80818303cc9fb0eda3d3430756feaf8cdf7b1f2dc0e922d"}
Jul 17 10:52:43.456627 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:43.456610    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xdrhl_48cc1998-ebc5-4702-8b08-027479580e57/ovn-acl-logging/0.log"
Jul 17 10:52:43.456910 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:43.456889    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl" event={"ID":"48cc1998-ebc5-4702-8b08-027479580e57","Type":"ContainerStarted","Data":"3be4c61d035ace7b6f538f35f10296ad43cf88189d180d48c45ead01caf2cc3e"}
Jul 17 10:52:43.457145 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:43.457127    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:43.457237 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:43.457177    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:43.457305 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:43.457287    2563 scope.go:117] "RemoveContainer" containerID="3e619260f75627276fde594c7750d0d9573a3c5a0a6496b0a19125ba08a389b3"
Jul 17 10:52:43.471201 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:43.471185    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:43.471714 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:43.471699    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:44.259826 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:44.259736    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdvfl"
Jul 17 10:52:44.260015 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:44.259877    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdvfl" podUID="8037abbc-75d6-42df-9cad-5c1340e0341e"
Jul 17 10:52:44.461077 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:44.461040    2563 generic.go:356] "Generic (PLEG): container finished" podID="85a21320-4c6f-4b3a-9d2b-3701c891a810" containerID="e528973ae405874fc80818303cc9fb0eda3d3430756feaf8cdf7b1f2dc0e922d" exitCode=0
Jul 17 10:52:44.461579 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:44.461122    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vkxxl" event={"ID":"85a21320-4c6f-4b3a-9d2b-3701c891a810","Type":"ContainerDied","Data":"e528973ae405874fc80818303cc9fb0eda3d3430756feaf8cdf7b1f2dc0e922d"}
Jul 17 10:52:44.464999 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:44.464975    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xdrhl_48cc1998-ebc5-4702-8b08-027479580e57/ovn-acl-logging/0.log"
Jul 17 10:52:44.465337 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:44.465313    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl" event={"ID":"48cc1998-ebc5-4702-8b08-027479580e57","Type":"ContainerStarted","Data":"caa7f5c8c02860be37b804dee336801b8a981c6e0eff3b244e8fa617a3e3b6b9"}
Jul 17 10:52:44.465486 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:44.465468    2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 17 10:52:44.509734 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:44.509696    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl" podStartSLOduration=8.975480794 podStartE2EDuration="28.509683991s" totalImagesPullingTime="19.534203197s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:52:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:52:44.509335118 +0000 UTC m=+29.690368081" watchObservedRunningTime="2026-07-17 10:52:44.509683991 +0000 UTC m=+29.690716949"
Jul 17 10:52:44.962394 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:44.962366    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tw6nz"]
Jul 17 10:52:44.962567 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:44.962506    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tw6nz"
Jul 17 10:52:44.962609 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:44.962581    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tw6nz" podUID="ca964baf-243f-4cb7-a20e-3c802e627f2c"
Jul 17 10:52:44.965507 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:44.965482    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mdvfl"]
Jul 17 10:52:44.965633 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:44.965593    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdvfl"
Jul 17 10:52:44.965723 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:44.965695    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdvfl" podUID="8037abbc-75d6-42df-9cad-5c1340e0341e"
Jul 17 10:52:44.966223 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:44.966202    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t9qnx"]
Jul 17 10:52:44.966332 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:44.966297    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9qnx"
Jul 17 10:52:44.966411 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:44.966378    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9qnx" podUID="ccf5dfd9-3981-4994-98cc-2edbc2b755b6"
Jul 17 10:52:45.467259 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:45.467235    2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 17 10:52:46.057211 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:46.057187    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:52:46.259551 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:46.259529    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tw6nz"
Jul 17 10:52:46.259666 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:46.259531    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9qnx"
Jul 17 10:52:46.259729 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:46.259613    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tw6nz" podUID="ca964baf-243f-4cb7-a20e-3c802e627f2c"
Jul 17 10:52:46.259729 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:46.259716    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9qnx" podUID="ccf5dfd9-3981-4994-98cc-2edbc2b755b6"
Jul 17 10:52:46.471948 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:46.471926    2563 generic.go:356] "Generic (PLEG): container finished" podID="85a21320-4c6f-4b3a-9d2b-3701c891a810" containerID="1129ecac478ebe8591d5a1d5fe44491401e9caf673a0d9e4d4a49af5cbc1eeb1" exitCode=0
Jul 17 10:52:46.472277 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:46.472013    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vkxxl" event={"ID":"85a21320-4c6f-4b3a-9d2b-3701c891a810","Type":"ContainerDied","Data":"1129ecac478ebe8591d5a1d5fe44491401e9caf673a0d9e4d4a49af5cbc1eeb1"}
Jul 17 10:52:47.258838 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:47.258810    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdvfl"
Jul 17 10:52:47.258972 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:47.258919    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdvfl" podUID="8037abbc-75d6-42df-9cad-5c1340e0341e"
Jul 17 10:52:47.476110 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:47.476085    2563 generic.go:356] "Generic (PLEG): container finished" podID="85a21320-4c6f-4b3a-9d2b-3701c891a810" containerID="07fadf65d023585ef88b7405277e227c0a4d9ffc444cc63e4f13df8364c65ffb" exitCode=0
Jul 17 10:52:47.476494 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:47.476122    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vkxxl" event={"ID":"85a21320-4c6f-4b3a-9d2b-3701c891a810","Type":"ContainerDied","Data":"07fadf65d023585ef88b7405277e227c0a4d9ffc444cc63e4f13df8364c65ffb"}
Jul 17 10:52:48.260082 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:48.259627    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9qnx"
Jul 17 10:52:48.260082 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:48.259743    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9qnx" podUID="ccf5dfd9-3981-4994-98cc-2edbc2b755b6"
Jul 17 10:52:48.260082 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:48.259795    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tw6nz"
Jul 17 10:52:48.260082 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:48.259894    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tw6nz" podUID="ca964baf-243f-4cb7-a20e-3c802e627f2c"
Jul 17 10:52:49.049728 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:49.049690    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8037abbc-75d6-42df-9cad-5c1340e0341e-metrics-certs\") pod \"network-metrics-daemon-mdvfl\" (UID: \"8037abbc-75d6-42df-9cad-5c1340e0341e\") " pod="openshift-multus/network-metrics-daemon-mdvfl"
Jul 17 10:52:49.050308 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:49.049754    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca964baf-243f-4cb7-a20e-3c802e627f2c-original-pull-secret\") pod \"global-pull-secret-syncer-tw6nz\" (UID: \"ca964baf-243f-4cb7-a20e-3c802e627f2c\") " pod="kube-system/global-pull-secret-syncer-tw6nz"
Jul 17 10:52:49.050308 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:49.049834    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 10:52:49.050308 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:49.049899    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8037abbc-75d6-42df-9cad-5c1340e0341e-metrics-certs podName:8037abbc-75d6-42df-9cad-5c1340e0341e nodeName:}" failed. No retries permitted until 2026-07-17 10:53:21.049883364 +0000 UTC m=+66.230916309 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8037abbc-75d6-42df-9cad-5c1340e0341e-metrics-certs") pod "network-metrics-daemon-mdvfl" (UID: "8037abbc-75d6-42df-9cad-5c1340e0341e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 10:52:49.050308 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:49.049840    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 10:52:49.050308 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:49.049971    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca964baf-243f-4cb7-a20e-3c802e627f2c-original-pull-secret podName:ca964baf-243f-4cb7-a20e-3c802e627f2c nodeName:}" failed. No retries permitted until 2026-07-17 10:53:21.049955876 +0000 UTC m=+66.230988828 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca964baf-243f-4cb7-a20e-3c802e627f2c-original-pull-secret") pod "global-pull-secret-syncer-tw6nz" (UID: "ca964baf-243f-4cb7-a20e-3c802e627f2c") : object "kube-system"/"original-pull-secret" not registered
Jul 17 10:52:49.150205 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:49.150172    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqvqj\" (UniqueName: \"kubernetes.io/projected/ccf5dfd9-3981-4994-98cc-2edbc2b755b6-kube-api-access-pqvqj\") pod \"network-check-target-t9qnx\" (UID: \"ccf5dfd9-3981-4994-98cc-2edbc2b755b6\") " pod="openshift-network-diagnostics/network-check-target-t9qnx"
Jul 17 10:52:49.150380 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:49.150307    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 10:52:49.150380 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:49.150343    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 10:52:49.150380 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:49.150355    2563 projected.go:196] Error preparing data for projected volume kube-api-access-pqvqj for pod openshift-network-diagnostics/network-check-target-t9qnx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 10:52:49.150562 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:49.150400    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ccf5dfd9-3981-4994-98cc-2edbc2b755b6-kube-api-access-pqvqj podName:ccf5dfd9-3981-4994-98cc-2edbc2b755b6 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:21.150387326 +0000 UTC m=+66.331420266 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pqvqj" (UniqueName: "kubernetes.io/projected/ccf5dfd9-3981-4994-98cc-2edbc2b755b6-kube-api-access-pqvqj") pod "network-check-target-t9qnx" (UID: "ccf5dfd9-3981-4994-98cc-2edbc2b755b6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 10:52:49.259048 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:49.259022    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdvfl"
Jul 17 10:52:49.259184 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:49.259149    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mdvfl" podUID="8037abbc-75d6-42df-9cad-5c1340e0341e"
Jul 17 10:52:50.182566 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.182535    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-12.ec2.internal" event="NodeReady"
Jul 17 10:52:50.182988 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.182691    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 17 10:52:50.219107 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.218879    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7bc89448c5-j2z9h"]
Jul 17 10:52:50.221626 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.221602    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h"
Jul 17 10:52:50.224584 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.224406    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gcsz5\""
Jul 17 10:52:50.224584 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.224469    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 17 10:52:50.224584 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.224499    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 17 10:52:50.224793 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.224657    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 17 10:52:50.230631 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.230614    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 17 10:52:50.232415 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.232397    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kfp4f"]
Jul 17 10:52:50.234179 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.234163    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kfp4f"
Jul 17 10:52:50.236113 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.236091    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bc89448c5-j2z9h"]
Jul 17 10:52:50.236778 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.236761    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-j4xv5"]
Jul 17 10:52:50.236939 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.236911    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 17 10:52:50.237015 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.236976    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dnhpd\""
Jul 17 10:52:50.237074 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.237040    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 17 10:52:50.240118 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.240100    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j4xv5"
Jul 17 10:52:50.243264 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.243249    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 17 10:52:50.243580 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.243562    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 17 10:52:50.244291 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.244129    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-25nnq\""
Jul 17 10:52:50.244291 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.244216    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 17 10:52:50.245115 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.245093    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kfp4f"]
Jul 17 10:52:50.248740 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.248708    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j4xv5"]
Jul 17 10:52:50.259639 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.259620    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tw6nz"
Jul 17 10:52:50.259789 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.259769    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9qnx"
Jul 17 10:52:50.262650 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.262634    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 17 10:52:50.262783 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.262663    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 17 10:52:50.262917 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.262900    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 17 10:52:50.263190 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.263171    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gt9xr\""
Jul 17 10:52:50.360910 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.360882    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-trusted-ca\") pod \"image-registry-7bc89448c5-j2z9h\" (UID: \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\") " pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h"
Jul 17 10:52:50.361040 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.360916    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/619f03dd-a502-4c49-a66d-496a29102121-config-volume\") pod \"dns-default-kfp4f\" (UID: \"619f03dd-a502-4c49-a66d-496a29102121\") " pod="openshift-dns/dns-default-kfp4f"
Jul 17 10:52:50.361040 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.360963    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhrx8\" (UniqueName: \"kubernetes.io/projected/619f03dd-a502-4c49-a66d-496a29102121-kube-api-access-lhrx8\") pod \"dns-default-kfp4f\" (UID: \"619f03dd-a502-4c49-a66d-496a29102121\") " pod="openshift-dns/dns-default-kfp4f"
Jul 17 10:52:50.361040 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.360988    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87ba2b7a-cc06-4d60-af20-e8eb0c16b840-cert\") pod \"ingress-canary-j4xv5\" (UID: \"87ba2b7a-cc06-4d60-af20-e8eb0c16b840\") " pod="openshift-ingress-canary/ingress-canary-j4xv5"
Jul 17 10:52:50.361040 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.361017    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dmh5\" (UniqueName: \"kubernetes.io/projected/87ba2b7a-cc06-4d60-af20-e8eb0c16b840-kube-api-access-5dmh5\") pod \"ingress-canary-j4xv5\" (UID: \"87ba2b7a-cc06-4d60-af20-e8eb0c16b840\") " pod="openshift-ingress-canary/ingress-canary-j4xv5"
Jul 17 10:52:50.361249 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.361065    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-registry-certificates\") pod \"image-registry-7bc89448c5-j2z9h\" (UID: \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\") " pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h"
Jul 17 10:52:50.361249 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.361115    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8d5d\" (UniqueName: \"kubernetes.io/projected/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-kube-api-access-g8d5d\") pod \"image-registry-7bc89448c5-j2z9h\" (UID: \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\") " pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h"
Jul 17 10:52:50.361249 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.361158    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-image-registry-private-configuration\") pod \"image-registry-7bc89448c5-j2z9h\" (UID: \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\") " pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h"
Jul 17 10:52:50.361249 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.361182    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-registry-tls\") pod \"image-registry-7bc89448c5-j2z9h\" (UID: \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\") " pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h"
Jul 17 10:52:50.361249 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.361203    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-ca-trust-extracted\") pod \"image-registry-7bc89448c5-j2z9h\" (UID: \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\") " pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h"
Jul 17 10:52:50.361249 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.361222    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/619f03dd-a502-4c49-a66d-496a29102121-metrics-tls\") pod \"dns-default-kfp4f\" (UID: \"619f03dd-a502-4c49-a66d-496a29102121\") " pod="openshift-dns/dns-default-kfp4f"
Jul 17 10:52:50.361249 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.361239    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-bound-sa-token\") pod \"image-registry-7bc89448c5-j2z9h\" (UID: \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\") " pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h"
Jul 17 10:52:50.361570 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.361266    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/619f03dd-a502-4c49-a66d-496a29102121-tmp-dir\") pod \"dns-default-kfp4f\" (UID: \"619f03dd-a502-4c49-a66d-496a29102121\") " pod="openshift-dns/dns-default-kfp4f"
Jul 17 10:52:50.361570 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.361320    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-installation-pull-secrets\") pod \"image-registry-7bc89448c5-j2z9h\" (UID: \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\") " pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h"
Jul 17 10:52:50.462278 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.462205    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-registry-certificates\") pod \"image-registry-7bc89448c5-j2z9h\" (UID: \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\") " pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h"
Jul 17 10:52:50.462278 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.462244    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8d5d\" (UniqueName: \"kubernetes.io/projected/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-kube-api-access-g8d5d\") pod \"image-registry-7bc89448c5-j2z9h\" (UID: \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\") " pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h"
Jul 17 10:52:50.462278 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.462279    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-image-registry-private-configuration\") pod \"image-registry-7bc89448c5-j2z9h\" (UID: \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\") " pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h"
Jul 17 10:52:50.462536 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.462296    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-registry-tls\") pod \"image-registry-7bc89448c5-j2z9h\" (UID: \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\") " pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h"
Jul 17 10:52:50.462536 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.462327    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-ca-trust-extracted\") pod \"image-registry-7bc89448c5-j2z9h\" (UID: \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\") " pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h"
Jul 17 10:52:50.462536 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.462350    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/619f03dd-a502-4c49-a66d-496a29102121-metrics-tls\") pod \"dns-default-kfp4f\" (UID: \"619f03dd-a502-4c49-a66d-496a29102121\") " pod="openshift-dns/dns-default-kfp4f"
Jul 17 10:52:50.462536 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.462378    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-bound-sa-token\") pod \"image-registry-7bc89448c5-j2z9h\" (UID: \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\") " pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h"
Jul 17 10:52:50.462536 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.462414    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/619f03dd-a502-4c49-a66d-496a29102121-tmp-dir\") pod \"dns-default-kfp4f\" (UID: \"619f03dd-a502-4c49-a66d-496a29102121\") " pod="openshift-dns/dns-default-kfp4f"
Jul 17 10:52:50.462536 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:50.462450    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 10:52:50.462536 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:50.462472    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bc89448c5-j2z9h: secret "image-registry-tls" not found
Jul 17 10:52:50.462536 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:50.462542    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-registry-tls podName:e652b2b1-5807-4dfd-bc88-0673b2c5d8a8 nodeName:}" failed. No retries permitted until 2026-07-17 10:52:50.962521395 +0000 UTC m=+36.143554355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-registry-tls") pod "image-registry-7bc89448c5-j2z9h" (UID: "e652b2b1-5807-4dfd-bc88-0673b2c5d8a8") : secret "image-registry-tls" not found
Jul 17 10:52:50.462910 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.462458    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-installation-pull-secrets\") pod \"image-registry-7bc89448c5-j2z9h\" (UID: \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\") " pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h"
Jul 17 10:52:50.462910 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.462745    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-ca-trust-extracted\") pod \"image-registry-7bc89448c5-j2z9h\" (UID: \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\") " pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h"
Jul 17 10:52:50.462910 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.462779    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-trusted-ca\") pod \"image-registry-7bc89448c5-j2z9h\" (UID: \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\") " pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h"
Jul 17 10:52:50.462910 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.462811    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/619f03dd-a502-4c49-a66d-496a29102121-config-volume\") pod \"dns-default-kfp4f\" (UID: \"619f03dd-a502-4c49-a66d-496a29102121\") " pod="openshift-dns/dns-default-kfp4f"
Jul 17 10:52:50.462910 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.462846    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhrx8\" (UniqueName: \"kubernetes.io/projected/619f03dd-a502-4c49-a66d-496a29102121-kube-api-access-lhrx8\") pod \"dns-default-kfp4f\" (UID: \"619f03dd-a502-4c49-a66d-496a29102121\") " pod="openshift-dns/dns-default-kfp4f"
Jul 17 10:52:50.462910 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.462861    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87ba2b7a-cc06-4d60-af20-e8eb0c16b840-cert\") pod \"ingress-canary-j4xv5\" (UID: \"87ba2b7a-cc06-4d60-af20-e8eb0c16b840\") " pod="openshift-ingress-canary/ingress-canary-j4xv5"
Jul 17 10:52:50.462910 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.462880    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dmh5\" (UniqueName: \"kubernetes.io/projected/87ba2b7a-cc06-4d60-af20-e8eb0c16b840-kube-api-access-5dmh5\") pod \"ingress-canary-j4xv5\" (UID: \"87ba2b7a-cc06-4d60-af20-e8eb0c16b840\") " pod="openshift-ingress-canary/ingress-canary-j4xv5"
Jul 17 10:52:50.462910 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.462905    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-registry-certificates\") pod \"image-registry-7bc89448c5-j2z9h\" (UID: \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\") " pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h"
Jul 17 10:52:50.463255 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.463028    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/619f03dd-a502-4c49-a66d-496a29102121-tmp-dir\") pod \"dns-default-kfp4f\" (UID: \"619f03dd-a502-4c49-a66d-496a29102121\") " pod="openshift-dns/dns-default-kfp4f"
Jul 17 10:52:50.463255 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:50.462861    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 10:52:50.463255 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:50.463112    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/619f03dd-a502-4c49-a66d-496a29102121-metrics-tls podName:619f03dd-a502-4c49-a66d-496a29102121 nodeName:}" failed. No retries permitted until 2026-07-17 10:52:50.963094177 +0000 UTC m=+36.144127118 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/619f03dd-a502-4c49-a66d-496a29102121-metrics-tls") pod "dns-default-kfp4f" (UID: "619f03dd-a502-4c49-a66d-496a29102121") : secret "dns-default-metrics-tls" not found
Jul 17 10:52:50.463561 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.463542    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/619f03dd-a502-4c49-a66d-496a29102121-config-volume\") pod \"dns-default-kfp4f\" (UID: \"619f03dd-a502-4c49-a66d-496a29102121\") " pod="openshift-dns/dns-default-kfp4f"
Jul 17 10:52:50.463654 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.463631    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-trusted-ca\") pod \"image-registry-7bc89448c5-j2z9h\" (UID: \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\") " pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h"
Jul 17 10:52:50.466992 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.466967    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-installation-pull-secrets\") pod \"image-registry-7bc89448c5-j2z9h\" (UID: \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\") " pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h"
Jul 17 10:52:50.466992 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.466979    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-image-registry-private-configuration\") pod \"image-registry-7bc89448c5-j2z9h\" (UID: \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\") " pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h"
Jul 17 10:52:50.467118 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.467073    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87ba2b7a-cc06-4d60-af20-e8eb0c16b840-cert\") pod \"ingress-canary-j4xv5\" (UID: \"87ba2b7a-cc06-4d60-af20-e8eb0c16b840\") " pod="openshift-ingress-canary/ingress-canary-j4xv5"
Jul 17 10:52:50.471442 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.471387    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-bound-sa-token\") pod \"image-registry-7bc89448c5-j2z9h\" (UID: \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\") " pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h"
Jul 17 10:52:50.471804 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.471781    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dmh5\" (UniqueName: \"kubernetes.io/projected/87ba2b7a-cc06-4d60-af20-e8eb0c16b840-kube-api-access-5dmh5\") pod \"ingress-canary-j4xv5\" (UID: \"87ba2b7a-cc06-4d60-af20-e8eb0c16b840\") " pod="openshift-ingress-canary/ingress-canary-j4xv5"
Jul 17 10:52:50.471891 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.471820    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8d5d\" (UniqueName: \"kubernetes.io/projected/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-kube-api-access-g8d5d\") pod \"image-registry-7bc89448c5-j2z9h\" (UID: \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\") " pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h"
Jul 17 10:52:50.472295 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.472266    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhrx8\" (UniqueName: \"kubernetes.io/projected/619f03dd-a502-4c49-a66d-496a29102121-kube-api-access-lhrx8\") pod \"dns-default-kfp4f\" (UID: \"619f03dd-a502-4c49-a66d-496a29102121\") " pod="openshift-dns/dns-default-kfp4f"
Jul 17 10:52:50.553448 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.553400    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j4xv5"
Jul 17 10:52:50.965923 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.965880    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-registry-tls\") pod \"image-registry-7bc89448c5-j2z9h\" (UID: \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\") " pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h"
Jul 17 10:52:50.965923 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:50.965921    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/619f03dd-a502-4c49-a66d-496a29102121-metrics-tls\") pod \"dns-default-kfp4f\" (UID: \"619f03dd-a502-4c49-a66d-496a29102121\") " pod="openshift-dns/dns-default-kfp4f"
Jul 17 10:52:50.966208 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:50.966055    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 10:52:50.966208 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:50.966089    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bc89448c5-j2z9h: secret "image-registry-tls" not found
Jul 17 10:52:50.966208 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:50.966158    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-registry-tls podName:e652b2b1-5807-4dfd-bc88-0673b2c5d8a8 nodeName:}" failed. No retries permitted until 2026-07-17 10:52:51.966144369 +0000 UTC m=+37.147177309 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-registry-tls") pod "image-registry-7bc89448c5-j2z9h" (UID: "e652b2b1-5807-4dfd-bc88-0673b2c5d8a8") : secret "image-registry-tls" not found
Jul 17 10:52:50.966208 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:50.966181    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 10:52:50.966406 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:50.966230    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/619f03dd-a502-4c49-a66d-496a29102121-metrics-tls podName:619f03dd-a502-4c49-a66d-496a29102121 nodeName:}" failed. No retries permitted until 2026-07-17 10:52:51.966216664 +0000 UTC m=+37.147249610 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/619f03dd-a502-4c49-a66d-496a29102121-metrics-tls") pod "dns-default-kfp4f" (UID: "619f03dd-a502-4c49-a66d-496a29102121") : secret "dns-default-metrics-tls" not found
Jul 17 10:52:51.259144 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:51.259065    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdvfl"
Jul 17 10:52:51.262315 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:51.262288    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rk769\""
Jul 17 10:52:51.262663 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:51.262632    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 17 10:52:51.441281 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:51.441256    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j4xv5"]
Jul 17 10:52:51.444392 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:52:51.444370    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87ba2b7a_cc06_4d60_af20_e8eb0c16b840.slice/crio-1a54ad69a08e6e5cbee1af3c9ba6d8fa374e3e8138b2918cd8ae34154a06976e WatchSource:0}: Error finding container 1a54ad69a08e6e5cbee1af3c9ba6d8fa374e3e8138b2918cd8ae34154a06976e: Status 404 returned error can't find the container with id 1a54ad69a08e6e5cbee1af3c9ba6d8fa374e3e8138b2918cd8ae34154a06976e
Jul 17 10:52:51.485246 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:51.485199    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j4xv5" event={"ID":"87ba2b7a-cc06-4d60-af20-e8eb0c16b840","Type":"ContainerStarted","Data":"1a54ad69a08e6e5cbee1af3c9ba6d8fa374e3e8138b2918cd8ae34154a06976e"}
Jul 17 10:52:51.488146 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:51.488123    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vkxxl" event={"ID":"85a21320-4c6f-4b3a-9d2b-3701c891a810","Type":"ContainerStarted","Data":"903716da7f5f98d2a74770e369a65008b25850f25cc52935c0bda112dfde864f"}
Jul 17 10:52:51.973914 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:51.973886    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-registry-tls\") pod \"image-registry-7bc89448c5-j2z9h\" (UID: \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\") " pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h"
Jul 17 10:52:51.974030 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:51.973917    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/619f03dd-a502-4c49-a66d-496a29102121-metrics-tls\") pod \"dns-default-kfp4f\" (UID: \"619f03dd-a502-4c49-a66d-496a29102121\") " pod="openshift-dns/dns-default-kfp4f"
Jul 17 10:52:51.974030 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:51.974007    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 10:52:51.974030 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:51.974011    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 10:52:51.974030 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:51.974028    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bc89448c5-j2z9h: secret "image-registry-tls" not found
Jul 17 10:52:51.974204 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:51.974056    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/619f03dd-a502-4c49-a66d-496a29102121-metrics-tls podName:619f03dd-a502-4c49-a66d-496a29102121 nodeName:}" failed. No retries permitted until 2026-07-17 10:52:53.974042415 +0000 UTC m=+39.155075355 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/619f03dd-a502-4c49-a66d-496a29102121-metrics-tls") pod "dns-default-kfp4f" (UID: "619f03dd-a502-4c49-a66d-496a29102121") : secret "dns-default-metrics-tls" not found
Jul 17 10:52:51.974204 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:51.974068    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-registry-tls podName:e652b2b1-5807-4dfd-bc88-0673b2c5d8a8 nodeName:}" failed. No retries permitted until 2026-07-17 10:52:53.974062726 +0000 UTC m=+39.155095666 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-registry-tls") pod "image-registry-7bc89448c5-j2z9h" (UID: "e652b2b1-5807-4dfd-bc88-0673b2c5d8a8") : secret "image-registry-tls" not found
Jul 17 10:52:52.493418 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:52.493385    2563 generic.go:356] "Generic (PLEG): container finished" podID="85a21320-4c6f-4b3a-9d2b-3701c891a810" containerID="903716da7f5f98d2a74770e369a65008b25850f25cc52935c0bda112dfde864f" exitCode=0
Jul 17 10:52:52.493899 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:52.493472    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vkxxl" event={"ID":"85a21320-4c6f-4b3a-9d2b-3701c891a810","Type":"ContainerDied","Data":"903716da7f5f98d2a74770e369a65008b25850f25cc52935c0bda112dfde864f"}
Jul 17 10:52:53.499628 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:53.499584    2563 generic.go:356] "Generic (PLEG): container finished" podID="85a21320-4c6f-4b3a-9d2b-3701c891a810" containerID="9e2fd97627b929ac03b88f0b6f51a15f0d4f213610ac8c4133768d64ddb10bcb" exitCode=0
Jul 17 10:52:53.499628 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:53.499628    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vkxxl" event={"ID":"85a21320-4c6f-4b3a-9d2b-3701c891a810","Type":"ContainerDied","Data":"9e2fd97627b929ac03b88f0b6f51a15f0d4f213610ac8c4133768d64ddb10bcb"}
Jul 17 10:52:53.989157 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:53.989011    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-registry-tls\") pod \"image-registry-7bc89448c5-j2z9h\" (UID: \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\") " pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h"
Jul 17 10:52:53.989237 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:53.989175    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/619f03dd-a502-4c49-a66d-496a29102121-metrics-tls\") pod \"dns-default-kfp4f\" (UID: \"619f03dd-a502-4c49-a66d-496a29102121\") " pod="openshift-dns/dns-default-kfp4f"
Jul 17 10:52:53.989237 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:53.989178    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 10:52:53.989237 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:53.989198    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bc89448c5-j2z9h: secret "image-registry-tls" not found
Jul 17 10:52:53.989326 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:53.989251    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-registry-tls podName:e652b2b1-5807-4dfd-bc88-0673b2c5d8a8 nodeName:}" failed. No retries permitted until 2026-07-17 10:52:57.989232387 +0000 UTC m=+43.170265332 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-registry-tls") pod "image-registry-7bc89448c5-j2z9h" (UID: "e652b2b1-5807-4dfd-bc88-0673b2c5d8a8") : secret "image-registry-tls" not found
Jul 17 10:52:53.989326 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:53.989300    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 10:52:53.989388 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:53.989355    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/619f03dd-a502-4c49-a66d-496a29102121-metrics-tls podName:619f03dd-a502-4c49-a66d-496a29102121 nodeName:}" failed. No retries permitted until 2026-07-17 10:52:57.989343023 +0000 UTC m=+43.170375963 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/619f03dd-a502-4c49-a66d-496a29102121-metrics-tls") pod "dns-default-kfp4f" (UID: "619f03dd-a502-4c49-a66d-496a29102121") : secret "dns-default-metrics-tls" not found
Jul 17 10:52:54.506174 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:54.506135    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j4xv5" event={"ID":"87ba2b7a-cc06-4d60-af20-e8eb0c16b840","Type":"ContainerStarted","Data":"9db754c9d7dc3b9f81ace86a757752c8903ff21c8ebb1c363af2435d31de4ea1"}
Jul 17 10:52:54.509237 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:54.509214    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vkxxl" event={"ID":"85a21320-4c6f-4b3a-9d2b-3701c891a810","Type":"ContainerStarted","Data":"6990130334dbeafdc9952fb7b673e9689342db56352118bfa253290e1334f154"}
Jul 17 10:52:54.522906 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:54.522864    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-j4xv5" podStartSLOduration=2.065444383 podStartE2EDuration="4.522849825s" totalImagesPullingTime="2.457405442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:52:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:52:54.521893816 +0000 UTC m=+39.702926776" watchObservedRunningTime="2026-07-17 10:52:54.522849825 +0000 UTC m=+39.703882787"
Jul 17 10:52:54.542898 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:54.542864    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vkxxl" podStartSLOduration=8.59485063 podStartE2EDuration="38.542850487s" totalImagesPullingTime="29.947999857s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:52:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:52:54.541876046 +0000 UTC m=+39.722909007" watchObservedRunningTime="2026-07-17 10:52:54.542850487 +0000 UTC m=+39.723883431"
Jul 17 10:52:58.016238 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:58.016203    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-registry-tls\") pod \"image-registry-7bc89448c5-j2z9h\" (UID: \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\") " pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h"
Jul 17 10:52:58.016238 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:52:58.016239    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/619f03dd-a502-4c49-a66d-496a29102121-metrics-tls\") pod \"dns-default-kfp4f\" (UID: \"619f03dd-a502-4c49-a66d-496a29102121\") " pod="openshift-dns/dns-default-kfp4f"
Jul 17 10:52:58.016686 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:58.016327    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 10:52:58.016686 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:58.016342    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bc89448c5-j2z9h: secret "image-registry-tls" not found
Jul 17 10:52:58.016686 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:58.016381    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 10:52:58.016686 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:58.016386    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-registry-tls podName:e652b2b1-5807-4dfd-bc88-0673b2c5d8a8 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:06.016373199 +0000 UTC m=+51.197406139 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-registry-tls") pod "image-registry-7bc89448c5-j2z9h" (UID: "e652b2b1-5807-4dfd-bc88-0673b2c5d8a8") : secret "image-registry-tls" not found
Jul 17 10:52:58.016686 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:52:58.016455    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/619f03dd-a502-4c49-a66d-496a29102121-metrics-tls podName:619f03dd-a502-4c49-a66d-496a29102121 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:06.016420676 +0000 UTC m=+51.197453622 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/619f03dd-a502-4c49-a66d-496a29102121-metrics-tls") pod "dns-default-kfp4f" (UID: "619f03dd-a502-4c49-a66d-496a29102121") : secret "dns-default-metrics-tls" not found
Jul 17 10:53:06.069863 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:06.069834    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-registry-tls\") pod \"image-registry-7bc89448c5-j2z9h\" (UID: \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\") " pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h"
Jul 17 10:53:06.069863 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:06.069864    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/619f03dd-a502-4c49-a66d-496a29102121-metrics-tls\") pod \"dns-default-kfp4f\" (UID: \"619f03dd-a502-4c49-a66d-496a29102121\") " pod="openshift-dns/dns-default-kfp4f"
Jul 17 10:53:06.070327 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:53:06.069951    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 10:53:06.070327 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:53:06.069961    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 10:53:06.070327 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:53:06.069977    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bc89448c5-j2z9h: secret "image-registry-tls" not found
Jul 17 10:53:06.070327 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:53:06.069996    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/619f03dd-a502-4c49-a66d-496a29102121-metrics-tls podName:619f03dd-a502-4c49-a66d-496a29102121 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:22.069983154 +0000 UTC m=+67.251016094 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/619f03dd-a502-4c49-a66d-496a29102121-metrics-tls") pod "dns-default-kfp4f" (UID: "619f03dd-a502-4c49-a66d-496a29102121") : secret "dns-default-metrics-tls" not found
Jul 17 10:53:06.070327 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:53:06.070024    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-registry-tls podName:e652b2b1-5807-4dfd-bc88-0673b2c5d8a8 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:22.070011825 +0000 UTC m=+67.251044765 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-registry-tls") pod "image-registry-7bc89448c5-j2z9h" (UID: "e652b2b1-5807-4dfd-bc88-0673b2c5d8a8") : secret "image-registry-tls" not found
Jul 17 10:53:15.361471 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:15.361442    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4xqz9"]
Jul 17 10:53:15.366097 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:15.366077    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4xqz9"
Jul 17 10:53:15.369823 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:15.369804    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 17 10:53:15.370055 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:15.370040    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 17 10:53:15.370868 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:15.370845    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-fpszc\""
Jul 17 10:53:15.370971 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:15.370869    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 17 10:53:15.370971 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:15.370869    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 17 10:53:15.377404 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:15.377385    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4xqz9"]
Jul 17 10:53:15.432012 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:15.431987    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8fa4781c-bff5-45e6-89fd-5192794e108d-config\") pod \"service-ca-operator-5bcbc94c78-4xqz9\" (UID: \"8fa4781c-bff5-45e6-89fd-5192794e108d\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4xqz9"
Jul 17 10:53:15.432102 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:15.432021    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94nbb\" (UniqueName: \"kubernetes.io/projected/8fa4781c-bff5-45e6-89fd-5192794e108d-kube-api-access-94nbb\") pod \"service-ca-operator-5bcbc94c78-4xqz9\" (UID: \"8fa4781c-bff5-45e6-89fd-5192794e108d\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4xqz9"
Jul 17 10:53:15.432102 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:15.432073    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8fa4781c-bff5-45e6-89fd-5192794e108d-serving-cert\") pod \"service-ca-operator-5bcbc94c78-4xqz9\" (UID: \"8fa4781c-bff5-45e6-89fd-5192794e108d\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4xqz9"
Jul 17 10:53:15.469204 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:15.469181    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-lh2pk"]
Jul 17 10:53:15.493525 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:15.493506    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-lh2pk"
Jul 17 10:53:15.525874 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:15.525856    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 17 10:53:15.526101 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:15.526081    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 17 10:53:15.532468 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:15.532447    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bcacde69-b0da-4aa1-8d6b-f9a248008f6e-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-lh2pk\" (UID: \"bcacde69-b0da-4aa1-8d6b-f9a248008f6e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-lh2pk"
Jul 17 10:53:15.532528 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:15.532480    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bcacde69-b0da-4aa1-8d6b-f9a248008f6e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-lh2pk\" (UID: \"bcacde69-b0da-4aa1-8d6b-f9a248008f6e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-lh2pk"
Jul 17 10:53:15.532571 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:15.532526    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8fa4781c-bff5-45e6-89fd-5192794e108d-serving-cert\") pod \"service-ca-operator-5bcbc94c78-4xqz9\" (UID: \"8fa4781c-bff5-45e6-89fd-5192794e108d\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4xqz9"
Jul 17 10:53:15.532571 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:15.532566    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8fa4781c-bff5-45e6-89fd-5192794e108d-config\") pod \"service-ca-operator-5bcbc94c78-4xqz9\" (UID: \"8fa4781c-bff5-45e6-89fd-5192794e108d\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4xqz9"
Jul 17 10:53:15.532659 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:15.532595    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vp57\" (UniqueName: \"kubernetes.io/projected/bcacde69-b0da-4aa1-8d6b-f9a248008f6e-kube-api-access-9vp57\") pod \"cluster-monitoring-operator-76cf8966f8-lh2pk\" (UID: \"bcacde69-b0da-4aa1-8d6b-f9a248008f6e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-lh2pk"
Jul 17 10:53:15.532659 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:15.532622    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94nbb\" (UniqueName: \"kubernetes.io/projected/8fa4781c-bff5-45e6-89fd-5192794e108d-kube-api-access-94nbb\") pod \"service-ca-operator-5bcbc94c78-4xqz9\" (UID: \"8fa4781c-bff5-45e6-89fd-5192794e108d\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4xqz9"
Jul 17 10:53:15.536200 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:15.536183    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8fa4781c-bff5-45e6-89fd-5192794e108d-serving-cert\") pod \"service-ca-operator-5bcbc94c78-4xqz9\" (UID: \"8fa4781c-bff5-45e6-89fd-5192794e108d\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4xqz9"
Jul 17 10:53:15.539980 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:15.539966    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 17 10:53:15.540060 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:15.540044    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 17 10:53:15.543969 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:15.543949    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8fa4781c-bff5-45e6-89fd-5192794e108d-config\") pod \"service-ca-operator-5bcbc94c78-4xqz9\" (UID: \"8fa4781c-bff5-45e6-89fd-5192794e108d\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4xqz9"
Jul 17 10:53:15.544499 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:15.544482    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-m84r8\""
Jul 17 10:53:15.556368 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:15.556349    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-lh2pk"]
Jul 17 10:53:15.564622 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:15.564604    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94nbb\" (UniqueName: \"kubernetes.io/projected/8fa4781c-bff5-45e6-89fd-5192794e108d-kube-api-access-94nbb\") pod \"service-ca-operator-5bcbc94c78-4xqz9\" (UID: \"8fa4781c-bff5-45e6-89fd-5192794e108d\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4xqz9"
Jul 17 10:53:15.633004 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:15.632961    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vp57\" (UniqueName: \"kubernetes.io/projected/bcacde69-b0da-4aa1-8d6b-f9a248008f6e-kube-api-access-9vp57\") pod \"cluster-monitoring-operator-76cf8966f8-lh2pk\" (UID: \"bcacde69-b0da-4aa1-8d6b-f9a248008f6e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-lh2pk"
Jul 17 10:53:15.633004 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:15.632991    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bcacde69-b0da-4aa1-8d6b-f9a248008f6e-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-lh2pk\" (UID: \"bcacde69-b0da-4aa1-8d6b-f9a248008f6e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-lh2pk"
Jul 17 10:53:15.633157 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:15.633011    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bcacde69-b0da-4aa1-8d6b-f9a248008f6e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-lh2pk\" (UID: \"bcacde69-b0da-4aa1-8d6b-f9a248008f6e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-lh2pk"
Jul 17 10:53:15.633157 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:53:15.633090    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 17 10:53:15.633157 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:53:15.633126    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcacde69-b0da-4aa1-8d6b-f9a248008f6e-cluster-monitoring-operator-tls podName:bcacde69-b0da-4aa1-8d6b-f9a248008f6e nodeName:}" failed. No retries permitted until 2026-07-17 10:53:16.133115146 +0000 UTC m=+61.314148086 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bcacde69-b0da-4aa1-8d6b-f9a248008f6e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-lh2pk" (UID: "bcacde69-b0da-4aa1-8d6b-f9a248008f6e") : secret "cluster-monitoring-operator-tls" not found
Jul 17 10:53:15.633569 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:15.633554    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bcacde69-b0da-4aa1-8d6b-f9a248008f6e-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-lh2pk\" (UID: \"bcacde69-b0da-4aa1-8d6b-f9a248008f6e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-lh2pk"
Jul 17 10:53:15.643619 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:15.643596    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vp57\" (UniqueName: \"kubernetes.io/projected/bcacde69-b0da-4aa1-8d6b-f9a248008f6e-kube-api-access-9vp57\") pod \"cluster-monitoring-operator-76cf8966f8-lh2pk\" (UID: \"bcacde69-b0da-4aa1-8d6b-f9a248008f6e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-lh2pk"
Jul 17 10:53:15.674547 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:15.674529    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4xqz9"
Jul 17 10:53:15.830982 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:15.830949    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4xqz9"]
Jul 17 10:53:15.832829 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:53:15.832803    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fa4781c_bff5_45e6_89fd_5192794e108d.slice/crio-429b64c1934ae3f7694975215744b07d733c728b0f087e7cf9142e9be127f942 WatchSource:0}: Error finding container 429b64c1934ae3f7694975215744b07d733c728b0f087e7cf9142e9be127f942: Status 404 returned error can't find the container with id 429b64c1934ae3f7694975215744b07d733c728b0f087e7cf9142e9be127f942
Jul 17 10:53:16.136151 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:16.136125    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bcacde69-b0da-4aa1-8d6b-f9a248008f6e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-lh2pk\" (UID: \"bcacde69-b0da-4aa1-8d6b-f9a248008f6e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-lh2pk"
Jul 17 10:53:16.136277 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:53:16.136260    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 17 10:53:16.136335 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:53:16.136326    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcacde69-b0da-4aa1-8d6b-f9a248008f6e-cluster-monitoring-operator-tls podName:bcacde69-b0da-4aa1-8d6b-f9a248008f6e nodeName:}" failed. No retries permitted until 2026-07-17 10:53:17.13631147 +0000 UTC m=+62.317344410 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bcacde69-b0da-4aa1-8d6b-f9a248008f6e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-lh2pk" (UID: "bcacde69-b0da-4aa1-8d6b-f9a248008f6e") : secret "cluster-monitoring-operator-tls" not found
Jul 17 10:53:16.486873 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:16.486849    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xdrhl"
Jul 17 10:53:16.551957 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:16.551923    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4xqz9" event={"ID":"8fa4781c-bff5-45e6-89fd-5192794e108d","Type":"ContainerStarted","Data":"429b64c1934ae3f7694975215744b07d733c728b0f087e7cf9142e9be127f942"}
Jul 17 10:53:17.143298 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:17.143265    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bcacde69-b0da-4aa1-8d6b-f9a248008f6e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-lh2pk\" (UID: \"bcacde69-b0da-4aa1-8d6b-f9a248008f6e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-lh2pk"
Jul 17 10:53:17.143521 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:53:17.143465    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 17 10:53:17.143573 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:53:17.143540    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcacde69-b0da-4aa1-8d6b-f9a248008f6e-cluster-monitoring-operator-tls podName:bcacde69-b0da-4aa1-8d6b-f9a248008f6e nodeName:}" failed. No retries permitted until 2026-07-17 10:53:19.143520029 +0000 UTC m=+64.324552975 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bcacde69-b0da-4aa1-8d6b-f9a248008f6e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-lh2pk" (UID: "bcacde69-b0da-4aa1-8d6b-f9a248008f6e") : secret "cluster-monitoring-operator-tls" not found
Jul 17 10:53:17.221832 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:17.221805    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-46cc2"]
Jul 17 10:53:17.223813 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:17.223792    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-46cc2"
Jul 17 10:53:17.227025 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:17.227008    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-vc6jt\""
Jul 17 10:53:17.234058 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:17.234022    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-46cc2"]
Jul 17 10:53:17.244315 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:17.244296    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txrzt\" (UniqueName: \"kubernetes.io/projected/fe3d1edc-4a04-4644-9309-f1e246884593-kube-api-access-txrzt\") pod \"network-check-source-7bc5b6bf85-46cc2\" (UID: \"fe3d1edc-4a04-4644-9309-f1e246884593\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-46cc2"
Jul 17 10:53:17.345361 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:17.345319    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txrzt\" (UniqueName: \"kubernetes.io/projected/fe3d1edc-4a04-4644-9309-f1e246884593-kube-api-access-txrzt\") pod \"network-check-source-7bc5b6bf85-46cc2\" (UID: \"fe3d1edc-4a04-4644-9309-f1e246884593\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-46cc2"
Jul 17 10:53:17.354000 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:17.353971    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 17 10:53:17.364346 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:17.364324    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 17 10:53:17.375027 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:17.375007    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txrzt\" (UniqueName: \"kubernetes.io/projected/fe3d1edc-4a04-4644-9309-f1e246884593-kube-api-access-txrzt\") pod \"network-check-source-7bc5b6bf85-46cc2\" (UID: \"fe3d1edc-4a04-4644-9309-f1e246884593\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-46cc2"
Jul 17 10:53:17.532979 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:17.532916    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-46cc2"
Jul 17 10:53:17.656666 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:17.656640    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-46cc2"]
Jul 17 10:53:17.660175 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:53:17.660145    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe3d1edc_4a04_4644_9309_f1e246884593.slice/crio-1da410ff294df60b9f2c31dd73de52558ba78cf573b2cd6318b855337491b1a4 WatchSource:0}: Error finding container 1da410ff294df60b9f2c31dd73de52558ba78cf573b2cd6318b855337491b1a4: Status 404 returned error can't find the container with id 1da410ff294df60b9f2c31dd73de52558ba78cf573b2cd6318b855337491b1a4
Jul 17 10:53:18.557441 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:18.557394    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4xqz9" event={"ID":"8fa4781c-bff5-45e6-89fd-5192794e108d","Type":"ContainerStarted","Data":"6d6223afb4d0d45b362d000aa6a03b3b6da2dec8914d40f91c8655a4354bf0e7"}
Jul 17 10:53:18.558668 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:18.558639    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-46cc2" event={"ID":"fe3d1edc-4a04-4644-9309-f1e246884593","Type":"ContainerStarted","Data":"1da410ff294df60b9f2c31dd73de52558ba78cf573b2cd6318b855337491b1a4"}
Jul 17 10:53:18.580495 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:18.580419    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4xqz9" podStartSLOduration=1.867900662 podStartE2EDuration="3.58039994s" totalImagesPullingTime="1.712499278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:53:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:53:18.579532614 +0000 UTC m=+63.760565575" watchObservedRunningTime="2026-07-17 10:53:18.58039994 +0000 UTC m=+63.761432903"
Jul 17 10:53:19.159691 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:19.159660    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bcacde69-b0da-4aa1-8d6b-f9a248008f6e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-lh2pk\" (UID: \"bcacde69-b0da-4aa1-8d6b-f9a248008f6e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-lh2pk"
Jul 17 10:53:19.159857 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:53:19.159822    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 17 10:53:19.159916 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:53:19.159903    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcacde69-b0da-4aa1-8d6b-f9a248008f6e-cluster-monitoring-operator-tls podName:bcacde69-b0da-4aa1-8d6b-f9a248008f6e nodeName:}" failed. No retries permitted until 2026-07-17 10:53:23.159882211 +0000 UTC m=+68.340915156 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bcacde69-b0da-4aa1-8d6b-f9a248008f6e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-lh2pk" (UID: "bcacde69-b0da-4aa1-8d6b-f9a248008f6e") : secret "cluster-monitoring-operator-tls" not found
Jul 17 10:53:19.846218 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:19.846184    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6c2kv"]
Jul 17 10:53:19.849623 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:19.849582    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6c2kv"
Jul 17 10:53:19.852115 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:19.852092    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 17 10:53:19.852359 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:19.852322    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 17 10:53:19.852359 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:19.852350    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 17 10:53:19.853234 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:19.853198    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 17 10:53:19.853234 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:19.853209    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-x57x9\""
Jul 17 10:53:19.863195 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:19.863116    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6c2kv"]
Jul 17 10:53:19.865292 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:19.865269    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-data-volume\") pod \"insights-runtime-extractor-6c2kv\" (UID: \"f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1\") " pod="openshift-insights/insights-runtime-extractor-6c2kv"
Jul 17 10:53:19.865387 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:19.865341    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl548\" (UniqueName: \"kubernetes.io/projected/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-kube-api-access-jl548\") pod \"insights-runtime-extractor-6c2kv\" (UID: \"f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1\") " pod="openshift-insights/insights-runtime-extractor-6c2kv"
Jul 17 10:53:19.865387 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:19.865375    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-crio-socket\") pod \"insights-runtime-extractor-6c2kv\" (UID: \"f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1\") " pod="openshift-insights/insights-runtime-extractor-6c2kv"
Jul 17 10:53:19.865903 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:19.865398    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6c2kv\" (UID: \"f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1\") " pod="openshift-insights/insights-runtime-extractor-6c2kv"
Jul 17 10:53:19.865903 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:19.865423    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6c2kv\" (UID: \"f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1\") " pod="openshift-insights/insights-runtime-extractor-6c2kv"
Jul 17 10:53:19.966606 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:19.966580    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl548\" (UniqueName: \"kubernetes.io/projected/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-kube-api-access-jl548\") pod \"insights-runtime-extractor-6c2kv\" (UID: \"f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1\") " pod="openshift-insights/insights-runtime-extractor-6c2kv"
Jul 17 10:53:19.966739 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:19.966615    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-crio-socket\") pod \"insights-runtime-extractor-6c2kv\" (UID: \"f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1\") " pod="openshift-insights/insights-runtime-extractor-6c2kv"
Jul 17 10:53:19.966739 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:19.966630    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6c2kv\" (UID: \"f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1\") " pod="openshift-insights/insights-runtime-extractor-6c2kv"
Jul 17 10:53:19.966739 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:19.966645    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6c2kv\" (UID: \"f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1\") " pod="openshift-insights/insights-runtime-extractor-6c2kv"
Jul 17 10:53:19.966739 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:19.966720    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-data-volume\") pod \"insights-runtime-extractor-6c2kv\" (UID: \"f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1\") " pod="openshift-insights/insights-runtime-extractor-6c2kv"
Jul 17 10:53:19.966739 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:19.966724    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-crio-socket\") pod \"insights-runtime-extractor-6c2kv\" (UID: \"f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1\") " pod="openshift-insights/insights-runtime-extractor-6c2kv"
Jul 17 10:53:19.966968 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:53:19.966863    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 10:53:19.966968 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:53:19.966923    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-insights-runtime-extractor-tls podName:f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:20.466904359 +0000 UTC m=+65.647937302 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6c2kv" (UID: "f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1") : secret "insights-runtime-extractor-tls" not found
Jul 17 10:53:19.967084 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:53:19.967069    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 10:53:19.967137 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:53:19.967129    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-kube-rbac-proxy-cm podName:f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:20.467115729 +0000 UTC m=+65.648148677 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6c2kv" (UID: "f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1") : configmap "kube-rbac-proxy" not found
Jul 17 10:53:19.967236 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:19.967220    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-data-volume\") pod \"insights-runtime-extractor-6c2kv\" (UID: \"f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1\") " pod="openshift-insights/insights-runtime-extractor-6c2kv"
Jul 17 10:53:19.979344 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:19.979323    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl548\" (UniqueName: \"kubernetes.io/projected/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-kube-api-access-jl548\") pod \"insights-runtime-extractor-6c2kv\" (UID: \"f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1\") " pod="openshift-insights/insights-runtime-extractor-6c2kv"
Jul 17 10:53:20.470409 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:20.470385    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6c2kv\" (UID: \"f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1\") " pod="openshift-insights/insights-runtime-extractor-6c2kv"
Jul 17 10:53:20.470518 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:20.470416    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6c2kv\" (UID: \"f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1\") " pod="openshift-insights/insights-runtime-extractor-6c2kv"
Jul 17 10:53:20.470559 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:53:20.470524    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 10:53:20.470591 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:53:20.470564    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-insights-runtime-extractor-tls podName:f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:21.470552288 +0000 UTC m=+66.651585231 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6c2kv" (UID: "f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1") : secret "insights-runtime-extractor-tls" not found
Jul 17 10:53:20.470644 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:53:20.470521    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 10:53:20.470682 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:53:20.470664    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-kube-rbac-proxy-cm podName:f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:21.470645885 +0000 UTC m=+66.651678826 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6c2kv" (UID: "f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1") : configmap "kube-rbac-proxy" not found
Jul 17 10:53:20.565712 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:20.565691    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-46cc2" event={"ID":"fe3d1edc-4a04-4644-9309-f1e246884593","Type":"ContainerStarted","Data":"83a4f7ef2e96ea76c49309b2ccfbc67a1891113417364a761da5f543e44bead5"}
Jul 17 10:53:20.583441 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:20.583394    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-46cc2" podStartSLOduration=0.849873768 podStartE2EDuration="3.5833809s" totalImagesPullingTime="2.733507132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:53:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:53:20.582654549 +0000 UTC m=+65.763687570" watchObservedRunningTime="2026-07-17 10:53:20.5833809 +0000 UTC m=+65.764413840"
Jul 17 10:53:20.651006 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:20.650956    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-wzr45"]
Jul 17 10:53:20.652675 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:20.652661    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-wzr45"
Jul 17 10:53:20.655144 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:20.655124    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 17 10:53:20.655300 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:20.655283    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 17 10:53:20.655463 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:20.655317    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 17 10:53:20.655463 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:20.655355    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 17 10:53:20.655463 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:20.655422    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-rjh8x\""
Jul 17 10:53:20.661346 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:20.661329    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-wzr45"]
Jul 17 10:53:20.671852 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:20.671828    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f30123c9-6a0a-4885-9b89-d4e35dab5de8-signing-key\") pod \"service-ca-58598695f7-wzr45\" (UID: \"f30123c9-6a0a-4885-9b89-d4e35dab5de8\") " pod="openshift-service-ca/service-ca-58598695f7-wzr45"
Jul 17 10:53:20.671975 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:20.671961    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f30123c9-6a0a-4885-9b89-d4e35dab5de8-signing-cabundle\") pod \"service-ca-58598695f7-wzr45\" (UID: \"f30123c9-6a0a-4885-9b89-d4e35dab5de8\") " pod="openshift-service-ca/service-ca-58598695f7-wzr45"
Jul 17 10:53:20.672018 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:20.672007    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwbfx\" (UniqueName: \"kubernetes.io/projected/f30123c9-6a0a-4885-9b89-d4e35dab5de8-kube-api-access-qwbfx\") pod \"service-ca-58598695f7-wzr45\" (UID: \"f30123c9-6a0a-4885-9b89-d4e35dab5de8\") " pod="openshift-service-ca/service-ca-58598695f7-wzr45"
Jul 17 10:53:20.772489 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:20.772467    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f30123c9-6a0a-4885-9b89-d4e35dab5de8-signing-key\") pod \"service-ca-58598695f7-wzr45\" (UID: \"f30123c9-6a0a-4885-9b89-d4e35dab5de8\") " pod="openshift-service-ca/service-ca-58598695f7-wzr45"
Jul 17 10:53:20.772566 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:20.772518    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f30123c9-6a0a-4885-9b89-d4e35dab5de8-signing-cabundle\") pod \"service-ca-58598695f7-wzr45\" (UID: \"f30123c9-6a0a-4885-9b89-d4e35dab5de8\") " pod="openshift-service-ca/service-ca-58598695f7-wzr45"
Jul 17 10:53:20.772680 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:20.772657    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwbfx\" (UniqueName: \"kubernetes.io/projected/f30123c9-6a0a-4885-9b89-d4e35dab5de8-kube-api-access-qwbfx\") pod \"service-ca-58598695f7-wzr45\" (UID: \"f30123c9-6a0a-4885-9b89-d4e35dab5de8\") " pod="openshift-service-ca/service-ca-58598695f7-wzr45"
Jul 17 10:53:20.773100 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:20.773073    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f30123c9-6a0a-4885-9b89-d4e35dab5de8-signing-cabundle\") pod \"service-ca-58598695f7-wzr45\" (UID: \"f30123c9-6a0a-4885-9b89-d4e35dab5de8\") " pod="openshift-service-ca/service-ca-58598695f7-wzr45"
Jul 17 10:53:20.774656 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:20.774640    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f30123c9-6a0a-4885-9b89-d4e35dab5de8-signing-key\") pod \"service-ca-58598695f7-wzr45\" (UID: \"f30123c9-6a0a-4885-9b89-d4e35dab5de8\") " pod="openshift-service-ca/service-ca-58598695f7-wzr45"
Jul 17 10:53:20.781669 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:20.781646    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwbfx\" (UniqueName: \"kubernetes.io/projected/f30123c9-6a0a-4885-9b89-d4e35dab5de8-kube-api-access-qwbfx\") pod \"service-ca-58598695f7-wzr45\" (UID: \"f30123c9-6a0a-4885-9b89-d4e35dab5de8\") " pod="openshift-service-ca/service-ca-58598695f7-wzr45"
Jul 17 10:53:20.963292 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:20.963246    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-wzr45"
Jul 17 10:53:21.075077 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:21.075053    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8037abbc-75d6-42df-9cad-5c1340e0341e-metrics-certs\") pod \"network-metrics-daemon-mdvfl\" (UID: \"8037abbc-75d6-42df-9cad-5c1340e0341e\") " pod="openshift-multus/network-metrics-daemon-mdvfl"
Jul 17 10:53:21.075200 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:21.075106    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca964baf-243f-4cb7-a20e-3c802e627f2c-original-pull-secret\") pod \"global-pull-secret-syncer-tw6nz\" (UID: \"ca964baf-243f-4cb7-a20e-3c802e627f2c\") " pod="kube-system/global-pull-secret-syncer-tw6nz"
Jul 17 10:53:21.077539 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:21.077522    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 17 10:53:21.077584 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:21.077567    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 17 10:53:21.083658 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:21.083636    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-wzr45"]
Jul 17 10:53:21.085757 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:53:21.085740    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 17 10:53:21.085833 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:53:21.085810    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8037abbc-75d6-42df-9cad-5c1340e0341e-metrics-certs podName:8037abbc-75d6-42df-9cad-5c1340e0341e nodeName:}" failed. No retries permitted until 2026-07-17 10:54:25.085789563 +0000 UTC m=+130.266822524 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8037abbc-75d6-42df-9cad-5c1340e0341e-metrics-certs") pod "network-metrics-daemon-mdvfl" (UID: "8037abbc-75d6-42df-9cad-5c1340e0341e") : secret "metrics-daemon-secret" not found
Jul 17 10:53:21.087388 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:53:21.087360    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf30123c9_6a0a_4885_9b89_d4e35dab5de8.slice/crio-b5dfd79ce6cf0c704caaceec009480f1d30c0a1d4a132b5a8164c91b2758320f WatchSource:0}: Error finding container b5dfd79ce6cf0c704caaceec009480f1d30c0a1d4a132b5a8164c91b2758320f: Status 404 returned error can't find the container with id b5dfd79ce6cf0c704caaceec009480f1d30c0a1d4a132b5a8164c91b2758320f
Jul 17 10:53:21.087878 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:21.087856    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca964baf-243f-4cb7-a20e-3c802e627f2c-original-pull-secret\") pod \"global-pull-secret-syncer-tw6nz\" (UID: \"ca964baf-243f-4cb7-a20e-3c802e627f2c\") " pod="kube-system/global-pull-secret-syncer-tw6nz"
Jul 17 10:53:21.170650 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:21.170545    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tw6nz"
Jul 17 10:53:21.176678 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:21.176144    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqvqj\" (UniqueName: \"kubernetes.io/projected/ccf5dfd9-3981-4994-98cc-2edbc2b755b6-kube-api-access-pqvqj\") pod \"network-check-target-t9qnx\" (UID: \"ccf5dfd9-3981-4994-98cc-2edbc2b755b6\") " pod="openshift-network-diagnostics/network-check-target-t9qnx"
Jul 17 10:53:21.181366 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:21.181343    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqvqj\" (UniqueName: \"kubernetes.io/projected/ccf5dfd9-3981-4994-98cc-2edbc2b755b6-kube-api-access-pqvqj\") pod \"network-check-target-t9qnx\" (UID: \"ccf5dfd9-3981-4994-98cc-2edbc2b755b6\") " pod="openshift-network-diagnostics/network-check-target-t9qnx"
Jul 17 10:53:21.298353 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:21.298319    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tw6nz"]
Jul 17 10:53:21.300601 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:53:21.300567    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca964baf_243f_4cb7_a20e_3c802e627f2c.slice/crio-ce2d21ac8064fcc999aee2403086d28a90486b46d3c7507f19e02e18f6b7bb88 WatchSource:0}: Error finding container ce2d21ac8064fcc999aee2403086d28a90486b46d3c7507f19e02e18f6b7bb88: Status 404 returned error can't find the container with id ce2d21ac8064fcc999aee2403086d28a90486b46d3c7507f19e02e18f6b7bb88
Jul 17 10:53:21.478662 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:21.478608    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gt9xr\""
Jul 17 10:53:21.478752 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:21.478694    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6c2kv\" (UID: \"f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1\") " pod="openshift-insights/insights-runtime-extractor-6c2kv"
Jul 17 10:53:21.478752 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:21.478734    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6c2kv\" (UID: \"f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1\") " pod="openshift-insights/insights-runtime-extractor-6c2kv"
Jul 17 10:53:21.478839 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:53:21.478751    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 10:53:21.478839 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:53:21.478801    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-kube-rbac-proxy-cm podName:f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:23.478785238 +0000 UTC m=+68.659818178 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6c2kv" (UID: "f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1") : configmap "kube-rbac-proxy" not found
Jul 17 10:53:21.478919 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:53:21.478869    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 10:53:21.478952 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:53:21.478920    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-insights-runtime-extractor-tls podName:f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:23.478905991 +0000 UTC m=+68.659938933 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6c2kv" (UID: "f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1") : secret "insights-runtime-extractor-tls" not found
Jul 17 10:53:21.486852 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:21.486831    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9qnx"
Jul 17 10:53:21.569877 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:21.569842    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-wzr45" event={"ID":"f30123c9-6a0a-4885-9b89-d4e35dab5de8","Type":"ContainerStarted","Data":"176883ae8a19578acb05fc355e0d7b4cabfe25b7f68936e7176af6f63ed7ed5c"}
Jul 17 10:53:21.570000 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:21.569900    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-wzr45" event={"ID":"f30123c9-6a0a-4885-9b89-d4e35dab5de8","Type":"ContainerStarted","Data":"b5dfd79ce6cf0c704caaceec009480f1d30c0a1d4a132b5a8164c91b2758320f"}
Jul 17 10:53:21.571379 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:21.571354    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tw6nz" event={"ID":"ca964baf-243f-4cb7-a20e-3c802e627f2c","Type":"ContainerStarted","Data":"ce2d21ac8064fcc999aee2403086d28a90486b46d3c7507f19e02e18f6b7bb88"}
Jul 17 10:53:21.595241 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:21.594891    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-wzr45" podStartSLOduration=1.594871832 podStartE2EDuration="1.594871832s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:53:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:53:21.593797571 +0000 UTC m=+66.774830535" watchObservedRunningTime="2026-07-17 10:53:21.594871832 +0000 UTC m=+66.775904795"
Jul 17 10:53:21.609462 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:21.609441    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t9qnx"]
Jul 17 10:53:21.611931 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:53:21.611909    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccf5dfd9_3981_4994_98cc_2edbc2b755b6.slice/crio-e32078271b264d5671d7094a2bd80f1ace74b0492e45cbff277a095ed503bfbb WatchSource:0}: Error finding container e32078271b264d5671d7094a2bd80f1ace74b0492e45cbff277a095ed503bfbb: Status 404 returned error can't find the container with id e32078271b264d5671d7094a2bd80f1ace74b0492e45cbff277a095ed503bfbb
Jul 17 10:53:22.054988 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:22.054964    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rsv5j_a90ca9ac-e3c6-452c-89d5-64d3f4c9b1e9/dns-node-resolver/0.log"
Jul 17 10:53:22.083387 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:22.083358    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-registry-tls\") pod \"image-registry-7bc89448c5-j2z9h\" (UID: \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\") " pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h"
Jul 17 10:53:22.083518 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:22.083425    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/619f03dd-a502-4c49-a66d-496a29102121-metrics-tls\") pod \"dns-default-kfp4f\" (UID: \"619f03dd-a502-4c49-a66d-496a29102121\") " pod="openshift-dns/dns-default-kfp4f"
Jul 17 10:53:22.083591 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:53:22.083533    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 10:53:22.083591 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:53:22.083553    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bc89448c5-j2z9h: secret "image-registry-tls" not found
Jul 17 10:53:22.083591 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:53:22.083567    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 10:53:22.083721 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:53:22.083614    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-registry-tls podName:e652b2b1-5807-4dfd-bc88-0673b2c5d8a8 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:54.08359606 +0000 UTC m=+99.264629013 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-registry-tls") pod "image-registry-7bc89448c5-j2z9h" (UID: "e652b2b1-5807-4dfd-bc88-0673b2c5d8a8") : secret "image-registry-tls" not found
Jul 17 10:53:22.083721 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:53:22.083632    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/619f03dd-a502-4c49-a66d-496a29102121-metrics-tls podName:619f03dd-a502-4c49-a66d-496a29102121 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:54.083622089 +0000 UTC m=+99.264655033 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/619f03dd-a502-4c49-a66d-496a29102121-metrics-tls") pod "dns-default-kfp4f" (UID: "619f03dd-a502-4c49-a66d-496a29102121") : secret "dns-default-metrics-tls" not found
Jul 17 10:53:22.577220 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:22.577184    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t9qnx" event={"ID":"ccf5dfd9-3981-4994-98cc-2edbc2b755b6","Type":"ContainerStarted","Data":"f57dd11993f784b5c8b440d1c99f81516b6e4aebcd39a32b06dc34dc1562f3f5"}
Jul 17 10:53:22.577400 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:22.577243    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t9qnx" event={"ID":"ccf5dfd9-3981-4994-98cc-2edbc2b755b6","Type":"ContainerStarted","Data":"e32078271b264d5671d7094a2bd80f1ace74b0492e45cbff277a095ed503bfbb"}
Jul 17 10:53:22.577400 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:22.577290    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-t9qnx"
Jul 17 10:53:22.596121 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:22.596075    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-t9qnx" podStartSLOduration=66.596061664 podStartE2EDuration="1m6.596061664s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:52:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:53:22.595338979 +0000 UTC m=+67.776371937" watchObservedRunningTime="2026-07-17 10:53:22.596061664 +0000 UTC m=+67.777094615"
Jul 17 10:53:23.056923 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:23.056837    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bpdts_d1260e44-4d64-4569-b0ce-78f616f8b412/node-ca/0.log"
Jul 17 10:53:23.196347 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:23.195643    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bcacde69-b0da-4aa1-8d6b-f9a248008f6e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-lh2pk\" (UID: \"bcacde69-b0da-4aa1-8d6b-f9a248008f6e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-lh2pk"
Jul 17 10:53:23.196347 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:53:23.195834    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 17 10:53:23.196347 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:53:23.195895    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcacde69-b0da-4aa1-8d6b-f9a248008f6e-cluster-monitoring-operator-tls podName:bcacde69-b0da-4aa1-8d6b-f9a248008f6e nodeName:}" failed. No retries permitted until 2026-07-17 10:53:31.195877562 +0000 UTC m=+76.376910505 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bcacde69-b0da-4aa1-8d6b-f9a248008f6e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-lh2pk" (UID: "bcacde69-b0da-4aa1-8d6b-f9a248008f6e") : secret "cluster-monitoring-operator-tls" not found
Jul 17 10:53:23.498154 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:23.498117    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6c2kv\" (UID: \"f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1\") " pod="openshift-insights/insights-runtime-extractor-6c2kv"
Jul 17 10:53:23.498329 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:23.498164    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6c2kv\" (UID: \"f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1\") " pod="openshift-insights/insights-runtime-extractor-6c2kv"
Jul 17 10:53:23.498329 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:53:23.498291    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 10:53:23.498463 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:53:23.498364    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-insights-runtime-extractor-tls podName:f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:27.498346244 +0000 UTC m=+72.679379184 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6c2kv" (UID: "f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1") : secret "insights-runtime-extractor-tls" not found
Jul 17 10:53:23.498670 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:53:23.498593    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 10:53:23.498670 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:53:23.498648    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-kube-rbac-proxy-cm podName:f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:27.498632642 +0000 UTC m=+72.679665587 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6c2kv" (UID: "f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1") : configmap "kube-rbac-proxy" not found
Jul 17 10:53:23.654863 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:23.654804    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j4xv5_87ba2b7a-cc06-4d60-af20-e8eb0c16b840/serve-healthcheck-canary/0.log"
Jul 17 10:53:26.592460 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:26.592413    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tw6nz" event={"ID":"ca964baf-243f-4cb7-a20e-3c802e627f2c","Type":"ContainerStarted","Data":"f7a97de2a18fec0c3a202e5b37a991d3fd2200a2cc8b9880c447f599fa872eb2"}
Jul 17 10:53:26.609037 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:26.608987    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tw6nz" podStartSLOduration=66.160482128 podStartE2EDuration="1m10.608971482s" totalImagesPullingTime="4.448489354s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:52:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:53:26.608804843 +0000 UTC m=+71.789837804" watchObservedRunningTime="2026-07-17 10:53:26.608971482 +0000 UTC m=+71.790004443"
Jul 17 10:53:27.526686 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:27.526661    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6c2kv\" (UID: \"f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1\") " pod="openshift-insights/insights-runtime-extractor-6c2kv"
Jul 17 10:53:27.526865 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:27.526690    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6c2kv\" (UID: \"f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1\") " pod="openshift-insights/insights-runtime-extractor-6c2kv"
Jul 17 10:53:27.526865 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:53:27.526768    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 10:53:27.526865 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:53:27.526779    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 10:53:27.526865 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:53:27.526818    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-insights-runtime-extractor-tls podName:f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:35.52680694 +0000 UTC m=+80.707839880 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6c2kv" (UID: "f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1") : secret "insights-runtime-extractor-tls" not found
Jul 17 10:53:27.526865 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:53:27.526829    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-kube-rbac-proxy-cm podName:f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:35.526823317 +0000 UTC m=+80.707856257 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6c2kv" (UID: "f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1") : configmap "kube-rbac-proxy" not found
Jul 17 10:53:31.255146 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:31.255115    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bcacde69-b0da-4aa1-8d6b-f9a248008f6e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-lh2pk\" (UID: \"bcacde69-b0da-4aa1-8d6b-f9a248008f6e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-lh2pk"
Jul 17 10:53:31.257374 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:31.257356    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bcacde69-b0da-4aa1-8d6b-f9a248008f6e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-lh2pk\" (UID: \"bcacde69-b0da-4aa1-8d6b-f9a248008f6e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-lh2pk"
Jul 17 10:53:31.400859 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:31.400827    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-lh2pk"
Jul 17 10:53:31.517643 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:31.517475    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-lh2pk"]
Jul 17 10:53:31.519896 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:53:31.519871    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcacde69_b0da_4aa1_8d6b_f9a248008f6e.slice/crio-3f00c844b86962227cb78d9eea17f5b4cdb5ed2ae8c2a3f3009ae37f26bedd2b WatchSource:0}: Error finding container 3f00c844b86962227cb78d9eea17f5b4cdb5ed2ae8c2a3f3009ae37f26bedd2b: Status 404 returned error can't find the container with id 3f00c844b86962227cb78d9eea17f5b4cdb5ed2ae8c2a3f3009ae37f26bedd2b
Jul 17 10:53:31.605361 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:31.605332    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-lh2pk" event={"ID":"bcacde69-b0da-4aa1-8d6b-f9a248008f6e","Type":"ContainerStarted","Data":"3f00c844b86962227cb78d9eea17f5b4cdb5ed2ae8c2a3f3009ae37f26bedd2b"}
Jul 17 10:53:33.612216 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:33.612180    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-lh2pk" event={"ID":"bcacde69-b0da-4aa1-8d6b-f9a248008f6e","Type":"ContainerStarted","Data":"2f49bab491604dec1a5954f41c27c4ddb3edb7d34d1135753621c6261be8ae2e"}
Jul 17 10:53:33.628535 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:33.628484    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-lh2pk" podStartSLOduration=16.708366324 podStartE2EDuration="18.628470213s" totalImagesPullingTime="1.920103889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:53:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:53:33.627786366 +0000 UTC m=+78.808819345" watchObservedRunningTime="2026-07-17 10:53:33.628470213 +0000 UTC m=+78.809503170"
Jul 17 10:53:35.587040 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:35.587011    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6c2kv\" (UID: \"f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1\") " pod="openshift-insights/insights-runtime-extractor-6c2kv"
Jul 17 10:53:35.587040 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:35.587045    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6c2kv\" (UID: \"f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1\") " pod="openshift-insights/insights-runtime-extractor-6c2kv"
Jul 17 10:53:35.587610 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:35.587582    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6c2kv\" (UID: \"f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1\") " pod="openshift-insights/insights-runtime-extractor-6c2kv"
Jul 17 10:53:35.589167 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:35.589146    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6c2kv\" (UID: \"f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1\") " pod="openshift-insights/insights-runtime-extractor-6c2kv"
Jul 17 10:53:35.761350 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:35.761330    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6c2kv"
Jul 17 10:53:35.896458 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:35.895136    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6c2kv"]
Jul 17 10:53:35.899779 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:53:35.899756    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf47b99d3_9f53_4a91_ac2b_e4ee8ea7c6d1.slice/crio-95cc6874ccf6b835bad8589920403ddd69dadf97a5d07344a8610f5e2360dc54 WatchSource:0}: Error finding container 95cc6874ccf6b835bad8589920403ddd69dadf97a5d07344a8610f5e2360dc54: Status 404 returned error can't find the container with id 95cc6874ccf6b835bad8589920403ddd69dadf97a5d07344a8610f5e2360dc54
Jul 17 10:53:36.623657 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:36.623611    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6c2kv" event={"ID":"f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1","Type":"ContainerStarted","Data":"95cc6874ccf6b835bad8589920403ddd69dadf97a5d07344a8610f5e2360dc54"}
Jul 17 10:53:40.640795 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:40.640766    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6c2kv" event={"ID":"f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1","Type":"ContainerStarted","Data":"e6afbe1f2cc2ab7f0443186dd847186a2fb0f63286ce04d24e71e4c2ab30bb05"}
Jul 17 10:53:42.022972 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:42.022939    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57fb68494f-pgpsg"]
Jul 17 10:53:42.033022 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:42.032997    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57fb68494f-pgpsg"
Jul 17 10:53:42.035722 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:42.035694    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 17 10:53:42.036508 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:42.036483    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 17 10:53:42.036629 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:42.036527    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 17 10:53:42.036906 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:42.036874    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 17 10:53:42.036906 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:42.036902    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 17 10:53:42.037459 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:42.037423    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 17 10:53:42.037554 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:42.037512    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 17 10:53:42.064062 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:42.064013    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57fb68494f-pgpsg"]
Jul 17 10:53:42.139492 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:42.139464    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b946c194-2daa-4008-9ff6-566ce33da17e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-57fb68494f-pgpsg\" (UID: \"b946c194-2daa-4008-9ff6-566ce33da17e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57fb68494f-pgpsg"
Jul 17 10:53:42.139787 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:42.139521    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmbnh\" (UniqueName: \"kubernetes.io/projected/b946c194-2daa-4008-9ff6-566ce33da17e-kube-api-access-bmbnh\") pod \"cluster-proxy-proxy-agent-57fb68494f-pgpsg\" (UID: \"b946c194-2daa-4008-9ff6-566ce33da17e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57fb68494f-pgpsg"
Jul 17 10:53:42.139787 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:42.139735    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b946c194-2daa-4008-9ff6-566ce33da17e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-57fb68494f-pgpsg\" (UID: \"b946c194-2daa-4008-9ff6-566ce33da17e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57fb68494f-pgpsg"
Jul 17 10:53:42.139899 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:42.139832    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b946c194-2daa-4008-9ff6-566ce33da17e-hub\") pod \"cluster-proxy-proxy-agent-57fb68494f-pgpsg\" (UID: \"b946c194-2daa-4008-9ff6-566ce33da17e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57fb68494f-pgpsg"
Jul 17 10:53:42.139899 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:42.139881    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b946c194-2daa-4008-9ff6-566ce33da17e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-57fb68494f-pgpsg\" (UID: \"b946c194-2daa-4008-9ff6-566ce33da17e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57fb68494f-pgpsg"
Jul 17 10:53:42.139984 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:42.139905    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b946c194-2daa-4008-9ff6-566ce33da17e-ca\") pod \"cluster-proxy-proxy-agent-57fb68494f-pgpsg\" (UID: \"b946c194-2daa-4008-9ff6-566ce33da17e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57fb68494f-pgpsg"
Jul 17 10:53:42.240991 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:42.240965    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b946c194-2daa-4008-9ff6-566ce33da17e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-57fb68494f-pgpsg\" (UID: \"b946c194-2daa-4008-9ff6-566ce33da17e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57fb68494f-pgpsg"
Jul 17 10:53:42.241098 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:42.241039    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b946c194-2daa-4008-9ff6-566ce33da17e-hub\") pod \"cluster-proxy-proxy-agent-57fb68494f-pgpsg\" (UID: \"b946c194-2daa-4008-9ff6-566ce33da17e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57fb68494f-pgpsg"
Jul 17 10:53:42.241098 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:42.241070    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b946c194-2daa-4008-9ff6-566ce33da17e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-57fb68494f-pgpsg\" (UID: \"b946c194-2daa-4008-9ff6-566ce33da17e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57fb68494f-pgpsg"
Jul 17 10:53:42.241098 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:42.241087    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b946c194-2daa-4008-9ff6-566ce33da17e-ca\") pod \"cluster-proxy-proxy-agent-57fb68494f-pgpsg\" (UID: \"b946c194-2daa-4008-9ff6-566ce33da17e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57fb68494f-pgpsg"
Jul 17 10:53:42.241247 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:42.241111    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b946c194-2daa-4008-9ff6-566ce33da17e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-57fb68494f-pgpsg\" (UID: \"b946c194-2daa-4008-9ff6-566ce33da17e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57fb68494f-pgpsg"
Jul 17 10:53:42.241247 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:42.241176    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmbnh\" (UniqueName: \"kubernetes.io/projected/b946c194-2daa-4008-9ff6-566ce33da17e-kube-api-access-bmbnh\") pod \"cluster-proxy-proxy-agent-57fb68494f-pgpsg\" (UID: \"b946c194-2daa-4008-9ff6-566ce33da17e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57fb68494f-pgpsg"
Jul 17 10:53:42.241910 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:42.241871    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b946c194-2daa-4008-9ff6-566ce33da17e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-57fb68494f-pgpsg\" (UID: \"b946c194-2daa-4008-9ff6-566ce33da17e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57fb68494f-pgpsg"
Jul 17 10:53:42.243940 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:42.243881    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b946c194-2daa-4008-9ff6-566ce33da17e-ca\") pod \"cluster-proxy-proxy-agent-57fb68494f-pgpsg\" (UID: \"b946c194-2daa-4008-9ff6-566ce33da17e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57fb68494f-pgpsg"
Jul 17 10:53:42.244046 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:42.243942    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b946c194-2daa-4008-9ff6-566ce33da17e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-57fb68494f-pgpsg\" (UID: \"b946c194-2daa-4008-9ff6-566ce33da17e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57fb68494f-pgpsg"
Jul 17 10:53:42.244046 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:42.243993    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b946c194-2daa-4008-9ff6-566ce33da17e-hub\") pod \"cluster-proxy-proxy-agent-57fb68494f-pgpsg\" (UID: \"b946c194-2daa-4008-9ff6-566ce33da17e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57fb68494f-pgpsg"
Jul 17 10:53:42.244387 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:42.244371    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b946c194-2daa-4008-9ff6-566ce33da17e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-57fb68494f-pgpsg\" (UID: \"b946c194-2daa-4008-9ff6-566ce33da17e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57fb68494f-pgpsg"
Jul 17 10:53:42.272695 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:42.272676    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmbnh\" (UniqueName: \"kubernetes.io/projected/b946c194-2daa-4008-9ff6-566ce33da17e-kube-api-access-bmbnh\") pod \"cluster-proxy-proxy-agent-57fb68494f-pgpsg\" (UID: \"b946c194-2daa-4008-9ff6-566ce33da17e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57fb68494f-pgpsg"
Jul 17 10:53:42.357076 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:42.356998    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57fb68494f-pgpsg"
Jul 17 10:53:43.784008 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:43.783983    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57fb68494f-pgpsg"]
Jul 17 10:53:43.786318 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:53:43.786297    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb946c194_2daa_4008_9ff6_566ce33da17e.slice/crio-317e3be31c836bb536c64351330b51cad2761b5bab9db6e151322499f4cb5280 WatchSource:0}: Error finding container 317e3be31c836bb536c64351330b51cad2761b5bab9db6e151322499f4cb5280: Status 404 returned error can't find the container with id 317e3be31c836bb536c64351330b51cad2761b5bab9db6e151322499f4cb5280
Jul 17 10:53:44.657366 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:44.657326    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57fb68494f-pgpsg" event={"ID":"b946c194-2daa-4008-9ff6-566ce33da17e","Type":"ContainerStarted","Data":"317e3be31c836bb536c64351330b51cad2761b5bab9db6e151322499f4cb5280"}
Jul 17 10:53:44.660209 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:44.660181    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6c2kv" event={"ID":"f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1","Type":"ContainerStarted","Data":"610f170119dfe1120d20d28361782636e03314a5292bdb2c1ec996aa43b13964"}
Jul 17 10:53:49.679004 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:49.678970    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57fb68494f-pgpsg" event={"ID":"b946c194-2daa-4008-9ff6-566ce33da17e","Type":"ContainerStarted","Data":"98be944f72f91dffc308057fe49963e661acea048c0001e18c55bb824e0d5c53"}
Jul 17 10:53:49.679377 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:49.679015    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57fb68494f-pgpsg" event={"ID":"b946c194-2daa-4008-9ff6-566ce33da17e","Type":"ContainerStarted","Data":"ce6383a049931af330f4ec92e8ccc3260f375637e1b773605ac30b34a5a0739e"}
Jul 17 10:53:49.679377 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:49.679032    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57fb68494f-pgpsg" event={"ID":"b946c194-2daa-4008-9ff6-566ce33da17e","Type":"ContainerStarted","Data":"c6f11a2d4f258c3064e851db42e977cbbf241c6418481b74960ec95155a9e931"}
Jul 17 10:53:49.680971 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:49.680949    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6c2kv" event={"ID":"f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1","Type":"ContainerStarted","Data":"bacfed8bc527f41bec4ee7a2457345ed9b253d4d74835a06fe4dc6d30a1035ec"}
Jul 17 10:53:49.698275 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:49.698241    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57fb68494f-pgpsg" podStartSLOduration=3.588445449 podStartE2EDuration="8.698231087s" totalImagesPullingTime="5.109785638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:53:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:53:49.697909584 +0000 UTC m=+94.878942544" watchObservedRunningTime="2026-07-17 10:53:49.698231087 +0000 UTC m=+94.879264047"
Jul 17 10:53:49.717887 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:49.717855    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6c2kv" podStartSLOduration=17.857412996 podStartE2EDuration="30.717844233s" totalImagesPullingTime="12.860431237s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:53:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:53:49.717326187 +0000 UTC m=+94.898359158" watchObservedRunningTime="2026-07-17 10:53:49.717844233 +0000 UTC m=+94.898877193"
Jul 17 10:53:53.473228 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:53.473140    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jg2vb"]
Jul 17 10:53:53.505446 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:53.505391    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jg2vb"
Jul 17 10:53:53.508905 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:53.508884    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 17 10:53:53.509270 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:53.509213    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sfnqc\""
Jul 17 10:53:53.509387 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:53.509346    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 17 10:53:53.509472 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:53.509389    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 17 10:53:53.509533 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:53.509507    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 17 10:53:53.584245 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:53.584224    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-t9qnx"
Jul 17 10:53:53.624707 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:53.624667    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9a1e3c22-8a25-4743-84ac-a15371808df5-node-exporter-accelerators-collector-config\") pod \"node-exporter-jg2vb\" (UID: \"9a1e3c22-8a25-4743-84ac-a15371808df5\") " pod="openshift-monitoring/node-exporter-jg2vb"
Jul 17 10:53:53.624816 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:53.624753    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a1e3c22-8a25-4743-84ac-a15371808df5-metrics-client-ca\") pod \"node-exporter-jg2vb\" (UID: \"9a1e3c22-8a25-4743-84ac-a15371808df5\") " pod="openshift-monitoring/node-exporter-jg2vb"
Jul 17 10:53:53.624913 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:53.624811    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9a1e3c22-8a25-4743-84ac-a15371808df5-node-exporter-textfile\") pod \"node-exporter-jg2vb\" (UID: \"9a1e3c22-8a25-4743-84ac-a15371808df5\") " pod="openshift-monitoring/node-exporter-jg2vb"
Jul 17 10:53:53.624913 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:53.624846    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9a1e3c22-8a25-4743-84ac-a15371808df5-node-exporter-tls\") pod \"node-exporter-jg2vb\" (UID: \"9a1e3c22-8a25-4743-84ac-a15371808df5\") " pod="openshift-monitoring/node-exporter-jg2vb"
Jul 17 10:53:53.624913 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:53.624867    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9a1e3c22-8a25-4743-84ac-a15371808df5-node-exporter-wtmp\") pod \"node-exporter-jg2vb\" (UID: \"9a1e3c22-8a25-4743-84ac-a15371808df5\") " pod="openshift-monitoring/node-exporter-jg2vb"
Jul 17 10:53:53.624913 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:53.624890    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9a1e3c22-8a25-4743-84ac-a15371808df5-root\") pod \"node-exporter-jg2vb\" (UID: \"9a1e3c22-8a25-4743-84ac-a15371808df5\") " pod="openshift-monitoring/node-exporter-jg2vb"
Jul 17 10:53:53.625098 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:53.624924    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a1e3c22-8a25-4743-84ac-a15371808df5-sys\") pod \"node-exporter-jg2vb\" (UID: \"9a1e3c22-8a25-4743-84ac-a15371808df5\") " pod="openshift-monitoring/node-exporter-jg2vb"
Jul 17 10:53:53.625098 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:53.624963    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a1e3c22-8a25-4743-84ac-a15371808df5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jg2vb\" (UID: \"9a1e3c22-8a25-4743-84ac-a15371808df5\") " pod="openshift-monitoring/node-exporter-jg2vb"
Jul 17 10:53:53.625098 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:53.625029    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk9qf\" (UniqueName: \"kubernetes.io/projected/9a1e3c22-8a25-4743-84ac-a15371808df5-kube-api-access-zk9qf\") pod \"node-exporter-jg2vb\" (UID: \"9a1e3c22-8a25-4743-84ac-a15371808df5\") " pod="openshift-monitoring/node-exporter-jg2vb"
Jul 17 10:53:53.726150 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:53.726086    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9a1e3c22-8a25-4743-84ac-a15371808df5-node-exporter-tls\") pod \"node-exporter-jg2vb\" (UID: \"9a1e3c22-8a25-4743-84ac-a15371808df5\") " pod="openshift-monitoring/node-exporter-jg2vb"
Jul 17 10:53:53.726150 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:53.726116    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9a1e3c22-8a25-4743-84ac-a15371808df5-node-exporter-wtmp\") pod \"node-exporter-jg2vb\" (UID: \"9a1e3c22-8a25-4743-84ac-a15371808df5\") " pod="openshift-monitoring/node-exporter-jg2vb"
Jul 17 10:53:53.726150 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:53.726131    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9a1e3c22-8a25-4743-84ac-a15371808df5-root\") pod \"node-exporter-jg2vb\" (UID: \"9a1e3c22-8a25-4743-84ac-a15371808df5\") " pod="openshift-monitoring/node-exporter-jg2vb"
Jul 17 10:53:53.726358 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:53.726158    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a1e3c22-8a25-4743-84ac-a15371808df5-sys\") pod \"node-exporter-jg2vb\" (UID: \"9a1e3c22-8a25-4743-84ac-a15371808df5\") " pod="openshift-monitoring/node-exporter-jg2vb"
Jul 17 10:53:53.726358 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:53.726194    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a1e3c22-8a25-4743-84ac-a15371808df5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jg2vb\" (UID: \"9a1e3c22-8a25-4743-84ac-a15371808df5\") " pod="openshift-monitoring/node-exporter-jg2vb"
Jul 17 10:53:53.726358 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:53.726215    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9a1e3c22-8a25-4743-84ac-a15371808df5-root\") pod \"node-exporter-jg2vb\" (UID: \"9a1e3c22-8a25-4743-84ac-a15371808df5\") " pod="openshift-monitoring/node-exporter-jg2vb"
Jul 17 10:53:53.726358 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:53.726235    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk9qf\" (UniqueName: \"kubernetes.io/projected/9a1e3c22-8a25-4743-84ac-a15371808df5-kube-api-access-zk9qf\") pod \"node-exporter-jg2vb\" (UID: \"9a1e3c22-8a25-4743-84ac-a15371808df5\") " pod="openshift-monitoring/node-exporter-jg2vb"
Jul 17 10:53:53.726358 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:53.726263    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9a1e3c22-8a25-4743-84ac-a15371808df5-node-exporter-wtmp\") pod \"node-exporter-jg2vb\" (UID: \"9a1e3c22-8a25-4743-84ac-a15371808df5\") " pod="openshift-monitoring/node-exporter-jg2vb"
Jul 17 10:53:53.726358 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:53.726275    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9a1e3c22-8a25-4743-84ac-a15371808df5-node-exporter-accelerators-collector-config\") pod \"node-exporter-jg2vb\" (UID: \"9a1e3c22-8a25-4743-84ac-a15371808df5\") " pod="openshift-monitoring/node-exporter-jg2vb"
Jul 17 10:53:53.726358 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:53.726300    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a1e3c22-8a25-4743-84ac-a15371808df5-sys\") pod \"node-exporter-jg2vb\" (UID: \"9a1e3c22-8a25-4743-84ac-a15371808df5\") " pod="openshift-monitoring/node-exporter-jg2vb"
Jul 17 10:53:53.726358 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:53.726330    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a1e3c22-8a25-4743-84ac-a15371808df5-metrics-client-ca\") pod \"node-exporter-jg2vb\" (UID: \"9a1e3c22-8a25-4743-84ac-a15371808df5\") " pod="openshift-monitoring/node-exporter-jg2vb"
Jul 17 10:53:53.726358 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:53.726358    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9a1e3c22-8a25-4743-84ac-a15371808df5-node-exporter-textfile\") pod \"node-exporter-jg2vb\" (UID: \"9a1e3c22-8a25-4743-84ac-a15371808df5\") " pod="openshift-monitoring/node-exporter-jg2vb"
Jul 17 10:53:53.726870 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:53.726835    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9a1e3c22-8a25-4743-84ac-a15371808df5-node-exporter-textfile\") pod \"node-exporter-jg2vb\" (UID: \"9a1e3c22-8a25-4743-84ac-a15371808df5\") " pod="openshift-monitoring/node-exporter-jg2vb"
Jul 17 10:53:53.726921 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:53.726886    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9a1e3c22-8a25-4743-84ac-a15371808df5-node-exporter-accelerators-collector-config\") pod \"node-exporter-jg2vb\" (UID: \"9a1e3c22-8a25-4743-84ac-a15371808df5\") " pod="openshift-monitoring/node-exporter-jg2vb"
Jul 17 10:53:53.726969 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:53.726915    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a1e3c22-8a25-4743-84ac-a15371808df5-metrics-client-ca\") pod \"node-exporter-jg2vb\" (UID: \"9a1e3c22-8a25-4743-84ac-a15371808df5\") " pod="openshift-monitoring/node-exporter-jg2vb"
Jul 17 10:53:53.728519 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:53.728490    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9a1e3c22-8a25-4743-84ac-a15371808df5-node-exporter-tls\") pod \"node-exporter-jg2vb\" (UID: \"9a1e3c22-8a25-4743-84ac-a15371808df5\") " pod="openshift-monitoring/node-exporter-jg2vb"
Jul 17 10:53:53.728665 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:53.728646    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a1e3c22-8a25-4743-84ac-a15371808df5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jg2vb\" (UID: \"9a1e3c22-8a25-4743-84ac-a15371808df5\") " pod="openshift-monitoring/node-exporter-jg2vb"
Jul 17 10:53:53.736221 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:53.736200    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk9qf\" (UniqueName: \"kubernetes.io/projected/9a1e3c22-8a25-4743-84ac-a15371808df5-kube-api-access-zk9qf\") pod \"node-exporter-jg2vb\" (UID: \"9a1e3c22-8a25-4743-84ac-a15371808df5\") " pod="openshift-monitoring/node-exporter-jg2vb"
Jul 17 10:53:53.816419 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:53.816396    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jg2vb"
Jul 17 10:53:53.825116 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:53:53.825097    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a1e3c22_8a25_4743_84ac_a15371808df5.slice/crio-d0b5dcce97bca3dd7415cc47d1d96f54369f81363f19e8043a1659747d14eb11 WatchSource:0}: Error finding container d0b5dcce97bca3dd7415cc47d1d96f54369f81363f19e8043a1659747d14eb11: Status 404 returned error can't find the container with id d0b5dcce97bca3dd7415cc47d1d96f54369f81363f19e8043a1659747d14eb11
Jul 17 10:53:54.129421 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:54.129375    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-registry-tls\") pod \"image-registry-7bc89448c5-j2z9h\" (UID: \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\") " pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h"
Jul 17 10:53:54.129553 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:54.129420    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/619f03dd-a502-4c49-a66d-496a29102121-metrics-tls\") pod \"dns-default-kfp4f\" (UID: \"619f03dd-a502-4c49-a66d-496a29102121\") " pod="openshift-dns/dns-default-kfp4f"
Jul 17 10:53:54.131540 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:54.131518    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/619f03dd-a502-4c49-a66d-496a29102121-metrics-tls\") pod \"dns-default-kfp4f\" (UID: \"619f03dd-a502-4c49-a66d-496a29102121\") " pod="openshift-dns/dns-default-kfp4f"
Jul 17 10:53:54.131638 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:54.131553    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-registry-tls\") pod \"image-registry-7bc89448c5-j2z9h\" (UID: \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\") " pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h"
Jul 17 10:53:54.134779 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:54.134762    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gcsz5\""
Jul 17 10:53:54.142776 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:54.142748    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h"
Jul 17 10:53:54.148207 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:54.148187    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dnhpd\""
Jul 17 10:53:54.156247 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:54.156228    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kfp4f"
Jul 17 10:53:54.316301 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:54.316270    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bc89448c5-j2z9h"]
Jul 17 10:53:54.319956 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:53:54.319911    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode652b2b1_5807_4dfd_bc88_0673b2c5d8a8.slice/crio-8a8e25064773dffd20e790e34aa8044ecb5f6975b89729414abfebc7c897b22a WatchSource:0}: Error finding container 8a8e25064773dffd20e790e34aa8044ecb5f6975b89729414abfebc7c897b22a: Status 404 returned error can't find the container with id 8a8e25064773dffd20e790e34aa8044ecb5f6975b89729414abfebc7c897b22a
Jul 17 10:53:54.335163 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:54.335142    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kfp4f"]
Jul 17 10:53:54.337528 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:53:54.337472    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod619f03dd_a502_4c49_a66d_496a29102121.slice/crio-eab4d8c71fa38fc12f58d58237c73dd1d8a59fa51417aff2463ced38960e4fb4 WatchSource:0}: Error finding container eab4d8c71fa38fc12f58d58237c73dd1d8a59fa51417aff2463ced38960e4fb4: Status 404 returned error can't find the container with id eab4d8c71fa38fc12f58d58237c73dd1d8a59fa51417aff2463ced38960e4fb4
Jul 17 10:53:54.699910 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:54.699874    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h" event={"ID":"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8","Type":"ContainerStarted","Data":"eab4547d7f1cd25bc50242245cf3f8e9b88463ba98ddb7bff242a6bb6d6110c3"}
Jul 17 10:53:54.700329 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:54.699928    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h" event={"ID":"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8","Type":"ContainerStarted","Data":"8a8e25064773dffd20e790e34aa8044ecb5f6975b89729414abfebc7c897b22a"}
Jul 17 10:53:54.700329 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:54.699985    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h"
Jul 17 10:53:54.701214 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:54.701192    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jg2vb" event={"ID":"9a1e3c22-8a25-4743-84ac-a15371808df5","Type":"ContainerStarted","Data":"d0b5dcce97bca3dd7415cc47d1d96f54369f81363f19e8043a1659747d14eb11"}
Jul 17 10:53:54.702301 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:54.702278    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kfp4f" event={"ID":"619f03dd-a502-4c49-a66d-496a29102121","Type":"ContainerStarted","Data":"eab4d8c71fa38fc12f58d58237c73dd1d8a59fa51417aff2463ced38960e4fb4"}
Jul 17 10:53:54.720374 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:54.720335    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h" podStartSLOduration=98.720321431 podStartE2EDuration="1m38.720321431s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:52:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:53:54.718868285 +0000 UTC m=+99.899901248" watchObservedRunningTime="2026-07-17 10:53:54.720321431 +0000 UTC m=+99.901354391"
Jul 17 10:53:55.708131 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:55.708086    2563 generic.go:356] "Generic (PLEG): container finished" podID="9a1e3c22-8a25-4743-84ac-a15371808df5" containerID="9abb86820f6d924867fde5b58ca41628e2c3acee1db5b7119c249be2c5ba2ea0" exitCode=0
Jul 17 10:53:55.708596 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:55.708160    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jg2vb" event={"ID":"9a1e3c22-8a25-4743-84ac-a15371808df5","Type":"ContainerDied","Data":"9abb86820f6d924867fde5b58ca41628e2c3acee1db5b7119c249be2c5ba2ea0"}
Jul 17 10:53:56.712732 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:56.712696    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kfp4f" event={"ID":"619f03dd-a502-4c49-a66d-496a29102121","Type":"ContainerStarted","Data":"09e79212d33bbc032caa2d04aca64b3ce7842f923bb8ad22bbfe9031c2dce196"}
Jul 17 10:53:56.713119 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:56.712764    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kfp4f"
Jul 17 10:53:56.713119 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:56.712786    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kfp4f" event={"ID":"619f03dd-a502-4c49-a66d-496a29102121","Type":"ContainerStarted","Data":"8c087b8a4c97f9ad67786db8d44c47adecba17525c9225a0a8d9ca8393741e07"}
Jul 17 10:53:56.714650 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:56.714622    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jg2vb" event={"ID":"9a1e3c22-8a25-4743-84ac-a15371808df5","Type":"ContainerStarted","Data":"3c2cf75bcf3df5e82f02a1a1fc15c11f237b080df39f4161b80f1851e93f3c8d"}
Jul 17 10:53:56.714748 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:56.714672    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jg2vb" event={"ID":"9a1e3c22-8a25-4743-84ac-a15371808df5","Type":"ContainerStarted","Data":"1666937f175cfdd3b8b43028c96e21fe10671de5c5e3e107b650d467d39a7bdf"}
Jul 17 10:53:56.730840 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:56.730799    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kfp4f" podStartSLOduration=64.855780585 podStartE2EDuration="1m6.730785454s" totalImagesPullingTime="1.875004869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:52:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:53:56.730475814 +0000 UTC m=+101.911508794" watchObservedRunningTime="2026-07-17 10:53:56.730785454 +0000 UTC m=+101.911818415"
Jul 17 10:53:56.748601 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:56.748564    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jg2vb" podStartSLOduration=2.78678013 podStartE2EDuration="3.748551339s" totalImagesPullingTime="900.394279ms" totalInitContainerRuntime="61.37693ms" isStatefulPod=true podCreationTimestamp="2026-07-17 10:53:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:53:56.747829412 +0000 UTC m=+101.928862375" watchObservedRunningTime="2026-07-17 10:53:56.748551339 +0000 UTC m=+101.929584347"
Jul 17 10:53:59.681317 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.681286    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 17 10:53:59.699250 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.699226    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.701823 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.701803    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 17 10:53:59.701823 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.701816    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bk4lq91kdm9mk\""
Jul 17 10:53:59.701958 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.701918    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 17 10:53:59.701958 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.701928    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 17 10:53:59.702555 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.702535    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 17 10:53:59.702674 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.702653    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 17 10:53:59.702748 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.702710    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 17 10:53:59.702748 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.702710    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 17 10:53:59.702883 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.702712    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 17 10:53:59.702883 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.702825    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8b2lh\""
Jul 17 10:53:59.703199 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.703182    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 17 10:53:59.703199 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.703193    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 17 10:53:59.703336 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.703238    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 17 10:53:59.703336 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.703299    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 17 10:53:59.703715 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.703682    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 17 10:53:59.705192 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.705171    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 17 10:53:59.707299 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.707282    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 17 10:53:59.711053 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.711034    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 17 10:53:59.771110 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.771085    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.771217 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.771112    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/374a98d3-3821-46b7-972e-df5c52388f92-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.771217 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.771135    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/374a98d3-3821-46b7-972e-df5c52388f92-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.771217 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.771165    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.771217 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.771190    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/374a98d3-3821-46b7-972e-df5c52388f92-config-out\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.771217 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.771210    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.771395 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.771226    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-web-config\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.771395 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.771242    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/374a98d3-3821-46b7-972e-df5c52388f92-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.771395 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.771268    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/374a98d3-3821-46b7-972e-df5c52388f92-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.771395 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.771296    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/374a98d3-3821-46b7-972e-df5c52388f92-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.771395 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.771319    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/374a98d3-3821-46b7-972e-df5c52388f92-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.771395 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.771336    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/374a98d3-3821-46b7-972e-df5c52388f92-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.771395 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.771378    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-config\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.771651 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.771422    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnhvk\" (UniqueName: \"kubernetes.io/projected/374a98d3-3821-46b7-972e-df5c52388f92-kube-api-access-vnhvk\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.771651 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.771464    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/374a98d3-3821-46b7-972e-df5c52388f92-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.771651 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.771479    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.771651 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.771498    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.771651 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.771534    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.771651 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.771553    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.771651 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.771569    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/374a98d3-3821-46b7-972e-df5c52388f92-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.872919 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.872893    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.873014 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.872941    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/374a98d3-3821-46b7-972e-df5c52388f92-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.873014 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.872987    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/374a98d3-3821-46b7-972e-df5c52388f92-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.873122 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.873029    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.873122 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.873064    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/374a98d3-3821-46b7-972e-df5c52388f92-config-out\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.873122 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.873092    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.873255 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.873126    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-web-config\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.873255 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.873157    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/374a98d3-3821-46b7-972e-df5c52388f92-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.873255 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.873188    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/374a98d3-3821-46b7-972e-df5c52388f92-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.873255 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.873219    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/374a98d3-3821-46b7-972e-df5c52388f92-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.873422 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.873260    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/374a98d3-3821-46b7-972e-df5c52388f92-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.873422 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.873293    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/374a98d3-3821-46b7-972e-df5c52388f92-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.873422 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.873318    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-config\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.873422 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.873351    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnhvk\" (UniqueName: \"kubernetes.io/projected/374a98d3-3821-46b7-972e-df5c52388f92-kube-api-access-vnhvk\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.873422 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.873386    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/374a98d3-3821-46b7-972e-df5c52388f92-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.873422 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.873416    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.873702 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.873469    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.873702 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.873505    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.873702 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.873533    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.873702 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.873561    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/374a98d3-3821-46b7-972e-df5c52388f92-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.874283 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.874259    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/374a98d3-3821-46b7-972e-df5c52388f92-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.877544 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.877519    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/374a98d3-3821-46b7-972e-df5c52388f92-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.878877 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.877675    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/374a98d3-3821-46b7-972e-df5c52388f92-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.878877 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.877835    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/374a98d3-3821-46b7-972e-df5c52388f92-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.878877 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.878028    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/374a98d3-3821-46b7-972e-df5c52388f92-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.878877 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.878550    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/374a98d3-3821-46b7-972e-df5c52388f92-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.880620 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.880561    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/374a98d3-3821-46b7-972e-df5c52388f92-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.881460 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.881136    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.881460 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.881273    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.881460 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.881322    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-web-config\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.881832 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.881805    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.882018 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.882003    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/374a98d3-3821-46b7-972e-df5c52388f92-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.882120 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.882077    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.882235 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.882215    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/374a98d3-3821-46b7-972e-df5c52388f92-config-out\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.882296 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.882216    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/374a98d3-3821-46b7-972e-df5c52388f92-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.882296 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.882249    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.882361 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.882344    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.882978 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.882962    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.883164 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.883142    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-config\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:53:59.892204 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:53:59.892184    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnhvk\" (UniqueName: \"kubernetes.io/projected/374a98d3-3821-46b7-972e-df5c52388f92-kube-api-access-vnhvk\") pod \"prometheus-k8s-0\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:54:00.009584 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:00.009539    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:54:00.169115 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:00.169084    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 17 10:54:00.172691 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:54:00.172660    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod374a98d3_3821_46b7_972e_df5c52388f92.slice/crio-e364df0a3625cc7cf468007be611ada19251eb22a99b5780d3f3439022b7382e WatchSource:0}: Error finding container e364df0a3625cc7cf468007be611ada19251eb22a99b5780d3f3439022b7382e: Status 404 returned error can't find the container with id e364df0a3625cc7cf468007be611ada19251eb22a99b5780d3f3439022b7382e
Jul 17 10:54:00.729739 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:00.729706    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"374a98d3-3821-46b7-972e-df5c52388f92","Type":"ContainerStarted","Data":"e364df0a3625cc7cf468007be611ada19251eb22a99b5780d3f3439022b7382e"}
Jul 17 10:54:01.734423 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:01.734362    2563 generic.go:356] "Generic (PLEG): container finished" podID="374a98d3-3821-46b7-972e-df5c52388f92" containerID="6bfe1e1a9133cda15dbef8254faf83ee1daad29100c5421712b564d47156067e" exitCode=0
Jul 17 10:54:01.734423 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:01.734393    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"374a98d3-3821-46b7-972e-df5c52388f92","Type":"ContainerDied","Data":"6bfe1e1a9133cda15dbef8254faf83ee1daad29100c5421712b564d47156067e"}
Jul 17 10:54:04.747246 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:04.747216    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"374a98d3-3821-46b7-972e-df5c52388f92","Type":"ContainerStarted","Data":"76664eee3ef6e1834f76babd1bb802defd0b206be4e474123b7019f010ef929b"}
Jul 17 10:54:04.747610 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:04.747299    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"374a98d3-3821-46b7-972e-df5c52388f92","Type":"ContainerStarted","Data":"8a640cf9e52afad16fef860a5b907e0ab8eec6e63c9d489a5b833145296836a2"}
Jul 17 10:54:06.013816 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:06.013779    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7bc89448c5-j2z9h"]
Jul 17 10:54:06.720034 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:06.720013    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kfp4f"
Jul 17 10:54:06.759015 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:06.758945    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"374a98d3-3821-46b7-972e-df5c52388f92","Type":"ContainerStarted","Data":"fdd365bb103ca6e7c69ec8ea262d0444cd5aaab29ca9f4b0a251ba7b9ca61f55"}
Jul 17 10:54:07.764984 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:07.764953    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"374a98d3-3821-46b7-972e-df5c52388f92","Type":"ContainerStarted","Data":"289bab9eb9e850a5a1f36230b84498a24a56325fd31a0c51966d1aa8baeb08b4"}
Jul 17 10:54:07.765295 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:07.765013    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"374a98d3-3821-46b7-972e-df5c52388f92","Type":"ContainerStarted","Data":"d597398ce6acb7c88d50d7241f11e8add1caaa3877aadc46393b9aba0d6f1dc2"}
Jul 17 10:54:07.765295 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:07.765036    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"374a98d3-3821-46b7-972e-df5c52388f92","Type":"ContainerStarted","Data":"fa8163ef717e2114e56cca68e7f8e17a78416cd630b26cc08f11932879c7bb97"}
Jul 17 10:54:10.010527 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:10.010490    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:54:16.019464 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:16.019416    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h"
Jul 17 10:54:16.042615 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:16.042567    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=10.917991324 podStartE2EDuration="17.042552425s" totalImagesPullingTime="6.103824097s" totalInitContainerRuntime="20.737004ms" isStatefulPod=false podCreationTimestamp="2026-07-17 10:53:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:54:07.804653656 +0000 UTC m=+112.985686616" watchObservedRunningTime="2026-07-17 10:54:16.042552425 +0000 UTC m=+121.223585386"
Jul 17 10:54:25.150475 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:25.150442    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8037abbc-75d6-42df-9cad-5c1340e0341e-metrics-certs\") pod \"network-metrics-daemon-mdvfl\" (UID: \"8037abbc-75d6-42df-9cad-5c1340e0341e\") " pod="openshift-multus/network-metrics-daemon-mdvfl"
Jul 17 10:54:25.152692 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:25.152669    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8037abbc-75d6-42df-9cad-5c1340e0341e-metrics-certs\") pod \"network-metrics-daemon-mdvfl\" (UID: \"8037abbc-75d6-42df-9cad-5c1340e0341e\") " pod="openshift-multus/network-metrics-daemon-mdvfl"
Jul 17 10:54:25.174784 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:25.174763    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rk769\""
Jul 17 10:54:25.182808 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:25.182787    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mdvfl"
Jul 17 10:54:25.351742 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:25.351693    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mdvfl"]
Jul 17 10:54:25.354098 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:54:25.354070    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8037abbc_75d6_42df_9cad_5c1340e0341e.slice/crio-f3b1e00decfbf11127f1c4ab8e84b96d36b83b382b75ab1e291ec4855e353c06 WatchSource:0}: Error finding container f3b1e00decfbf11127f1c4ab8e84b96d36b83b382b75ab1e291ec4855e353c06: Status 404 returned error can't find the container with id f3b1e00decfbf11127f1c4ab8e84b96d36b83b382b75ab1e291ec4855e353c06
Jul 17 10:54:25.826353 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:25.826315    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mdvfl" event={"ID":"8037abbc-75d6-42df-9cad-5c1340e0341e","Type":"ContainerStarted","Data":"f3b1e00decfbf11127f1c4ab8e84b96d36b83b382b75ab1e291ec4855e353c06"}
Jul 17 10:54:26.831374 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:26.831343    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mdvfl" event={"ID":"8037abbc-75d6-42df-9cad-5c1340e0341e","Type":"ContainerStarted","Data":"56257a2236096bbbb1e2223c658a6d8d0953949a0ac29054cd9863782fa421b5"}
Jul 17 10:54:26.831707 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:26.831401    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mdvfl" event={"ID":"8037abbc-75d6-42df-9cad-5c1340e0341e","Type":"ContainerStarted","Data":"fe56ae216d3d0bb616fe70ffcc54f4f1ce895a54ed31f222fc2729300a910925"}
Jul 17 10:54:26.850288 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:26.850248    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mdvfl" podStartSLOduration=130.071171897 podStartE2EDuration="2m10.850233259s" totalImagesPullingTime="779.061362ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:52:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:54:26.84860723 +0000 UTC m=+132.029640183" watchObservedRunningTime="2026-07-17 10:54:26.850233259 +0000 UTC m=+132.031266221"
Jul 17 10:54:31.038115 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:31.038077    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h" podUID="e652b2b1-5807-4dfd-bc88-0673b2c5d8a8" containerName="registry" containerID="cri-o://eab4547d7f1cd25bc50242245cf3f8e9b88463ba98ddb7bff242a6bb6d6110c3" gracePeriod=30
Jul 17 10:54:31.271347 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:31.271327    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h"
Jul 17 10:54:31.291384 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:31.291340    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-ca-trust-extracted\") pod \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\" (UID: \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\") "
Jul 17 10:54:31.291384 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:31.291372    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-registry-tls\") pod \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\" (UID: \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\") "
Jul 17 10:54:31.291529 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:31.291393    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-registry-certificates\") pod \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\" (UID: \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\") "
Jul 17 10:54:31.291529 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:31.291441    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-bound-sa-token\") pod \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\" (UID: \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\") "
Jul 17 10:54:31.291529 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:31.291479    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-trusted-ca\") pod \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\" (UID: \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\") "
Jul 17 10:54:31.291529 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:31.291515    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-image-registry-private-configuration\") pod \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\" (UID: \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\") "
Jul 17 10:54:31.291709 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:31.291546    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8d5d\" (UniqueName: \"kubernetes.io/projected/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-kube-api-access-g8d5d\") pod \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\" (UID: \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\") "
Jul 17 10:54:31.291709 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:31.291579    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-installation-pull-secrets\") pod \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\" (UID: \"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8\") "
Jul 17 10:54:31.291939 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:31.291877    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e652b2b1-5807-4dfd-bc88-0673b2c5d8a8" (UID: "e652b2b1-5807-4dfd-bc88-0673b2c5d8a8"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 10:54:31.292043 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:31.291962    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e652b2b1-5807-4dfd-bc88-0673b2c5d8a8" (UID: "e652b2b1-5807-4dfd-bc88-0673b2c5d8a8"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 10:54:31.293888 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:31.293841    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e652b2b1-5807-4dfd-bc88-0673b2c5d8a8" (UID: "e652b2b1-5807-4dfd-bc88-0673b2c5d8a8"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 10:54:31.294033 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:31.293904    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e652b2b1-5807-4dfd-bc88-0673b2c5d8a8" (UID: "e652b2b1-5807-4dfd-bc88-0673b2c5d8a8"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 10:54:31.294033 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:31.293943    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e652b2b1-5807-4dfd-bc88-0673b2c5d8a8" (UID: "e652b2b1-5807-4dfd-bc88-0673b2c5d8a8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 10:54:31.294130 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:31.294073    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-kube-api-access-g8d5d" (OuterVolumeSpecName: "kube-api-access-g8d5d") pod "e652b2b1-5807-4dfd-bc88-0673b2c5d8a8" (UID: "e652b2b1-5807-4dfd-bc88-0673b2c5d8a8"). InnerVolumeSpecName "kube-api-access-g8d5d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 10:54:31.294364 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:31.294345    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e652b2b1-5807-4dfd-bc88-0673b2c5d8a8" (UID: "e652b2b1-5807-4dfd-bc88-0673b2c5d8a8"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 10:54:31.299932 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:31.299908    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e652b2b1-5807-4dfd-bc88-0673b2c5d8a8" (UID: "e652b2b1-5807-4dfd-bc88-0673b2c5d8a8"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:54:31.392320 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:31.392296    2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-bound-sa-token\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 10:54:31.392320 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:31.392317    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-trusted-ca\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 10:54:31.392486 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:31.392329    2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-image-registry-private-configuration\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 10:54:31.392486 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:31.392342    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8d5d\" (UniqueName: \"kubernetes.io/projected/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-kube-api-access-g8d5d\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 10:54:31.392486 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:31.392356    2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-installation-pull-secrets\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 10:54:31.392486 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:31.392370    2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-ca-trust-extracted\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 10:54:31.392486 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:31.392381    2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-registry-tls\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 10:54:31.392486 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:31.392393    2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8-registry-certificates\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 10:54:31.849059 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:31.849038    2563 generic.go:356] "Generic (PLEG): container finished" podID="e652b2b1-5807-4dfd-bc88-0673b2c5d8a8" containerID="eab4547d7f1cd25bc50242245cf3f8e9b88463ba98ddb7bff242a6bb6d6110c3" exitCode=0
Jul 17 10:54:31.849162 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:31.849077    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h"
Jul 17 10:54:31.849162 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:31.849080    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h" event={"ID":"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8","Type":"ContainerDied","Data":"eab4547d7f1cd25bc50242245cf3f8e9b88463ba98ddb7bff242a6bb6d6110c3"}
Jul 17 10:54:31.849224 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:31.849174    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bc89448c5-j2z9h" event={"ID":"e652b2b1-5807-4dfd-bc88-0673b2c5d8a8","Type":"ContainerDied","Data":"8a8e25064773dffd20e790e34aa8044ecb5f6975b89729414abfebc7c897b22a"}
Jul 17 10:54:31.849224 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:31.849194    2563 scope.go:117] "RemoveContainer" containerID="eab4547d7f1cd25bc50242245cf3f8e9b88463ba98ddb7bff242a6bb6d6110c3"
Jul 17 10:54:31.857250 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:31.857235    2563 scope.go:117] "RemoveContainer" containerID="eab4547d7f1cd25bc50242245cf3f8e9b88463ba98ddb7bff242a6bb6d6110c3"
Jul 17 10:54:31.857527 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:54:31.857507    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eab4547d7f1cd25bc50242245cf3f8e9b88463ba98ddb7bff242a6bb6d6110c3\": container with ID starting with eab4547d7f1cd25bc50242245cf3f8e9b88463ba98ddb7bff242a6bb6d6110c3 not found: ID does not exist" containerID="eab4547d7f1cd25bc50242245cf3f8e9b88463ba98ddb7bff242a6bb6d6110c3"
Jul 17 10:54:31.857591 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:31.857533    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eab4547d7f1cd25bc50242245cf3f8e9b88463ba98ddb7bff242a6bb6d6110c3"} err="failed to get container status \"eab4547d7f1cd25bc50242245cf3f8e9b88463ba98ddb7bff242a6bb6d6110c3\": rpc error: code = NotFound desc = could not find container \"eab4547d7f1cd25bc50242245cf3f8e9b88463ba98ddb7bff242a6bb6d6110c3\": container with ID starting with eab4547d7f1cd25bc50242245cf3f8e9b88463ba98ddb7bff242a6bb6d6110c3 not found: ID does not exist"
Jul 17 10:54:31.869783 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:31.869762    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7bc89448c5-j2z9h"]
Jul 17 10:54:31.873658 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:31.873638    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7bc89448c5-j2z9h"]
Jul 17 10:54:33.262912 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:33.262880    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e652b2b1-5807-4dfd-bc88-0673b2c5d8a8" path="/var/lib/kubelet/pods/e652b2b1-5807-4dfd-bc88-0673b2c5d8a8/volumes"
Jul 17 10:54:38.875062 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:38.875031    2563 generic.go:356] "Generic (PLEG): container finished" podID="8fa4781c-bff5-45e6-89fd-5192794e108d" containerID="6d6223afb4d0d45b362d000aa6a03b3b6da2dec8914d40f91c8655a4354bf0e7" exitCode=0
Jul 17 10:54:38.875456 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:38.875105    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4xqz9" event={"ID":"8fa4781c-bff5-45e6-89fd-5192794e108d","Type":"ContainerDied","Data":"6d6223afb4d0d45b362d000aa6a03b3b6da2dec8914d40f91c8655a4354bf0e7"}
Jul 17 10:54:38.875456 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:38.875381    2563 scope.go:117] "RemoveContainer" containerID="6d6223afb4d0d45b362d000aa6a03b3b6da2dec8914d40f91c8655a4354bf0e7"
Jul 17 10:54:39.880007 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:54:39.879970    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4xqz9" event={"ID":"8fa4781c-bff5-45e6-89fd-5192794e108d","Type":"ContainerStarted","Data":"e98dcae3b452b87f2230506efa409715bf4b648e6f0a02ef9a29fbdcf1af87bd"}
Jul 17 10:55:00.010124 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:00.010090    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:00.028326 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:00.028302    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:00.962383 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:00.962357    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:18.033884 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.033853    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 17 10:55:18.034290 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.034099    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="374a98d3-3821-46b7-972e-df5c52388f92" containerName="prometheus" containerID="cri-o://8a640cf9e52afad16fef860a5b907e0ab8eec6e63c9d489a5b833145296836a2" gracePeriod=600
Jul 17 10:55:18.034290 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.034116    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="374a98d3-3821-46b7-972e-df5c52388f92" containerName="kube-rbac-proxy" containerID="cri-o://d597398ce6acb7c88d50d7241f11e8add1caaa3877aadc46393b9aba0d6f1dc2" gracePeriod=600
Jul 17 10:55:18.034290 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.034168    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="374a98d3-3821-46b7-972e-df5c52388f92" containerName="kube-rbac-proxy-thanos" containerID="cri-o://289bab9eb9e850a5a1f36230b84498a24a56325fd31a0c51966d1aa8baeb08b4" gracePeriod=600
Jul 17 10:55:18.034290 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.034163    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="374a98d3-3821-46b7-972e-df5c52388f92" containerName="kube-rbac-proxy-web" containerID="cri-o://fa8163ef717e2114e56cca68e7f8e17a78416cd630b26cc08f11932879c7bb97" gracePeriod=600
Jul 17 10:55:18.034290 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.034178    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="374a98d3-3821-46b7-972e-df5c52388f92" containerName="thanos-sidecar" containerID="cri-o://fdd365bb103ca6e7c69ec8ea262d0444cd5aaab29ca9f4b0a251ba7b9ca61f55" gracePeriod=600
Jul 17 10:55:18.034290 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.034210    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="374a98d3-3821-46b7-972e-df5c52388f92" containerName="config-reloader" containerID="cri-o://76664eee3ef6e1834f76babd1bb802defd0b206be4e474123b7019f010ef929b" gracePeriod=600
Jul 17 10:55:18.273189 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.273167    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:18.299364 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.299308    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/374a98d3-3821-46b7-972e-df5c52388f92-configmap-metrics-client-ca\") pod \"374a98d3-3821-46b7-972e-df5c52388f92\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") "
Jul 17 10:55:18.299364 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.299346    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/374a98d3-3821-46b7-972e-df5c52388f92-prometheus-trusted-ca-bundle\") pod \"374a98d3-3821-46b7-972e-df5c52388f92\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") "
Jul 17 10:55:18.299549 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.299371    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-config\") pod \"374a98d3-3821-46b7-972e-df5c52388f92\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") "
Jul 17 10:55:18.299549 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.299398    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-secret-prometheus-k8s-tls\") pod \"374a98d3-3821-46b7-972e-df5c52388f92\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") "
Jul 17 10:55:18.299549 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.299422    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/374a98d3-3821-46b7-972e-df5c52388f92-prometheus-k8s-db\") pod \"374a98d3-3821-46b7-972e-df5c52388f92\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") "
Jul 17 10:55:18.299549 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.299477    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-secret-kube-rbac-proxy\") pod \"374a98d3-3821-46b7-972e-df5c52388f92\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") "
Jul 17 10:55:18.299549 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.299501    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/374a98d3-3821-46b7-972e-df5c52388f92-configmap-serving-certs-ca-bundle\") pod \"374a98d3-3821-46b7-972e-df5c52388f92\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") "
Jul 17 10:55:18.299549 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.299542    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-thanos-prometheus-http-client-file\") pod \"374a98d3-3821-46b7-972e-df5c52388f92\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") "
Jul 17 10:55:18.299843 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.299584    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-web-config\") pod \"374a98d3-3821-46b7-972e-df5c52388f92\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") "
Jul 17 10:55:18.299843 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.299612    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/374a98d3-3821-46b7-972e-df5c52388f92-prometheus-k8s-rulefiles-1\") pod \"374a98d3-3821-46b7-972e-df5c52388f92\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") "
Jul 17 10:55:18.299843 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.299658    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"374a98d3-3821-46b7-972e-df5c52388f92\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") "
Jul 17 10:55:18.299843 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.299686    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-secret-grpc-tls\") pod \"374a98d3-3821-46b7-972e-df5c52388f92\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") "
Jul 17 10:55:18.299843 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.299711    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/374a98d3-3821-46b7-972e-df5c52388f92-tls-assets\") pod \"374a98d3-3821-46b7-972e-df5c52388f92\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") "
Jul 17 10:55:18.299843 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.299730    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/374a98d3-3821-46b7-972e-df5c52388f92-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "374a98d3-3821-46b7-972e-df5c52388f92" (UID: "374a98d3-3821-46b7-972e-df5c52388f92"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 10:55:18.299843 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.299760    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vnhvk\" (UniqueName: \"kubernetes.io/projected/374a98d3-3821-46b7-972e-df5c52388f92-kube-api-access-vnhvk\") pod \"374a98d3-3821-46b7-972e-df5c52388f92\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") "
Jul 17 10:55:18.299843 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.299790    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"374a98d3-3821-46b7-972e-df5c52388f92\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") "
Jul 17 10:55:18.299843 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.299821    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/374a98d3-3821-46b7-972e-df5c52388f92-prometheus-k8s-rulefiles-2\") pod \"374a98d3-3821-46b7-972e-df5c52388f92\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") "
Jul 17 10:55:18.300320 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.299853    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-secret-metrics-client-certs\") pod \"374a98d3-3821-46b7-972e-df5c52388f92\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") "
Jul 17 10:55:18.300320 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.299898    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/374a98d3-3821-46b7-972e-df5c52388f92-prometheus-k8s-rulefiles-0\") pod \"374a98d3-3821-46b7-972e-df5c52388f92\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") "
Jul 17 10:55:18.300320 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.299934    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/374a98d3-3821-46b7-972e-df5c52388f92-config-out\") pod \"374a98d3-3821-46b7-972e-df5c52388f92\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") "
Jul 17 10:55:18.300320 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.299958    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/374a98d3-3821-46b7-972e-df5c52388f92-configmap-kubelet-serving-ca-bundle\") pod \"374a98d3-3821-46b7-972e-df5c52388f92\" (UID: \"374a98d3-3821-46b7-972e-df5c52388f92\") "
Jul 17 10:55:18.300320 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.300186    2563 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/374a98d3-3821-46b7-972e-df5c52388f92-configmap-metrics-client-ca\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 10:55:18.300320 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.300307    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/374a98d3-3821-46b7-972e-df5c52388f92-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "374a98d3-3821-46b7-972e-df5c52388f92" (UID: "374a98d3-3821-46b7-972e-df5c52388f92"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 10:55:18.300625 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.300497    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/374a98d3-3821-46b7-972e-df5c52388f92-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "374a98d3-3821-46b7-972e-df5c52388f92" (UID: "374a98d3-3821-46b7-972e-df5c52388f92"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 10:55:18.300674 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.300626    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/374a98d3-3821-46b7-972e-df5c52388f92-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "374a98d3-3821-46b7-972e-df5c52388f92" (UID: "374a98d3-3821-46b7-972e-df5c52388f92"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 10:55:18.301037 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.300833    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/374a98d3-3821-46b7-972e-df5c52388f92-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "374a98d3-3821-46b7-972e-df5c52388f92" (UID: "374a98d3-3821-46b7-972e-df5c52388f92"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 10:55:18.301520 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.301257    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/374a98d3-3821-46b7-972e-df5c52388f92-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "374a98d3-3821-46b7-972e-df5c52388f92" (UID: "374a98d3-3821-46b7-972e-df5c52388f92"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 10:55:18.303329 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.303051    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-config" (OuterVolumeSpecName: "config") pod "374a98d3-3821-46b7-972e-df5c52388f92" (UID: "374a98d3-3821-46b7-972e-df5c52388f92"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 10:55:18.303571 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.303537    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "374a98d3-3821-46b7-972e-df5c52388f92" (UID: "374a98d3-3821-46b7-972e-df5c52388f92"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 10:55:18.303683 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.303660    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/374a98d3-3821-46b7-972e-df5c52388f92-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "374a98d3-3821-46b7-972e-df5c52388f92" (UID: "374a98d3-3821-46b7-972e-df5c52388f92"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:55:18.304220 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.304189    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/374a98d3-3821-46b7-972e-df5c52388f92-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "374a98d3-3821-46b7-972e-df5c52388f92" (UID: "374a98d3-3821-46b7-972e-df5c52388f92"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 10:55:18.305462 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.305406    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "374a98d3-3821-46b7-972e-df5c52388f92" (UID: "374a98d3-3821-46b7-972e-df5c52388f92"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 10:55:18.305555 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.305476    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "374a98d3-3821-46b7-972e-df5c52388f92" (UID: "374a98d3-3821-46b7-972e-df5c52388f92"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 10:55:18.305555 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.305546    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "374a98d3-3821-46b7-972e-df5c52388f92" (UID: "374a98d3-3821-46b7-972e-df5c52388f92"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 10:55:18.305892 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.305867    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "374a98d3-3821-46b7-972e-df5c52388f92" (UID: "374a98d3-3821-46b7-972e-df5c52388f92"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 10:55:18.305974 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.305867    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/374a98d3-3821-46b7-972e-df5c52388f92-config-out" (OuterVolumeSpecName: "config-out") pod "374a98d3-3821-46b7-972e-df5c52388f92" (UID: "374a98d3-3821-46b7-972e-df5c52388f92"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:55:18.306376 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.306341    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "374a98d3-3821-46b7-972e-df5c52388f92" (UID: "374a98d3-3821-46b7-972e-df5c52388f92"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 10:55:18.306697 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.306669    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/374a98d3-3821-46b7-972e-df5c52388f92-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "374a98d3-3821-46b7-972e-df5c52388f92" (UID: "374a98d3-3821-46b7-972e-df5c52388f92"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 10:55:18.306785 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.306723    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/374a98d3-3821-46b7-972e-df5c52388f92-kube-api-access-vnhvk" (OuterVolumeSpecName: "kube-api-access-vnhvk") pod "374a98d3-3821-46b7-972e-df5c52388f92" (UID: "374a98d3-3821-46b7-972e-df5c52388f92"). InnerVolumeSpecName "kube-api-access-vnhvk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 10:55:18.307058 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.307039    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "374a98d3-3821-46b7-972e-df5c52388f92" (UID: "374a98d3-3821-46b7-972e-df5c52388f92"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 10:55:18.314780 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.314753    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-web-config" (OuterVolumeSpecName: "web-config") pod "374a98d3-3821-46b7-972e-df5c52388f92" (UID: "374a98d3-3821-46b7-972e-df5c52388f92"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 10:55:18.400466 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.400444    2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-web-config\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 10:55:18.400466 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.400465    2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/374a98d3-3821-46b7-972e-df5c52388f92-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 10:55:18.400590 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.400475    2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 10:55:18.400590 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.400484    2563 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-secret-grpc-tls\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 10:55:18.400590 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.400492    2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/374a98d3-3821-46b7-972e-df5c52388f92-tls-assets\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 10:55:18.400590 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.400512    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vnhvk\" (UniqueName: \"kubernetes.io/projected/374a98d3-3821-46b7-972e-df5c52388f92-kube-api-access-vnhvk\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 10:55:18.400590 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.400520    2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 10:55:18.400590 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.400527    2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/374a98d3-3821-46b7-972e-df5c52388f92-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 10:55:18.400590 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.400535    2563 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-secret-metrics-client-certs\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 10:55:18.400590 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.400543    2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/374a98d3-3821-46b7-972e-df5c52388f92-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 10:55:18.400590 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.400551    2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/374a98d3-3821-46b7-972e-df5c52388f92-config-out\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 10:55:18.400590 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.400558    2563 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/374a98d3-3821-46b7-972e-df5c52388f92-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 10:55:18.400590 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.400566    2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/374a98d3-3821-46b7-972e-df5c52388f92-prometheus-trusted-ca-bundle\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 10:55:18.400590 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.400573    2563 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-config\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 10:55:18.400590 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.400581    2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-secret-prometheus-k8s-tls\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 10:55:18.400590 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.400588    2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/374a98d3-3821-46b7-972e-df5c52388f92-prometheus-k8s-db\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 10:55:18.400954 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.400597    2563 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-secret-kube-rbac-proxy\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 10:55:18.400954 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.400605    2563 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/374a98d3-3821-46b7-972e-df5c52388f92-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 10:55:18.400954 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:18.400612    2563 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/374a98d3-3821-46b7-972e-df5c52388f92-thanos-prometheus-http-client-file\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 10:55:19.012140 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.012113    2563 generic.go:356] "Generic (PLEG): container finished" podID="374a98d3-3821-46b7-972e-df5c52388f92" containerID="289bab9eb9e850a5a1f36230b84498a24a56325fd31a0c51966d1aa8baeb08b4" exitCode=0
Jul 17 10:55:19.012140 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.012134    2563 generic.go:356] "Generic (PLEG): container finished" podID="374a98d3-3821-46b7-972e-df5c52388f92" containerID="d597398ce6acb7c88d50d7241f11e8add1caaa3877aadc46393b9aba0d6f1dc2" exitCode=0
Jul 17 10:55:19.012140 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.012141    2563 generic.go:356] "Generic (PLEG): container finished" podID="374a98d3-3821-46b7-972e-df5c52388f92" containerID="fa8163ef717e2114e56cca68e7f8e17a78416cd630b26cc08f11932879c7bb97" exitCode=0
Jul 17 10:55:19.012356 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.012147    2563 generic.go:356] "Generic (PLEG): container finished" podID="374a98d3-3821-46b7-972e-df5c52388f92" containerID="fdd365bb103ca6e7c69ec8ea262d0444cd5aaab29ca9f4b0a251ba7b9ca61f55" exitCode=0
Jul 17 10:55:19.012356 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.012152    2563 generic.go:356] "Generic (PLEG): container finished" podID="374a98d3-3821-46b7-972e-df5c52388f92" containerID="76664eee3ef6e1834f76babd1bb802defd0b206be4e474123b7019f010ef929b" exitCode=0
Jul 17 10:55:19.012356 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.012157    2563 generic.go:356] "Generic (PLEG): container finished" podID="374a98d3-3821-46b7-972e-df5c52388f92" containerID="8a640cf9e52afad16fef860a5b907e0ab8eec6e63c9d489a5b833145296836a2" exitCode=0
Jul 17 10:55:19.012356 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.012187    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"374a98d3-3821-46b7-972e-df5c52388f92","Type":"ContainerDied","Data":"289bab9eb9e850a5a1f36230b84498a24a56325fd31a0c51966d1aa8baeb08b4"}
Jul 17 10:55:19.012356 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.012204    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.012356 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.012273    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"374a98d3-3821-46b7-972e-df5c52388f92","Type":"ContainerDied","Data":"d597398ce6acb7c88d50d7241f11e8add1caaa3877aadc46393b9aba0d6f1dc2"}
Jul 17 10:55:19.012356 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.012300    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"374a98d3-3821-46b7-972e-df5c52388f92","Type":"ContainerDied","Data":"fa8163ef717e2114e56cca68e7f8e17a78416cd630b26cc08f11932879c7bb97"}
Jul 17 10:55:19.012356 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.012325    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"374a98d3-3821-46b7-972e-df5c52388f92","Type":"ContainerDied","Data":"fdd365bb103ca6e7c69ec8ea262d0444cd5aaab29ca9f4b0a251ba7b9ca61f55"}
Jul 17 10:55:19.012356 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.012341    2563 scope.go:117] "RemoveContainer" containerID="289bab9eb9e850a5a1f36230b84498a24a56325fd31a0c51966d1aa8baeb08b4"
Jul 17 10:55:19.012802 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.012363    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"374a98d3-3821-46b7-972e-df5c52388f92","Type":"ContainerDied","Data":"76664eee3ef6e1834f76babd1bb802defd0b206be4e474123b7019f010ef929b"}
Jul 17 10:55:19.012802 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.012401    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"374a98d3-3821-46b7-972e-df5c52388f92","Type":"ContainerDied","Data":"8a640cf9e52afad16fef860a5b907e0ab8eec6e63c9d489a5b833145296836a2"}
Jul 17 10:55:19.012802 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.012455    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"374a98d3-3821-46b7-972e-df5c52388f92","Type":"ContainerDied","Data":"e364df0a3625cc7cf468007be611ada19251eb22a99b5780d3f3439022b7382e"}
Jul 17 10:55:19.019148 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.019125    2563 scope.go:117] "RemoveContainer" containerID="d597398ce6acb7c88d50d7241f11e8add1caaa3877aadc46393b9aba0d6f1dc2"
Jul 17 10:55:19.025653 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.025638    2563 scope.go:117] "RemoveContainer" containerID="fa8163ef717e2114e56cca68e7f8e17a78416cd630b26cc08f11932879c7bb97"
Jul 17 10:55:19.031891 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.031873    2563 scope.go:117] "RemoveContainer" containerID="fdd365bb103ca6e7c69ec8ea262d0444cd5aaab29ca9f4b0a251ba7b9ca61f55"
Jul 17 10:55:19.035195 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.035177    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 17 10:55:19.039306 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.039083    2563 scope.go:117] "RemoveContainer" containerID="76664eee3ef6e1834f76babd1bb802defd0b206be4e474123b7019f010ef929b"
Jul 17 10:55:19.040378 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.040361    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 17 10:55:19.046233 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.046216    2563 scope.go:117] "RemoveContainer" containerID="8a640cf9e52afad16fef860a5b907e0ab8eec6e63c9d489a5b833145296836a2"
Jul 17 10:55:19.058813 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.058799    2563 scope.go:117] "RemoveContainer" containerID="6bfe1e1a9133cda15dbef8254faf83ee1daad29100c5421712b564d47156067e"
Jul 17 10:55:19.064646 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.064628    2563 scope.go:117] "RemoveContainer" containerID="289bab9eb9e850a5a1f36230b84498a24a56325fd31a0c51966d1aa8baeb08b4"
Jul 17 10:55:19.064901 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:55:19.064880    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"289bab9eb9e850a5a1f36230b84498a24a56325fd31a0c51966d1aa8baeb08b4\": container with ID starting with 289bab9eb9e850a5a1f36230b84498a24a56325fd31a0c51966d1aa8baeb08b4 not found: ID does not exist" containerID="289bab9eb9e850a5a1f36230b84498a24a56325fd31a0c51966d1aa8baeb08b4"
Jul 17 10:55:19.064951 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.064906    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"289bab9eb9e850a5a1f36230b84498a24a56325fd31a0c51966d1aa8baeb08b4"} err="failed to get container status \"289bab9eb9e850a5a1f36230b84498a24a56325fd31a0c51966d1aa8baeb08b4\": rpc error: code = NotFound desc = could not find container \"289bab9eb9e850a5a1f36230b84498a24a56325fd31a0c51966d1aa8baeb08b4\": container with ID starting with 289bab9eb9e850a5a1f36230b84498a24a56325fd31a0c51966d1aa8baeb08b4 not found: ID does not exist"
Jul 17 10:55:19.064951 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.064924    2563 scope.go:117] "RemoveContainer" containerID="d597398ce6acb7c88d50d7241f11e8add1caaa3877aadc46393b9aba0d6f1dc2"
Jul 17 10:55:19.065189 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:55:19.065167    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d597398ce6acb7c88d50d7241f11e8add1caaa3877aadc46393b9aba0d6f1dc2\": container with ID starting with d597398ce6acb7c88d50d7241f11e8add1caaa3877aadc46393b9aba0d6f1dc2 not found: ID does not exist" containerID="d597398ce6acb7c88d50d7241f11e8add1caaa3877aadc46393b9aba0d6f1dc2"
Jul 17 10:55:19.065255 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.065194    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d597398ce6acb7c88d50d7241f11e8add1caaa3877aadc46393b9aba0d6f1dc2"} err="failed to get container status \"d597398ce6acb7c88d50d7241f11e8add1caaa3877aadc46393b9aba0d6f1dc2\": rpc error: code = NotFound desc = could not find container \"d597398ce6acb7c88d50d7241f11e8add1caaa3877aadc46393b9aba0d6f1dc2\": container with ID starting with d597398ce6acb7c88d50d7241f11e8add1caaa3877aadc46393b9aba0d6f1dc2 not found: ID does not exist"
Jul 17 10:55:19.065255 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.065216    2563 scope.go:117] "RemoveContainer" containerID="fa8163ef717e2114e56cca68e7f8e17a78416cd630b26cc08f11932879c7bb97"
Jul 17 10:55:19.065554 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:55:19.065528    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa8163ef717e2114e56cca68e7f8e17a78416cd630b26cc08f11932879c7bb97\": container with ID starting with fa8163ef717e2114e56cca68e7f8e17a78416cd630b26cc08f11932879c7bb97 not found: ID does not exist" containerID="fa8163ef717e2114e56cca68e7f8e17a78416cd630b26cc08f11932879c7bb97"
Jul 17 10:55:19.065662 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.065563    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa8163ef717e2114e56cca68e7f8e17a78416cd630b26cc08f11932879c7bb97"} err="failed to get container status \"fa8163ef717e2114e56cca68e7f8e17a78416cd630b26cc08f11932879c7bb97\": rpc error: code = NotFound desc = could not find container \"fa8163ef717e2114e56cca68e7f8e17a78416cd630b26cc08f11932879c7bb97\": container with ID starting with fa8163ef717e2114e56cca68e7f8e17a78416cd630b26cc08f11932879c7bb97 not found: ID does not exist"
Jul 17 10:55:19.065662 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.065586    2563 scope.go:117] "RemoveContainer" containerID="fdd365bb103ca6e7c69ec8ea262d0444cd5aaab29ca9f4b0a251ba7b9ca61f55"
Jul 17 10:55:19.065930 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:55:19.065886    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdd365bb103ca6e7c69ec8ea262d0444cd5aaab29ca9f4b0a251ba7b9ca61f55\": container with ID starting with fdd365bb103ca6e7c69ec8ea262d0444cd5aaab29ca9f4b0a251ba7b9ca61f55 not found: ID does not exist" containerID="fdd365bb103ca6e7c69ec8ea262d0444cd5aaab29ca9f4b0a251ba7b9ca61f55"
Jul 17 10:55:19.065930 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.065912    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdd365bb103ca6e7c69ec8ea262d0444cd5aaab29ca9f4b0a251ba7b9ca61f55"} err="failed to get container status \"fdd365bb103ca6e7c69ec8ea262d0444cd5aaab29ca9f4b0a251ba7b9ca61f55\": rpc error: code = NotFound desc = could not find container \"fdd365bb103ca6e7c69ec8ea262d0444cd5aaab29ca9f4b0a251ba7b9ca61f55\": container with ID starting with fdd365bb103ca6e7c69ec8ea262d0444cd5aaab29ca9f4b0a251ba7b9ca61f55 not found: ID does not exist"
Jul 17 10:55:19.065930 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.065930    2563 scope.go:117] "RemoveContainer" containerID="76664eee3ef6e1834f76babd1bb802defd0b206be4e474123b7019f010ef929b"
Jul 17 10:55:19.066202 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:55:19.066181    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76664eee3ef6e1834f76babd1bb802defd0b206be4e474123b7019f010ef929b\": container with ID starting with 76664eee3ef6e1834f76babd1bb802defd0b206be4e474123b7019f010ef929b not found: ID does not exist" containerID="76664eee3ef6e1834f76babd1bb802defd0b206be4e474123b7019f010ef929b"
Jul 17 10:55:19.066255 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.066209    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76664eee3ef6e1834f76babd1bb802defd0b206be4e474123b7019f010ef929b"} err="failed to get container status \"76664eee3ef6e1834f76babd1bb802defd0b206be4e474123b7019f010ef929b\": rpc error: code = NotFound desc = could not find container \"76664eee3ef6e1834f76babd1bb802defd0b206be4e474123b7019f010ef929b\": container with ID starting with 76664eee3ef6e1834f76babd1bb802defd0b206be4e474123b7019f010ef929b not found: ID does not exist"
Jul 17 10:55:19.066255 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.066227    2563 scope.go:117] "RemoveContainer" containerID="8a640cf9e52afad16fef860a5b907e0ab8eec6e63c9d489a5b833145296836a2"
Jul 17 10:55:19.066498 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:55:19.066478    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a640cf9e52afad16fef860a5b907e0ab8eec6e63c9d489a5b833145296836a2\": container with ID starting with 8a640cf9e52afad16fef860a5b907e0ab8eec6e63c9d489a5b833145296836a2 not found: ID does not exist" containerID="8a640cf9e52afad16fef860a5b907e0ab8eec6e63c9d489a5b833145296836a2"
Jul 17 10:55:19.066564 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.066501    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a640cf9e52afad16fef860a5b907e0ab8eec6e63c9d489a5b833145296836a2"} err="failed to get container status \"8a640cf9e52afad16fef860a5b907e0ab8eec6e63c9d489a5b833145296836a2\": rpc error: code = NotFound desc = could not find container \"8a640cf9e52afad16fef860a5b907e0ab8eec6e63c9d489a5b833145296836a2\": container with ID starting with 8a640cf9e52afad16fef860a5b907e0ab8eec6e63c9d489a5b833145296836a2 not found: ID does not exist"
Jul 17 10:55:19.066564 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.066514    2563 scope.go:117] "RemoveContainer" containerID="6bfe1e1a9133cda15dbef8254faf83ee1daad29100c5421712b564d47156067e"
Jul 17 10:55:19.066755 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:55:19.066735    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bfe1e1a9133cda15dbef8254faf83ee1daad29100c5421712b564d47156067e\": container with ID starting with 6bfe1e1a9133cda15dbef8254faf83ee1daad29100c5421712b564d47156067e not found: ID does not exist" containerID="6bfe1e1a9133cda15dbef8254faf83ee1daad29100c5421712b564d47156067e"
Jul 17 10:55:19.066800 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.066760    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bfe1e1a9133cda15dbef8254faf83ee1daad29100c5421712b564d47156067e"} err="failed to get container status \"6bfe1e1a9133cda15dbef8254faf83ee1daad29100c5421712b564d47156067e\": rpc error: code = NotFound desc = could not find container \"6bfe1e1a9133cda15dbef8254faf83ee1daad29100c5421712b564d47156067e\": container with ID starting with 6bfe1e1a9133cda15dbef8254faf83ee1daad29100c5421712b564d47156067e not found: ID does not exist"
Jul 17 10:55:19.066800 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.066775    2563 scope.go:117] "RemoveContainer" containerID="289bab9eb9e850a5a1f36230b84498a24a56325fd31a0c51966d1aa8baeb08b4"
Jul 17 10:55:19.067014 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.066995    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"289bab9eb9e850a5a1f36230b84498a24a56325fd31a0c51966d1aa8baeb08b4"} err="failed to get container status \"289bab9eb9e850a5a1f36230b84498a24a56325fd31a0c51966d1aa8baeb08b4\": rpc error: code = NotFound desc = could not find container \"289bab9eb9e850a5a1f36230b84498a24a56325fd31a0c51966d1aa8baeb08b4\": container with ID starting with 289bab9eb9e850a5a1f36230b84498a24a56325fd31a0c51966d1aa8baeb08b4 not found: ID does not exist"
Jul 17 10:55:19.067056 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.067015    2563 scope.go:117] "RemoveContainer" containerID="d597398ce6acb7c88d50d7241f11e8add1caaa3877aadc46393b9aba0d6f1dc2"
Jul 17 10:55:19.067146 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.067128    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 17 10:55:19.067237 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.067221    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d597398ce6acb7c88d50d7241f11e8add1caaa3877aadc46393b9aba0d6f1dc2"} err="failed to get container status \"d597398ce6acb7c88d50d7241f11e8add1caaa3877aadc46393b9aba0d6f1dc2\": rpc error: code = NotFound desc = could not find container \"d597398ce6acb7c88d50d7241f11e8add1caaa3877aadc46393b9aba0d6f1dc2\": container with ID starting with d597398ce6acb7c88d50d7241f11e8add1caaa3877aadc46393b9aba0d6f1dc2 not found: ID does not exist"
Jul 17 10:55:19.067275 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.067238    2563 scope.go:117] "RemoveContainer" containerID="fa8163ef717e2114e56cca68e7f8e17a78416cd630b26cc08f11932879c7bb97"
Jul 17 10:55:19.067352 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.067340    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="374a98d3-3821-46b7-972e-df5c52388f92" containerName="kube-rbac-proxy-thanos"
Jul 17 10:55:19.067399 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.067354    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="374a98d3-3821-46b7-972e-df5c52388f92" containerName="kube-rbac-proxy-thanos"
Jul 17 10:55:19.067399 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.067362    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="374a98d3-3821-46b7-972e-df5c52388f92" containerName="init-config-reloader"
Jul 17 10:55:19.067399 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.067368    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="374a98d3-3821-46b7-972e-df5c52388f92" containerName="init-config-reloader"
Jul 17 10:55:19.067399 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.067376    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="374a98d3-3821-46b7-972e-df5c52388f92" containerName="config-reloader"
Jul 17 10:55:19.067399 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.067381    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="374a98d3-3821-46b7-972e-df5c52388f92" containerName="config-reloader"
Jul 17 10:55:19.067399 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.067389    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e652b2b1-5807-4dfd-bc88-0673b2c5d8a8" containerName="registry"
Jul 17 10:55:19.067399 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.067396    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e652b2b1-5807-4dfd-bc88-0673b2c5d8a8" containerName="registry"
Jul 17 10:55:19.067671 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.067405    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="374a98d3-3821-46b7-972e-df5c52388f92" containerName="prometheus"
Jul 17 10:55:19.067671 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.067413    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="374a98d3-3821-46b7-972e-df5c52388f92" containerName="prometheus"
Jul 17 10:55:19.067671 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.067416    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa8163ef717e2114e56cca68e7f8e17a78416cd630b26cc08f11932879c7bb97"} err="failed to get container status \"fa8163ef717e2114e56cca68e7f8e17a78416cd630b26cc08f11932879c7bb97\": rpc error: code = NotFound desc = could not find container \"fa8163ef717e2114e56cca68e7f8e17a78416cd630b26cc08f11932879c7bb97\": container with ID starting with fa8163ef717e2114e56cca68e7f8e17a78416cd630b26cc08f11932879c7bb97 not found: ID does not exist"
Jul 17 10:55:19.067671 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.067450    2563 scope.go:117] "RemoveContainer" containerID="fdd365bb103ca6e7c69ec8ea262d0444cd5aaab29ca9f4b0a251ba7b9ca61f55"
Jul 17 10:55:19.067671 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.067423    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="374a98d3-3821-46b7-972e-df5c52388f92" containerName="kube-rbac-proxy"
Jul 17 10:55:19.067671 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.067489    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="374a98d3-3821-46b7-972e-df5c52388f92" containerName="kube-rbac-proxy"
Jul 17 10:55:19.067671 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.067507    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="374a98d3-3821-46b7-972e-df5c52388f92" containerName="thanos-sidecar"
Jul 17 10:55:19.067671 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.067515    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="374a98d3-3821-46b7-972e-df5c52388f92" containerName="thanos-sidecar"
Jul 17 10:55:19.067671 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.067525    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="374a98d3-3821-46b7-972e-df5c52388f92" containerName="kube-rbac-proxy-web"
Jul 17 10:55:19.067671 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.067530    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="374a98d3-3821-46b7-972e-df5c52388f92" containerName="kube-rbac-proxy-web"
Jul 17 10:55:19.067671 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.067589    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="374a98d3-3821-46b7-972e-df5c52388f92" containerName="config-reloader"
Jul 17 10:55:19.067671 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.067601    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="374a98d3-3821-46b7-972e-df5c52388f92" containerName="thanos-sidecar"
Jul 17 10:55:19.067671 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.067608    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="374a98d3-3821-46b7-972e-df5c52388f92" containerName="kube-rbac-proxy-web"
Jul 17 10:55:19.067671 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.067613    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="374a98d3-3821-46b7-972e-df5c52388f92" containerName="kube-rbac-proxy"
Jul 17 10:55:19.067671 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.067630    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e652b2b1-5807-4dfd-bc88-0673b2c5d8a8" containerName="registry"
Jul 17 10:55:19.067671 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.067635    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="374a98d3-3821-46b7-972e-df5c52388f92" containerName="kube-rbac-proxy-thanos"
Jul 17 10:55:19.067671 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.067641    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="374a98d3-3821-46b7-972e-df5c52388f92" containerName="prometheus"
Jul 17 10:55:19.068195 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.067736    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdd365bb103ca6e7c69ec8ea262d0444cd5aaab29ca9f4b0a251ba7b9ca61f55"} err="failed to get container status \"fdd365bb103ca6e7c69ec8ea262d0444cd5aaab29ca9f4b0a251ba7b9ca61f55\": rpc error: code = NotFound desc = could not find container \"fdd365bb103ca6e7c69ec8ea262d0444cd5aaab29ca9f4b0a251ba7b9ca61f55\": container with ID starting with fdd365bb103ca6e7c69ec8ea262d0444cd5aaab29ca9f4b0a251ba7b9ca61f55 not found: ID does not exist"
Jul 17 10:55:19.068195 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.067751    2563 scope.go:117] "RemoveContainer" containerID="76664eee3ef6e1834f76babd1bb802defd0b206be4e474123b7019f010ef929b"
Jul 17 10:55:19.068195 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.067929    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76664eee3ef6e1834f76babd1bb802defd0b206be4e474123b7019f010ef929b"} err="failed to get container status \"76664eee3ef6e1834f76babd1bb802defd0b206be4e474123b7019f010ef929b\": rpc error: code = NotFound desc = could not find container \"76664eee3ef6e1834f76babd1bb802defd0b206be4e474123b7019f010ef929b\": container with ID starting with 76664eee3ef6e1834f76babd1bb802defd0b206be4e474123b7019f010ef929b not found: ID does not exist"
Jul 17 10:55:19.068195 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.067954    2563 scope.go:117] "RemoveContainer" containerID="8a640cf9e52afad16fef860a5b907e0ab8eec6e63c9d489a5b833145296836a2"
Jul 17 10:55:19.068195 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.068170    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a640cf9e52afad16fef860a5b907e0ab8eec6e63c9d489a5b833145296836a2"} err="failed to get container status \"8a640cf9e52afad16fef860a5b907e0ab8eec6e63c9d489a5b833145296836a2\": rpc error: code = NotFound desc = could not find container \"8a640cf9e52afad16fef860a5b907e0ab8eec6e63c9d489a5b833145296836a2\": container with ID starting with 8a640cf9e52afad16fef860a5b907e0ab8eec6e63c9d489a5b833145296836a2 not found: ID does not exist"
Jul 17 10:55:19.068195 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.068185    2563 scope.go:117] "RemoveContainer" containerID="6bfe1e1a9133cda15dbef8254faf83ee1daad29100c5421712b564d47156067e"
Jul 17 10:55:19.068400 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.068384    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bfe1e1a9133cda15dbef8254faf83ee1daad29100c5421712b564d47156067e"} err="failed to get container status \"6bfe1e1a9133cda15dbef8254faf83ee1daad29100c5421712b564d47156067e\": rpc error: code = NotFound desc = could not find container \"6bfe1e1a9133cda15dbef8254faf83ee1daad29100c5421712b564d47156067e\": container with ID starting with 6bfe1e1a9133cda15dbef8254faf83ee1daad29100c5421712b564d47156067e not found: ID does not exist"
Jul 17 10:55:19.068450 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.068403    2563 scope.go:117] "RemoveContainer" containerID="289bab9eb9e850a5a1f36230b84498a24a56325fd31a0c51966d1aa8baeb08b4"
Jul 17 10:55:19.068643 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.068626    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"289bab9eb9e850a5a1f36230b84498a24a56325fd31a0c51966d1aa8baeb08b4"} err="failed to get container status \"289bab9eb9e850a5a1f36230b84498a24a56325fd31a0c51966d1aa8baeb08b4\": rpc error: code = NotFound desc = could not find container \"289bab9eb9e850a5a1f36230b84498a24a56325fd31a0c51966d1aa8baeb08b4\": container with ID starting with 289bab9eb9e850a5a1f36230b84498a24a56325fd31a0c51966d1aa8baeb08b4 not found: ID does not exist"
Jul 17 10:55:19.068713 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.068643    2563 scope.go:117] "RemoveContainer" containerID="d597398ce6acb7c88d50d7241f11e8add1caaa3877aadc46393b9aba0d6f1dc2"
Jul 17 10:55:19.068849 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.068833    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d597398ce6acb7c88d50d7241f11e8add1caaa3877aadc46393b9aba0d6f1dc2"} err="failed to get container status \"d597398ce6acb7c88d50d7241f11e8add1caaa3877aadc46393b9aba0d6f1dc2\": rpc error: code = NotFound desc = could not find container \"d597398ce6acb7c88d50d7241f11e8add1caaa3877aadc46393b9aba0d6f1dc2\": container with ID starting with d597398ce6acb7c88d50d7241f11e8add1caaa3877aadc46393b9aba0d6f1dc2 not found: ID does not exist"
Jul 17 10:55:19.068893 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.068851    2563 scope.go:117] "RemoveContainer" containerID="fa8163ef717e2114e56cca68e7f8e17a78416cd630b26cc08f11932879c7bb97"
Jul 17 10:55:19.069045 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.069028    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa8163ef717e2114e56cca68e7f8e17a78416cd630b26cc08f11932879c7bb97"} err="failed to get container status \"fa8163ef717e2114e56cca68e7f8e17a78416cd630b26cc08f11932879c7bb97\": rpc error: code = NotFound desc = could not find container \"fa8163ef717e2114e56cca68e7f8e17a78416cd630b26cc08f11932879c7bb97\": container with ID starting with fa8163ef717e2114e56cca68e7f8e17a78416cd630b26cc08f11932879c7bb97 not found: ID does not exist"
Jul 17 10:55:19.069083 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.069046    2563 scope.go:117] "RemoveContainer" containerID="fdd365bb103ca6e7c69ec8ea262d0444cd5aaab29ca9f4b0a251ba7b9ca61f55"
Jul 17 10:55:19.069243 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.069224    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdd365bb103ca6e7c69ec8ea262d0444cd5aaab29ca9f4b0a251ba7b9ca61f55"} err="failed to get container status \"fdd365bb103ca6e7c69ec8ea262d0444cd5aaab29ca9f4b0a251ba7b9ca61f55\": rpc error: code = NotFound desc = could not find container \"fdd365bb103ca6e7c69ec8ea262d0444cd5aaab29ca9f4b0a251ba7b9ca61f55\": container with ID starting with fdd365bb103ca6e7c69ec8ea262d0444cd5aaab29ca9f4b0a251ba7b9ca61f55 not found: ID does not exist"
Jul 17 10:55:19.069319 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.069245    2563 scope.go:117] "RemoveContainer" containerID="76664eee3ef6e1834f76babd1bb802defd0b206be4e474123b7019f010ef929b"
Jul 17 10:55:19.069495 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.069477    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76664eee3ef6e1834f76babd1bb802defd0b206be4e474123b7019f010ef929b"} err="failed to get container status \"76664eee3ef6e1834f76babd1bb802defd0b206be4e474123b7019f010ef929b\": rpc error: code = NotFound desc = could not find container \"76664eee3ef6e1834f76babd1bb802defd0b206be4e474123b7019f010ef929b\": container with ID starting with 76664eee3ef6e1834f76babd1bb802defd0b206be4e474123b7019f010ef929b not found: ID does not exist"
Jul 17 10:55:19.069552 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.069495    2563 scope.go:117] "RemoveContainer" containerID="8a640cf9e52afad16fef860a5b907e0ab8eec6e63c9d489a5b833145296836a2"
Jul 17 10:55:19.069707 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.069689    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a640cf9e52afad16fef860a5b907e0ab8eec6e63c9d489a5b833145296836a2"} err="failed to get container status \"8a640cf9e52afad16fef860a5b907e0ab8eec6e63c9d489a5b833145296836a2\": rpc error: code = NotFound desc = could not find container \"8a640cf9e52afad16fef860a5b907e0ab8eec6e63c9d489a5b833145296836a2\": container with ID starting with 8a640cf9e52afad16fef860a5b907e0ab8eec6e63c9d489a5b833145296836a2 not found: ID does not exist"
Jul 17 10:55:19.069772 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.069708    2563 scope.go:117] "RemoveContainer" containerID="6bfe1e1a9133cda15dbef8254faf83ee1daad29100c5421712b564d47156067e"
Jul 17 10:55:19.069950 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.069931    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bfe1e1a9133cda15dbef8254faf83ee1daad29100c5421712b564d47156067e"} err="failed to get container status \"6bfe1e1a9133cda15dbef8254faf83ee1daad29100c5421712b564d47156067e\": rpc error: code = NotFound desc = could not find container \"6bfe1e1a9133cda15dbef8254faf83ee1daad29100c5421712b564d47156067e\": container with ID starting with 6bfe1e1a9133cda15dbef8254faf83ee1daad29100c5421712b564d47156067e not found: ID does not exist"
Jul 17 10:55:19.069989 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.069951    2563 scope.go:117] "RemoveContainer" containerID="289bab9eb9e850a5a1f36230b84498a24a56325fd31a0c51966d1aa8baeb08b4"
Jul 17 10:55:19.070155 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.070138    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"289bab9eb9e850a5a1f36230b84498a24a56325fd31a0c51966d1aa8baeb08b4"} err="failed to get container status \"289bab9eb9e850a5a1f36230b84498a24a56325fd31a0c51966d1aa8baeb08b4\": rpc error: code = NotFound desc = could not find container \"289bab9eb9e850a5a1f36230b84498a24a56325fd31a0c51966d1aa8baeb08b4\": container with ID starting with 289bab9eb9e850a5a1f36230b84498a24a56325fd31a0c51966d1aa8baeb08b4 not found: ID does not exist"
Jul 17 10:55:19.070219 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.070156    2563 scope.go:117] "RemoveContainer" containerID="d597398ce6acb7c88d50d7241f11e8add1caaa3877aadc46393b9aba0d6f1dc2"
Jul 17 10:55:19.070382 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.070363    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d597398ce6acb7c88d50d7241f11e8add1caaa3877aadc46393b9aba0d6f1dc2"} err="failed to get container status \"d597398ce6acb7c88d50d7241f11e8add1caaa3877aadc46393b9aba0d6f1dc2\": rpc error: code = NotFound desc = could not find container \"d597398ce6acb7c88d50d7241f11e8add1caaa3877aadc46393b9aba0d6f1dc2\": container with ID starting with d597398ce6acb7c88d50d7241f11e8add1caaa3877aadc46393b9aba0d6f1dc2 not found: ID does not exist"
Jul 17 10:55:19.070423 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.070382    2563 scope.go:117] "RemoveContainer" containerID="fa8163ef717e2114e56cca68e7f8e17a78416cd630b26cc08f11932879c7bb97"
Jul 17 10:55:19.070701 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.070681    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa8163ef717e2114e56cca68e7f8e17a78416cd630b26cc08f11932879c7bb97"} err="failed to get container status \"fa8163ef717e2114e56cca68e7f8e17a78416cd630b26cc08f11932879c7bb97\": rpc error: code = NotFound desc = could not find container \"fa8163ef717e2114e56cca68e7f8e17a78416cd630b26cc08f11932879c7bb97\": container with ID starting with fa8163ef717e2114e56cca68e7f8e17a78416cd630b26cc08f11932879c7bb97 not found: ID does not exist"
Jul 17 10:55:19.070773 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.070701    2563 scope.go:117] "RemoveContainer" containerID="fdd365bb103ca6e7c69ec8ea262d0444cd5aaab29ca9f4b0a251ba7b9ca61f55"
Jul 17 10:55:19.070773 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.070746    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.071145 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.070934    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdd365bb103ca6e7c69ec8ea262d0444cd5aaab29ca9f4b0a251ba7b9ca61f55"} err="failed to get container status \"fdd365bb103ca6e7c69ec8ea262d0444cd5aaab29ca9f4b0a251ba7b9ca61f55\": rpc error: code = NotFound desc = could not find container \"fdd365bb103ca6e7c69ec8ea262d0444cd5aaab29ca9f4b0a251ba7b9ca61f55\": container with ID starting with fdd365bb103ca6e7c69ec8ea262d0444cd5aaab29ca9f4b0a251ba7b9ca61f55 not found: ID does not exist"
Jul 17 10:55:19.071145 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.070958    2563 scope.go:117] "RemoveContainer" containerID="76664eee3ef6e1834f76babd1bb802defd0b206be4e474123b7019f010ef929b"
Jul 17 10:55:19.071356 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.071333    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76664eee3ef6e1834f76babd1bb802defd0b206be4e474123b7019f010ef929b"} err="failed to get container status \"76664eee3ef6e1834f76babd1bb802defd0b206be4e474123b7019f010ef929b\": rpc error: code = NotFound desc = could not find container \"76664eee3ef6e1834f76babd1bb802defd0b206be4e474123b7019f010ef929b\": container with ID starting with 76664eee3ef6e1834f76babd1bb802defd0b206be4e474123b7019f010ef929b not found: ID does not exist"
Jul 17 10:55:19.071410 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.071359    2563 scope.go:117] "RemoveContainer" containerID="8a640cf9e52afad16fef860a5b907e0ab8eec6e63c9d489a5b833145296836a2"
Jul 17 10:55:19.071615 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.071587    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a640cf9e52afad16fef860a5b907e0ab8eec6e63c9d489a5b833145296836a2"} err="failed to get container status \"8a640cf9e52afad16fef860a5b907e0ab8eec6e63c9d489a5b833145296836a2\": rpc error: code = NotFound desc = could not find container \"8a640cf9e52afad16fef860a5b907e0ab8eec6e63c9d489a5b833145296836a2\": container with ID starting with 8a640cf9e52afad16fef860a5b907e0ab8eec6e63c9d489a5b833145296836a2 not found: ID does not exist"
Jul 17 10:55:19.071679 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.071617    2563 scope.go:117] "RemoveContainer" containerID="6bfe1e1a9133cda15dbef8254faf83ee1daad29100c5421712b564d47156067e"
Jul 17 10:55:19.071842 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.071821    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bfe1e1a9133cda15dbef8254faf83ee1daad29100c5421712b564d47156067e"} err="failed to get container status \"6bfe1e1a9133cda15dbef8254faf83ee1daad29100c5421712b564d47156067e\": rpc error: code = NotFound desc = could not find container \"6bfe1e1a9133cda15dbef8254faf83ee1daad29100c5421712b564d47156067e\": container with ID starting with 6bfe1e1a9133cda15dbef8254faf83ee1daad29100c5421712b564d47156067e not found: ID does not exist"
Jul 17 10:55:19.071895 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.071844    2563 scope.go:117] "RemoveContainer" containerID="289bab9eb9e850a5a1f36230b84498a24a56325fd31a0c51966d1aa8baeb08b4"
Jul 17 10:55:19.072093 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.072071    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"289bab9eb9e850a5a1f36230b84498a24a56325fd31a0c51966d1aa8baeb08b4"} err="failed to get container status \"289bab9eb9e850a5a1f36230b84498a24a56325fd31a0c51966d1aa8baeb08b4\": rpc error: code = NotFound desc = could not find container \"289bab9eb9e850a5a1f36230b84498a24a56325fd31a0c51966d1aa8baeb08b4\": container with ID starting with 289bab9eb9e850a5a1f36230b84498a24a56325fd31a0c51966d1aa8baeb08b4 not found: ID does not exist"
Jul 17 10:55:19.072145 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.072096    2563 scope.go:117] "RemoveContainer" containerID="d597398ce6acb7c88d50d7241f11e8add1caaa3877aadc46393b9aba0d6f1dc2"
Jul 17 10:55:19.072316 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.072301    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d597398ce6acb7c88d50d7241f11e8add1caaa3877aadc46393b9aba0d6f1dc2"} err="failed to get container status \"d597398ce6acb7c88d50d7241f11e8add1caaa3877aadc46393b9aba0d6f1dc2\": rpc error: code = NotFound desc = could not find container \"d597398ce6acb7c88d50d7241f11e8add1caaa3877aadc46393b9aba0d6f1dc2\": container with ID starting with d597398ce6acb7c88d50d7241f11e8add1caaa3877aadc46393b9aba0d6f1dc2 not found: ID does not exist"
Jul 17 10:55:19.072358 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.072316    2563 scope.go:117] "RemoveContainer" containerID="fa8163ef717e2114e56cca68e7f8e17a78416cd630b26cc08f11932879c7bb97"
Jul 17 10:55:19.072523 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.072508    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa8163ef717e2114e56cca68e7f8e17a78416cd630b26cc08f11932879c7bb97"} err="failed to get container status \"fa8163ef717e2114e56cca68e7f8e17a78416cd630b26cc08f11932879c7bb97\": rpc error: code = NotFound desc = could not find container \"fa8163ef717e2114e56cca68e7f8e17a78416cd630b26cc08f11932879c7bb97\": container with ID starting with fa8163ef717e2114e56cca68e7f8e17a78416cd630b26cc08f11932879c7bb97 not found: ID does not exist"
Jul 17 10:55:19.072588 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.072523    2563 scope.go:117] "RemoveContainer" containerID="fdd365bb103ca6e7c69ec8ea262d0444cd5aaab29ca9f4b0a251ba7b9ca61f55"
Jul 17 10:55:19.072768 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.072749    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdd365bb103ca6e7c69ec8ea262d0444cd5aaab29ca9f4b0a251ba7b9ca61f55"} err="failed to get container status \"fdd365bb103ca6e7c69ec8ea262d0444cd5aaab29ca9f4b0a251ba7b9ca61f55\": rpc error: code = NotFound desc = could not find container \"fdd365bb103ca6e7c69ec8ea262d0444cd5aaab29ca9f4b0a251ba7b9ca61f55\": container with ID starting with fdd365bb103ca6e7c69ec8ea262d0444cd5aaab29ca9f4b0a251ba7b9ca61f55 not found: ID does not exist"
Jul 17 10:55:19.072813 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.072768    2563 scope.go:117] "RemoveContainer" containerID="76664eee3ef6e1834f76babd1bb802defd0b206be4e474123b7019f010ef929b"
Jul 17 10:55:19.072947 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.072929    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76664eee3ef6e1834f76babd1bb802defd0b206be4e474123b7019f010ef929b"} err="failed to get container status \"76664eee3ef6e1834f76babd1bb802defd0b206be4e474123b7019f010ef929b\": rpc error: code = NotFound desc = could not find container \"76664eee3ef6e1834f76babd1bb802defd0b206be4e474123b7019f010ef929b\": container with ID starting with 76664eee3ef6e1834f76babd1bb802defd0b206be4e474123b7019f010ef929b not found: ID does not exist"
Jul 17 10:55:19.072989 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.072946    2563 scope.go:117] "RemoveContainer" containerID="8a640cf9e52afad16fef860a5b907e0ab8eec6e63c9d489a5b833145296836a2"
Jul 17 10:55:19.073150 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.073133    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a640cf9e52afad16fef860a5b907e0ab8eec6e63c9d489a5b833145296836a2"} err="failed to get container status \"8a640cf9e52afad16fef860a5b907e0ab8eec6e63c9d489a5b833145296836a2\": rpc error: code = NotFound desc = could not find container \"8a640cf9e52afad16fef860a5b907e0ab8eec6e63c9d489a5b833145296836a2\": container with ID starting with 8a640cf9e52afad16fef860a5b907e0ab8eec6e63c9d489a5b833145296836a2 not found: ID does not exist"
Jul 17 10:55:19.073200 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.073151    2563 scope.go:117] "RemoveContainer" containerID="6bfe1e1a9133cda15dbef8254faf83ee1daad29100c5421712b564d47156067e"
Jul 17 10:55:19.073379 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.073356    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bfe1e1a9133cda15dbef8254faf83ee1daad29100c5421712b564d47156067e"} err="failed to get container status \"6bfe1e1a9133cda15dbef8254faf83ee1daad29100c5421712b564d47156067e\": rpc error: code = NotFound desc = could not find container \"6bfe1e1a9133cda15dbef8254faf83ee1daad29100c5421712b564d47156067e\": container with ID starting with 6bfe1e1a9133cda15dbef8254faf83ee1daad29100c5421712b564d47156067e not found: ID does not exist"
Jul 17 10:55:19.073451 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.073383    2563 scope.go:117] "RemoveContainer" containerID="289bab9eb9e850a5a1f36230b84498a24a56325fd31a0c51966d1aa8baeb08b4"
Jul 17 10:55:19.073634 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.073605    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 17 10:55:19.073722 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.073689    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"289bab9eb9e850a5a1f36230b84498a24a56325fd31a0c51966d1aa8baeb08b4"} err="failed to get container status \"289bab9eb9e850a5a1f36230b84498a24a56325fd31a0c51966d1aa8baeb08b4\": rpc error: code = NotFound desc = could not find container \"289bab9eb9e850a5a1f36230b84498a24a56325fd31a0c51966d1aa8baeb08b4\": container with ID starting with 289bab9eb9e850a5a1f36230b84498a24a56325fd31a0c51966d1aa8baeb08b4 not found: ID does not exist"
Jul 17 10:55:19.073722 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.073717    2563 scope.go:117] "RemoveContainer" containerID="d597398ce6acb7c88d50d7241f11e8add1caaa3877aadc46393b9aba0d6f1dc2"
Jul 17 10:55:19.073834 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.073723    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bk4lq91kdm9mk\""
Jul 17 10:55:19.073834 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.073735    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 17 10:55:19.073834 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.073791    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 17 10:55:19.073972 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.073887    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 17 10:55:19.073972 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.073889    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 17 10:55:19.074065 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.073973    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d597398ce6acb7c88d50d7241f11e8add1caaa3877aadc46393b9aba0d6f1dc2"} err="failed to get container status \"d597398ce6acb7c88d50d7241f11e8add1caaa3877aadc46393b9aba0d6f1dc2\": rpc error: code = NotFound desc = could not find container \"d597398ce6acb7c88d50d7241f11e8add1caaa3877aadc46393b9aba0d6f1dc2\": container with ID starting with d597398ce6acb7c88d50d7241f11e8add1caaa3877aadc46393b9aba0d6f1dc2 not found: ID does not exist"
Jul 17 10:55:19.074065 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.073994    2563 scope.go:117] "RemoveContainer" containerID="fa8163ef717e2114e56cca68e7f8e17a78416cd630b26cc08f11932879c7bb97"
Jul 17 10:55:19.074167 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.074107    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 17 10:55:19.074322 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.074287    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 17 10:55:19.074322 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.074297    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 17 10:55:19.074322 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.074317    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8b2lh\""
Jul 17 10:55:19.074542 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.074386    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa8163ef717e2114e56cca68e7f8e17a78416cd630b26cc08f11932879c7bb97"} err="failed to get container status \"fa8163ef717e2114e56cca68e7f8e17a78416cd630b26cc08f11932879c7bb97\": rpc error: code = NotFound desc = could not find container \"fa8163ef717e2114e56cca68e7f8e17a78416cd630b26cc08f11932879c7bb97\": container with ID starting with fa8163ef717e2114e56cca68e7f8e17a78416cd630b26cc08f11932879c7bb97 not found: ID does not exist"
Jul 17 10:55:19.074542 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.074423    2563 scope.go:117] "RemoveContainer" containerID="fdd365bb103ca6e7c69ec8ea262d0444cd5aaab29ca9f4b0a251ba7b9ca61f55"
Jul 17 10:55:19.074542 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.074474    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 17 10:55:19.074708 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.074592    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 17 10:55:19.074708 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.074666    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 17 10:55:19.074794 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.074708    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdd365bb103ca6e7c69ec8ea262d0444cd5aaab29ca9f4b0a251ba7b9ca61f55"} err="failed to get container status \"fdd365bb103ca6e7c69ec8ea262d0444cd5aaab29ca9f4b0a251ba7b9ca61f55\": rpc error: code = NotFound desc = could not find container \"fdd365bb103ca6e7c69ec8ea262d0444cd5aaab29ca9f4b0a251ba7b9ca61f55\": container with ID starting with fdd365bb103ca6e7c69ec8ea262d0444cd5aaab29ca9f4b0a251ba7b9ca61f55 not found: ID does not exist"
Jul 17 10:55:19.074794 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.074730    2563 scope.go:117] "RemoveContainer" containerID="76664eee3ef6e1834f76babd1bb802defd0b206be4e474123b7019f010ef929b"
Jul 17 10:55:19.074794 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.074698    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 17 10:55:19.074794 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.074719    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 17 10:55:19.075017 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.074989    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76664eee3ef6e1834f76babd1bb802defd0b206be4e474123b7019f010ef929b"} err="failed to get container status \"76664eee3ef6e1834f76babd1bb802defd0b206be4e474123b7019f010ef929b\": rpc error: code = NotFound desc = could not find container \"76664eee3ef6e1834f76babd1bb802defd0b206be4e474123b7019f010ef929b\": container with ID starting with 76664eee3ef6e1834f76babd1bb802defd0b206be4e474123b7019f010ef929b not found: ID does not exist"
Jul 17 10:55:19.075017 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.075018    2563 scope.go:117] "RemoveContainer" containerID="8a640cf9e52afad16fef860a5b907e0ab8eec6e63c9d489a5b833145296836a2"
Jul 17 10:55:19.075312 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.075283    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a640cf9e52afad16fef860a5b907e0ab8eec6e63c9d489a5b833145296836a2"} err="failed to get container status \"8a640cf9e52afad16fef860a5b907e0ab8eec6e63c9d489a5b833145296836a2\": rpc error: code = NotFound desc = could not find container \"8a640cf9e52afad16fef860a5b907e0ab8eec6e63c9d489a5b833145296836a2\": container with ID starting with 8a640cf9e52afad16fef860a5b907e0ab8eec6e63c9d489a5b833145296836a2 not found: ID does not exist"
Jul 17 10:55:19.075312 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.075312    2563 scope.go:117] "RemoveContainer" containerID="6bfe1e1a9133cda15dbef8254faf83ee1daad29100c5421712b564d47156067e"
Jul 17 10:55:19.075598 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.075575    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bfe1e1a9133cda15dbef8254faf83ee1daad29100c5421712b564d47156067e"} err="failed to get container status \"6bfe1e1a9133cda15dbef8254faf83ee1daad29100c5421712b564d47156067e\": rpc error: code = NotFound desc = could not find container \"6bfe1e1a9133cda15dbef8254faf83ee1daad29100c5421712b564d47156067e\": container with ID starting with 6bfe1e1a9133cda15dbef8254faf83ee1daad29100c5421712b564d47156067e not found: ID does not exist"
Jul 17 10:55:19.076937 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.076917    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 17 10:55:19.079186 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.079168    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 17 10:55:19.086369 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.086350    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 17 10:55:19.105393 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.105371    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80bf7d53-e9f4-455a-af96-b997888bd6ca-config-out\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.105485 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.105396    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/80bf7d53-e9f4-455a-af96-b997888bd6ca-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.105485 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.105412    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/80bf7d53-e9f4-455a-af96-b997888bd6ca-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.105485 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.105442    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80bf7d53-e9f4-455a-af96-b997888bd6ca-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.105590 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.105493    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80bf7d53-e9f4-455a-af96-b997888bd6ca-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.105590 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.105548    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/80bf7d53-e9f4-455a-af96-b997888bd6ca-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.105590 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.105566    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/80bf7d53-e9f4-455a-af96-b997888bd6ca-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.105590 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.105581    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/80bf7d53-e9f4-455a-af96-b997888bd6ca-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.105710 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.105636    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/80bf7d53-e9f4-455a-af96-b997888bd6ca-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.105710 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.105657    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/80bf7d53-e9f4-455a-af96-b997888bd6ca-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.105710 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.105672    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80bf7d53-e9f4-455a-af96-b997888bd6ca-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.105710 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.105689    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80bf7d53-e9f4-455a-af96-b997888bd6ca-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.105710 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.105703    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/80bf7d53-e9f4-455a-af96-b997888bd6ca-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.105857 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.105734    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80bf7d53-e9f4-455a-af96-b997888bd6ca-web-config\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.105857 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.105756    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80bf7d53-e9f4-455a-af96-b997888bd6ca-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.105857 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.105775    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/80bf7d53-e9f4-455a-af96-b997888bd6ca-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.105857 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.105799    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80bf7d53-e9f4-455a-af96-b997888bd6ca-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.105857 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.105822    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/80bf7d53-e9f4-455a-af96-b997888bd6ca-config\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.105857 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.105839    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwnrs\" (UniqueName: \"kubernetes.io/projected/80bf7d53-e9f4-455a-af96-b997888bd6ca-kube-api-access-qwnrs\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.106032 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.105865    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80bf7d53-e9f4-455a-af96-b997888bd6ca-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.206818 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.206791    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80bf7d53-e9f4-455a-af96-b997888bd6ca-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.206912 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.206826    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/80bf7d53-e9f4-455a-af96-b997888bd6ca-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.206912 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.206849    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/80bf7d53-e9f4-455a-af96-b997888bd6ca-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.206912 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.206872    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/80bf7d53-e9f4-455a-af96-b997888bd6ca-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.206912 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.206908    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/80bf7d53-e9f4-455a-af96-b997888bd6ca-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.207092 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.206935    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/80bf7d53-e9f4-455a-af96-b997888bd6ca-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.207092 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.207032    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80bf7d53-e9f4-455a-af96-b997888bd6ca-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.207092 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.207070    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80bf7d53-e9f4-455a-af96-b997888bd6ca-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.207222 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.207097    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/80bf7d53-e9f4-455a-af96-b997888bd6ca-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.207222 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.207129    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80bf7d53-e9f4-455a-af96-b997888bd6ca-web-config\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.207222 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.207159    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80bf7d53-e9f4-455a-af96-b997888bd6ca-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.207222 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.207190    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/80bf7d53-e9f4-455a-af96-b997888bd6ca-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.207222 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.207216    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80bf7d53-e9f4-455a-af96-b997888bd6ca-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.207476 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.207250    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/80bf7d53-e9f4-455a-af96-b997888bd6ca-config\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.207476 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.207278    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwnrs\" (UniqueName: \"kubernetes.io/projected/80bf7d53-e9f4-455a-af96-b997888bd6ca-kube-api-access-qwnrs\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.207476 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.207305    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80bf7d53-e9f4-455a-af96-b997888bd6ca-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.207476 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.207344    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80bf7d53-e9f4-455a-af96-b997888bd6ca-config-out\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.207476 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.207369    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/80bf7d53-e9f4-455a-af96-b997888bd6ca-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.207476 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.207395    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/80bf7d53-e9f4-455a-af96-b997888bd6ca-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.207476 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.207409    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/80bf7d53-e9f4-455a-af96-b997888bd6ca-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.207476 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.207421    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80bf7d53-e9f4-455a-af96-b997888bd6ca-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.207859 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.207567    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/80bf7d53-e9f4-455a-af96-b997888bd6ca-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.207859 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.207595    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80bf7d53-e9f4-455a-af96-b997888bd6ca-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.209063 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.208353    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80bf7d53-e9f4-455a-af96-b997888bd6ca-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.209063 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.208773    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/80bf7d53-e9f4-455a-af96-b997888bd6ca-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.209063 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.209002    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80bf7d53-e9f4-455a-af96-b997888bd6ca-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.209298 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.209081    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80bf7d53-e9f4-455a-af96-b997888bd6ca-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.210019 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.209996    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80bf7d53-e9f4-455a-af96-b997888bd6ca-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.210537 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.210501    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/80bf7d53-e9f4-455a-af96-b997888bd6ca-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.211166 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.211006    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/80bf7d53-e9f4-455a-af96-b997888bd6ca-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.211166 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.211113    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/80bf7d53-e9f4-455a-af96-b997888bd6ca-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.211453 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.211397    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80bf7d53-e9f4-455a-af96-b997888bd6ca-web-config\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.211671 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.211648    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/80bf7d53-e9f4-455a-af96-b997888bd6ca-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.211753 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.211653    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80bf7d53-e9f4-455a-af96-b997888bd6ca-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.211808 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.211754    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80bf7d53-e9f4-455a-af96-b997888bd6ca-config-out\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.212389 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.212366    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/80bf7d53-e9f4-455a-af96-b997888bd6ca-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.212685 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.212667    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80bf7d53-e9f4-455a-af96-b997888bd6ca-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.212892 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.212876    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/80bf7d53-e9f4-455a-af96-b997888bd6ca-config\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.213023 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.213007    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/80bf7d53-e9f4-455a-af96-b997888bd6ca-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.216505 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.216485    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwnrs\" (UniqueName: \"kubernetes.io/projected/80bf7d53-e9f4-455a-af96-b997888bd6ca-kube-api-access-qwnrs\") pod \"prometheus-k8s-0\" (UID: \"80bf7d53-e9f4-455a-af96-b997888bd6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.264030 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.263981    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="374a98d3-3821-46b7-972e-df5c52388f92" path="/var/lib/kubelet/pods/374a98d3-3821-46b7-972e-df5c52388f92/volumes"
Jul 17 10:55:19.381524 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.381500    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:55:19.528569 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:19.528502    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 17 10:55:19.532043 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:55:19.532008    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80bf7d53_e9f4_455a_af96_b997888bd6ca.slice/crio-b16c69fdaf042ae46ec28fa37b883702ba09fc319e6f4d3b27d7e69f064ac078 WatchSource:0}: Error finding container b16c69fdaf042ae46ec28fa37b883702ba09fc319e6f4d3b27d7e69f064ac078: Status 404 returned error can't find the container with id b16c69fdaf042ae46ec28fa37b883702ba09fc319e6f4d3b27d7e69f064ac078
Jul 17 10:55:20.016626 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:20.016597    2563 generic.go:356] "Generic (PLEG): container finished" podID="80bf7d53-e9f4-455a-af96-b997888bd6ca" containerID="7a21abc2941c4a703b1ec5d3290c3a979c9ce91ad21b6076a23d10464637b48c" exitCode=0
Jul 17 10:55:20.016735 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:20.016686    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80bf7d53-e9f4-455a-af96-b997888bd6ca","Type":"ContainerDied","Data":"7a21abc2941c4a703b1ec5d3290c3a979c9ce91ad21b6076a23d10464637b48c"}
Jul 17 10:55:20.016792 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:20.016756    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80bf7d53-e9f4-455a-af96-b997888bd6ca","Type":"ContainerStarted","Data":"b16c69fdaf042ae46ec28fa37b883702ba09fc319e6f4d3b27d7e69f064ac078"}
Jul 17 10:55:21.024986 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:21.024958    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80bf7d53-e9f4-455a-af96-b997888bd6ca","Type":"ContainerStarted","Data":"7a4463292f37e98a73cb5768c011eff454749239c46f548a9cd9ff62e3f5705f"}
Jul 17 10:55:21.025336 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:21.025059    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80bf7d53-e9f4-455a-af96-b997888bd6ca","Type":"ContainerStarted","Data":"31a6dbb3b8b5a9b0f30e6bd03dbefdac002d577bd68cee2428c1c2ac4c773e23"}
Jul 17 10:55:21.025336 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:21.025089    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80bf7d53-e9f4-455a-af96-b997888bd6ca","Type":"ContainerStarted","Data":"9aac38aff9e5cab60715572e62dd550b65292f6137301d6bb4e0c89501d8e9fc"}
Jul 17 10:55:21.025336 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:21.025113    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80bf7d53-e9f4-455a-af96-b997888bd6ca","Type":"ContainerStarted","Data":"580529fb147955e3cba1246bccd1ac73ea243601350645dd5837541b5bd28128"}
Jul 17 10:55:21.025336 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:21.025135    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80bf7d53-e9f4-455a-af96-b997888bd6ca","Type":"ContainerStarted","Data":"9d1fdfb5ba64a7e33cd12875d0bb525cfe6f3c17b0dbb4f030a0c8b363f84c82"}
Jul 17 10:55:21.025336 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:21.025157    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80bf7d53-e9f4-455a-af96-b997888bd6ca","Type":"ContainerStarted","Data":"6141b3386028445dab31d47116eeef147229c0d500cf2f5e448de89d0f544c78"}
Jul 17 10:55:24.382642 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:55:24.382609    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:56:19.382271 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:56:19.382239    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:56:19.396172 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:56:19.396150    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:56:19.425942 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:56:19.425874    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=60.407220446 podStartE2EDuration="1m0.42585643s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.635984ms" isStatefulPod=false podCreationTimestamp="2026-07-17 10:55:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:55:21.057802737 +0000 UTC m=+186.238835699" watchObservedRunningTime="2026-07-17 10:56:19.42585643 +0000 UTC m=+244.606889392"
Jul 17 10:56:20.233074 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:56:20.233049    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:57:15.177637 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:57:15.177611    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xdrhl_48cc1998-ebc5-4702-8b08-027479580e57/ovn-acl-logging/0.log"
Jul 17 10:57:15.184378 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:57:15.184356    2563 kubelet.go:1648] "Image garbage collection succeeded"
Jul 17 10:57:15.185421 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:57:15.185402    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xdrhl_48cc1998-ebc5-4702-8b08-027479580e57/ovn-acl-logging/0.log"
Jul 17 10:58:08.591291 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:08.591218    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp"]
Jul 17 10:58:08.594216 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:08.594201    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp"
Jul 17 10:58:08.598597 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:08.598578    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 17 10:58:08.598935 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:08.598921    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 17 10:58:08.599468 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:08.599448    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zjf47\""
Jul 17 10:58:08.599626 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:08.599590    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 17 10:58:08.602199 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:08.602184    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 17 10:58:08.617946 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:08.617917    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp"]
Jul 17 10:58:08.687499 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:08.687476    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/504118f3-6caf-4324-90c3-692d18de714a-webhook-cert\") pod \"opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp\" (UID: \"504118f3-6caf-4324-90c3-692d18de714a\") " pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp"
Jul 17 10:58:08.687577 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:08.687509    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/504118f3-6caf-4324-90c3-692d18de714a-tmp\") pod \"opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp\" (UID: \"504118f3-6caf-4324-90c3-692d18de714a\") " pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp"
Jul 17 10:58:08.687577 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:08.687573    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/504118f3-6caf-4324-90c3-692d18de714a-manifests\") pod \"opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp\" (UID: \"504118f3-6caf-4324-90c3-692d18de714a\") " pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp"
Jul 17 10:58:08.687644 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:08.687591    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/504118f3-6caf-4324-90c3-692d18de714a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp\" (UID: \"504118f3-6caf-4324-90c3-692d18de714a\") " pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp"
Jul 17 10:58:08.687692 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:08.687665    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpxrs\" (UniqueName: \"kubernetes.io/projected/504118f3-6caf-4324-90c3-692d18de714a-kube-api-access-zpxrs\") pod \"opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp\" (UID: \"504118f3-6caf-4324-90c3-692d18de714a\") " pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp"
Jul 17 10:58:08.788573 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:08.788543    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/504118f3-6caf-4324-90c3-692d18de714a-tmp\") pod \"opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp\" (UID: \"504118f3-6caf-4324-90c3-692d18de714a\") " pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp"
Jul 17 10:58:08.788658 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:08.788591    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/504118f3-6caf-4324-90c3-692d18de714a-manifests\") pod \"opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp\" (UID: \"504118f3-6caf-4324-90c3-692d18de714a\") " pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp"
Jul 17 10:58:08.788658 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:08.788609    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/504118f3-6caf-4324-90c3-692d18de714a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp\" (UID: \"504118f3-6caf-4324-90c3-692d18de714a\") " pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp"
Jul 17 10:58:08.788658 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:08.788644    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpxrs\" (UniqueName: \"kubernetes.io/projected/504118f3-6caf-4324-90c3-692d18de714a-kube-api-access-zpxrs\") pod \"opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp\" (UID: \"504118f3-6caf-4324-90c3-692d18de714a\") " pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp"
Jul 17 10:58:08.788757 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:08.788662    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/504118f3-6caf-4324-90c3-692d18de714a-webhook-cert\") pod \"opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp\" (UID: \"504118f3-6caf-4324-90c3-692d18de714a\") " pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp"
Jul 17 10:58:08.788989 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:08.788966    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/504118f3-6caf-4324-90c3-692d18de714a-manifests\") pod \"opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp\" (UID: \"504118f3-6caf-4324-90c3-692d18de714a\") " pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp"
Jul 17 10:58:08.790640 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:08.790621    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/504118f3-6caf-4324-90c3-692d18de714a-tmp\") pod \"opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp\" (UID: \"504118f3-6caf-4324-90c3-692d18de714a\") " pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp"
Jul 17 10:58:08.791047 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:08.791027    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/504118f3-6caf-4324-90c3-692d18de714a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp\" (UID: \"504118f3-6caf-4324-90c3-692d18de714a\") " pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp"
Jul 17 10:58:08.791113 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:08.791027    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/504118f3-6caf-4324-90c3-692d18de714a-webhook-cert\") pod \"opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp\" (UID: \"504118f3-6caf-4324-90c3-692d18de714a\") " pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp"
Jul 17 10:58:08.801883 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:08.801858    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpxrs\" (UniqueName: \"kubernetes.io/projected/504118f3-6caf-4324-90c3-692d18de714a-kube-api-access-zpxrs\") pod \"opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp\" (UID: \"504118f3-6caf-4324-90c3-692d18de714a\") " pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp"
Jul 17 10:58:08.903956 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:08.903932    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp"
Jul 17 10:58:09.038166 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:09.038137    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp"]
Jul 17 10:58:09.041943 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:58:09.041919    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod504118f3_6caf_4324_90c3_692d18de714a.slice/crio-66a01f3406b09cbf6c4629062b904b2637648cf210250a10a841247e3b76480e WatchSource:0}: Error finding container 66a01f3406b09cbf6c4629062b904b2637648cf210250a10a841247e3b76480e: Status 404 returned error can't find the container with id 66a01f3406b09cbf6c4629062b904b2637648cf210250a10a841247e3b76480e
Jul 17 10:58:09.043609 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:09.043590    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 10:58:09.557176 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:09.557150    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp" event={"ID":"504118f3-6caf-4324-90c3-692d18de714a","Type":"ContainerStarted","Data":"66a01f3406b09cbf6c4629062b904b2637648cf210250a10a841247e3b76480e"}
Jul 17 10:58:12.569585 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:12.569554    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp" event={"ID":"504118f3-6caf-4324-90c3-692d18de714a","Type":"ContainerStarted","Data":"935ad2e6d052b0e9eac3b883162e9e27f1c4ef34c4fdffec1204d0debc9dd4e3"}
Jul 17 10:58:13.574049 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:13.574022    2563 generic.go:356] "Generic (PLEG): container finished" podID="504118f3-6caf-4324-90c3-692d18de714a" containerID="935ad2e6d052b0e9eac3b883162e9e27f1c4ef34c4fdffec1204d0debc9dd4e3" exitCode=0
Jul 17 10:58:13.574393 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:13.574087    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp" event={"ID":"504118f3-6caf-4324-90c3-692d18de714a","Type":"ContainerDied","Data":"935ad2e6d052b0e9eac3b883162e9e27f1c4ef34c4fdffec1204d0debc9dd4e3"}
Jul 17 10:58:14.579775 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:14.579731    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp" event={"ID":"504118f3-6caf-4324-90c3-692d18de714a","Type":"ContainerStarted","Data":"c41dd51441712f6afdfda57f5e6a1f276f54971ee5e172a1c16c9825b26ad09d"}
Jul 17 10:58:14.580130 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:14.579861    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp"
Jul 17 10:58:14.602219 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:14.602173    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp" podStartSLOduration=2.489712385 podStartE2EDuration="6.602159647s" totalImagesPullingTime="3.147530706s" totalInitContainerRuntime="964.916556ms" isStatefulPod=false podCreationTimestamp="2026-07-17 10:58:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:58:14.600120562 +0000 UTC m=+359.781153550" watchObservedRunningTime="2026-07-17 10:58:14.602159647 +0000 UTC m=+359.783192650"
Jul 17 10:58:25.585411 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:25.585384    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp"
Jul 17 10:58:30.137510 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:30.137472    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bjtft"]
Jul 17 10:58:30.152883 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:30.152856    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bjtft"]
Jul 17 10:58:30.153043 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:30.152986    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bjtft"
Jul 17 10:58:30.156202 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:30.156170    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 17 10:58:30.156326 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:30.156213    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 17 10:58:30.156326 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:30.156214    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 17 10:58:30.156602 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:30.156577    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-r47p7\""
Jul 17 10:58:30.156717 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:30.156612    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 17 10:58:30.156780 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:30.156733    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 17 10:58:30.156834 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:30.156736    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 17 10:58:30.236569 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:30.236543    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0890f1f8-687b-44a1-bfab-48cf79365ee1-istio-token\") pod \"istiod-openshift-gateway-7574459656-bjtft\" (UID: \"0890f1f8-687b-44a1-bfab-48cf79365ee1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bjtft"
Jul 17 10:58:30.236721 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:30.236577    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0890f1f8-687b-44a1-bfab-48cf79365ee1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-bjtft\" (UID: \"0890f1f8-687b-44a1-bfab-48cf79365ee1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bjtft"
Jul 17 10:58:30.236721 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:30.236595    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bg7z\" (UniqueName: \"kubernetes.io/projected/0890f1f8-687b-44a1-bfab-48cf79365ee1-kube-api-access-7bg7z\") pod \"istiod-openshift-gateway-7574459656-bjtft\" (UID: \"0890f1f8-687b-44a1-bfab-48cf79365ee1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bjtft"
Jul 17 10:58:30.236721 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:30.236617    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0890f1f8-687b-44a1-bfab-48cf79365ee1-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-bjtft\" (UID: \"0890f1f8-687b-44a1-bfab-48cf79365ee1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bjtft"
Jul 17 10:58:30.236721 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:30.236681    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0890f1f8-687b-44a1-bfab-48cf79365ee1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-bjtft\" (UID: \"0890f1f8-687b-44a1-bfab-48cf79365ee1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bjtft"
Jul 17 10:58:30.236857 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:30.236796    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0890f1f8-687b-44a1-bfab-48cf79365ee1-cacerts\") pod \"istiod-openshift-gateway-7574459656-bjtft\" (UID: \"0890f1f8-687b-44a1-bfab-48cf79365ee1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bjtft"
Jul 17 10:58:30.236857 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:30.236845    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0890f1f8-687b-44a1-bfab-48cf79365ee1-local-certs\") pod \"istiod-openshift-gateway-7574459656-bjtft\" (UID: \"0890f1f8-687b-44a1-bfab-48cf79365ee1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bjtft"
Jul 17 10:58:30.337561 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:30.337524    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0890f1f8-687b-44a1-bfab-48cf79365ee1-istio-token\") pod \"istiod-openshift-gateway-7574459656-bjtft\" (UID: \"0890f1f8-687b-44a1-bfab-48cf79365ee1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bjtft"
Jul 17 10:58:30.337740 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:30.337570    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0890f1f8-687b-44a1-bfab-48cf79365ee1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-bjtft\" (UID: \"0890f1f8-687b-44a1-bfab-48cf79365ee1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bjtft"
Jul 17 10:58:30.337740 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:30.337594    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bg7z\" (UniqueName: \"kubernetes.io/projected/0890f1f8-687b-44a1-bfab-48cf79365ee1-kube-api-access-7bg7z\") pod \"istiod-openshift-gateway-7574459656-bjtft\" (UID: \"0890f1f8-687b-44a1-bfab-48cf79365ee1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bjtft"
Jul 17 10:58:30.337740 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:30.337622    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0890f1f8-687b-44a1-bfab-48cf79365ee1-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-bjtft\" (UID: \"0890f1f8-687b-44a1-bfab-48cf79365ee1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bjtft"
Jul 17 10:58:30.337740 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:30.337654    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0890f1f8-687b-44a1-bfab-48cf79365ee1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-bjtft\" (UID: \"0890f1f8-687b-44a1-bfab-48cf79365ee1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bjtft"
Jul 17 10:58:30.337740 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:30.337690    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0890f1f8-687b-44a1-bfab-48cf79365ee1-cacerts\") pod \"istiod-openshift-gateway-7574459656-bjtft\" (UID: \"0890f1f8-687b-44a1-bfab-48cf79365ee1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bjtft"
Jul 17 10:58:30.337740 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:30.337717    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0890f1f8-687b-44a1-bfab-48cf79365ee1-local-certs\") pod \"istiod-openshift-gateway-7574459656-bjtft\" (UID: \"0890f1f8-687b-44a1-bfab-48cf79365ee1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bjtft"
Jul 17 10:58:30.338224 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:30.338195    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0890f1f8-687b-44a1-bfab-48cf79365ee1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-bjtft\" (UID: \"0890f1f8-687b-44a1-bfab-48cf79365ee1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bjtft"
Jul 17 10:58:30.339967 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:30.339944    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0890f1f8-687b-44a1-bfab-48cf79365ee1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-bjtft\" (UID: \"0890f1f8-687b-44a1-bfab-48cf79365ee1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bjtft"
Jul 17 10:58:30.339967 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:30.339957    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0890f1f8-687b-44a1-bfab-48cf79365ee1-local-certs\") pod \"istiod-openshift-gateway-7574459656-bjtft\" (UID: \"0890f1f8-687b-44a1-bfab-48cf79365ee1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bjtft"
Jul 17 10:58:30.340293 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:30.340272    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0890f1f8-687b-44a1-bfab-48cf79365ee1-cacerts\") pod \"istiod-openshift-gateway-7574459656-bjtft\" (UID: \"0890f1f8-687b-44a1-bfab-48cf79365ee1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bjtft"
Jul 17 10:58:30.340293 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:30.340286    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0890f1f8-687b-44a1-bfab-48cf79365ee1-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-bjtft\" (UID: \"0890f1f8-687b-44a1-bfab-48cf79365ee1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bjtft"
Jul 17 10:58:30.345517 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:30.345493    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0890f1f8-687b-44a1-bfab-48cf79365ee1-istio-token\") pod \"istiod-openshift-gateway-7574459656-bjtft\" (UID: \"0890f1f8-687b-44a1-bfab-48cf79365ee1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bjtft"
Jul 17 10:58:30.345830 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:30.345811    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bg7z\" (UniqueName: \"kubernetes.io/projected/0890f1f8-687b-44a1-bfab-48cf79365ee1-kube-api-access-7bg7z\") pod \"istiod-openshift-gateway-7574459656-bjtft\" (UID: \"0890f1f8-687b-44a1-bfab-48cf79365ee1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bjtft"
Jul 17 10:58:30.462308 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:30.462281    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bjtft"
Jul 17 10:58:30.602660 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:30.602621    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bjtft"]
Jul 17 10:58:30.607087 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:58:30.607054    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0890f1f8_687b_44a1_bfab_48cf79365ee1.slice/crio-54a4886f5b2980c99e29328c84da790a553d79c23f841547eb3626e58154389d WatchSource:0}: Error finding container 54a4886f5b2980c99e29328c84da790a553d79c23f841547eb3626e58154389d: Status 404 returned error can't find the container with id 54a4886f5b2980c99e29328c84da790a553d79c23f841547eb3626e58154389d
Jul 17 10:58:30.636669 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:30.636634    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bjtft" event={"ID":"0890f1f8-687b-44a1-bfab-48cf79365ee1","Type":"ContainerStarted","Data":"54a4886f5b2980c99e29328c84da790a553d79c23f841547eb3626e58154389d"}
Jul 17 10:58:33.130820 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:33.130765    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 17 10:58:33.131127 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:33.130856    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 17 10:58:33.652744 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:33.652706    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bjtft" event={"ID":"0890f1f8-687b-44a1-bfab-48cf79365ee1","Type":"ContainerStarted","Data":"478f2bbe5b8c67359a506571ec9bf0e6fb4de41b586c2b14d8f793be554fdc42"}
Jul 17 10:58:33.653010 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:33.652851    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bjtft"
Jul 17 10:58:33.684766 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:33.684706    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bjtft" podStartSLOduration=1.163208243 podStartE2EDuration="3.684688222s" totalImagesPullingTime="2.521479979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:58:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:58:33.68224221 +0000 UTC m=+378.863275176" watchObservedRunningTime="2026-07-17 10:58:33.684688222 +0000 UTC m=+378.865721184"
Jul 17 10:58:34.658476 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:34.658423    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bjtft"
Jul 17 10:58:37.321309 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:37.321278    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-9895988c6-p2t2q"]
Jul 17 10:58:37.324587 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:37.324569    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-9895988c6-p2t2q"
Jul 17 10:58:37.331663 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:37.330056    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 17 10:58:37.331663 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:37.330404    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 17 10:58:37.331663 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:37.330448    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 17 10:58:37.331663 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:37.330745    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 17 10:58:37.331663 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:37.330952    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-l72dz\""
Jul 17 10:58:37.331663 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:37.331161    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 17 10:58:37.342356 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:37.342329    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-9895988c6-p2t2q"]
Jul 17 10:58:37.392119 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:37.392093    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a0ff0652-824f-4558-aacd-d5718d65421f-manager-config\") pod \"lws-controller-manager-9895988c6-p2t2q\" (UID: \"a0ff0652-824f-4558-aacd-d5718d65421f\") " pod="openshift-lws-operator/lws-controller-manager-9895988c6-p2t2q"
Jul 17 10:58:37.392200 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:37.392126    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a0ff0652-824f-4558-aacd-d5718d65421f-cert\") pod \"lws-controller-manager-9895988c6-p2t2q\" (UID: \"a0ff0652-824f-4558-aacd-d5718d65421f\") " pod="openshift-lws-operator/lws-controller-manager-9895988c6-p2t2q"
Jul 17 10:58:37.392200 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:37.392189    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a0ff0652-824f-4558-aacd-d5718d65421f-metrics-cert\") pod \"lws-controller-manager-9895988c6-p2t2q\" (UID: \"a0ff0652-824f-4558-aacd-d5718d65421f\") " pod="openshift-lws-operator/lws-controller-manager-9895988c6-p2t2q"
Jul 17 10:58:37.392298 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:37.392216    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs5q7\" (UniqueName: \"kubernetes.io/projected/a0ff0652-824f-4558-aacd-d5718d65421f-kube-api-access-cs5q7\") pod \"lws-controller-manager-9895988c6-p2t2q\" (UID: \"a0ff0652-824f-4558-aacd-d5718d65421f\") " pod="openshift-lws-operator/lws-controller-manager-9895988c6-p2t2q"
Jul 17 10:58:37.493232 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:37.493207    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a0ff0652-824f-4558-aacd-d5718d65421f-metrics-cert\") pod \"lws-controller-manager-9895988c6-p2t2q\" (UID: \"a0ff0652-824f-4558-aacd-d5718d65421f\") " pod="openshift-lws-operator/lws-controller-manager-9895988c6-p2t2q"
Jul 17 10:58:37.493322 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:37.493234    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs5q7\" (UniqueName: \"kubernetes.io/projected/a0ff0652-824f-4558-aacd-d5718d65421f-kube-api-access-cs5q7\") pod \"lws-controller-manager-9895988c6-p2t2q\" (UID: \"a0ff0652-824f-4558-aacd-d5718d65421f\") " pod="openshift-lws-operator/lws-controller-manager-9895988c6-p2t2q"
Jul 17 10:58:37.493322 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:37.493263    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a0ff0652-824f-4558-aacd-d5718d65421f-manager-config\") pod \"lws-controller-manager-9895988c6-p2t2q\" (UID: \"a0ff0652-824f-4558-aacd-d5718d65421f\") " pod="openshift-lws-operator/lws-controller-manager-9895988c6-p2t2q"
Jul 17 10:58:37.493322 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:37.493293    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a0ff0652-824f-4558-aacd-d5718d65421f-cert\") pod \"lws-controller-manager-9895988c6-p2t2q\" (UID: \"a0ff0652-824f-4558-aacd-d5718d65421f\") " pod="openshift-lws-operator/lws-controller-manager-9895988c6-p2t2q"
Jul 17 10:58:37.493837 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:37.493813    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a0ff0652-824f-4558-aacd-d5718d65421f-manager-config\") pod \"lws-controller-manager-9895988c6-p2t2q\" (UID: \"a0ff0652-824f-4558-aacd-d5718d65421f\") " pod="openshift-lws-operator/lws-controller-manager-9895988c6-p2t2q"
Jul 17 10:58:37.495454 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:37.495414    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a0ff0652-824f-4558-aacd-d5718d65421f-cert\") pod \"lws-controller-manager-9895988c6-p2t2q\" (UID: \"a0ff0652-824f-4558-aacd-d5718d65421f\") " pod="openshift-lws-operator/lws-controller-manager-9895988c6-p2t2q"
Jul 17 10:58:37.495530 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:37.495483    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a0ff0652-824f-4558-aacd-d5718d65421f-metrics-cert\") pod \"lws-controller-manager-9895988c6-p2t2q\" (UID: \"a0ff0652-824f-4558-aacd-d5718d65421f\") " pod="openshift-lws-operator/lws-controller-manager-9895988c6-p2t2q"
Jul 17 10:58:37.508324 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:37.508304    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs5q7\" (UniqueName: \"kubernetes.io/projected/a0ff0652-824f-4558-aacd-d5718d65421f-kube-api-access-cs5q7\") pod \"lws-controller-manager-9895988c6-p2t2q\" (UID: \"a0ff0652-824f-4558-aacd-d5718d65421f\") " pod="openshift-lws-operator/lws-controller-manager-9895988c6-p2t2q"
Jul 17 10:58:37.635278 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:37.635225    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-9895988c6-p2t2q"
Jul 17 10:58:37.758072 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:37.758047    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-9895988c6-p2t2q"]
Jul 17 10:58:37.759590 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:58:37.759568    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0ff0652_824f_4558_aacd_d5718d65421f.slice/crio-1fdfbaada5f88c2e4356348cf12c3084c2c2e3b834321a19094b8d1bd5083ddc WatchSource:0}: Error finding container 1fdfbaada5f88c2e4356348cf12c3084c2c2e3b834321a19094b8d1bd5083ddc: Status 404 returned error can't find the container with id 1fdfbaada5f88c2e4356348cf12c3084c2c2e3b834321a19094b8d1bd5083ddc
Jul 17 10:58:38.673641 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:38.673601    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-9895988c6-p2t2q" event={"ID":"a0ff0652-824f-4558-aacd-d5718d65421f","Type":"ContainerStarted","Data":"1fdfbaada5f88c2e4356348cf12c3084c2c2e3b834321a19094b8d1bd5083ddc"}
Jul 17 10:58:40.684084 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:40.684054    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-9895988c6-p2t2q" event={"ID":"a0ff0652-824f-4558-aacd-d5718d65421f","Type":"ContainerStarted","Data":"69a73f28d30a81dc157870c4e586ee7c31714aad9687036352e8b4adc4df8967"}
Jul 17 10:58:40.684460 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:40.684213    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-9895988c6-p2t2q"
Jul 17 10:58:42.691387 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:42.691339    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-9895988c6-p2t2q" podStartSLOduration=3.49556216 podStartE2EDuration="5.691321458s" totalImagesPullingTime="2.195759298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:58:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:58:40.73998653 +0000 UTC m=+385.921019493" watchObservedRunningTime="2026-07-17 10:58:42.691321458 +0000 UTC m=+387.872354417"
Jul 17 10:58:42.691791 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:42.691780    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bjtft"]
Jul 17 10:58:42.691938 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:42.691919    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bjtft" podUID="0890f1f8-687b-44a1-bfab-48cf79365ee1" containerName="discovery" containerID="cri-o://478f2bbe5b8c67359a506571ec9bf0e6fb4de41b586c2b14d8f793be554fdc42" gracePeriod=30
Jul 17 10:58:42.929511 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:42.929489    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bjtft"
Jul 17 10:58:43.035953 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:43.035890    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0890f1f8-687b-44a1-bfab-48cf79365ee1-istio-csr-dns-cert\") pod \"0890f1f8-687b-44a1-bfab-48cf79365ee1\" (UID: \"0890f1f8-687b-44a1-bfab-48cf79365ee1\") "
Jul 17 10:58:43.035953 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:43.035922    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bg7z\" (UniqueName: \"kubernetes.io/projected/0890f1f8-687b-44a1-bfab-48cf79365ee1-kube-api-access-7bg7z\") pod \"0890f1f8-687b-44a1-bfab-48cf79365ee1\" (UID: \"0890f1f8-687b-44a1-bfab-48cf79365ee1\") "
Jul 17 10:58:43.036145 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:43.035988    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0890f1f8-687b-44a1-bfab-48cf79365ee1-cacerts\") pod \"0890f1f8-687b-44a1-bfab-48cf79365ee1\" (UID: \"0890f1f8-687b-44a1-bfab-48cf79365ee1\") "
Jul 17 10:58:43.036145 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:43.036076    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0890f1f8-687b-44a1-bfab-48cf79365ee1-istio-kubeconfig\") pod \"0890f1f8-687b-44a1-bfab-48cf79365ee1\" (UID: \"0890f1f8-687b-44a1-bfab-48cf79365ee1\") "
Jul 17 10:58:43.036145 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:43.036108    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0890f1f8-687b-44a1-bfab-48cf79365ee1-istio-csr-ca-configmap\") pod \"0890f1f8-687b-44a1-bfab-48cf79365ee1\" (UID: \"0890f1f8-687b-44a1-bfab-48cf79365ee1\") "
Jul 17 10:58:43.036291 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:43.036166    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0890f1f8-687b-44a1-bfab-48cf79365ee1-istio-token\") pod \"0890f1f8-687b-44a1-bfab-48cf79365ee1\" (UID: \"0890f1f8-687b-44a1-bfab-48cf79365ee1\") "
Jul 17 10:58:43.036291 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:43.036185    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0890f1f8-687b-44a1-bfab-48cf79365ee1-local-certs\") pod \"0890f1f8-687b-44a1-bfab-48cf79365ee1\" (UID: \"0890f1f8-687b-44a1-bfab-48cf79365ee1\") "
Jul 17 10:58:43.036603 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:43.036556    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0890f1f8-687b-44a1-bfab-48cf79365ee1-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "0890f1f8-687b-44a1-bfab-48cf79365ee1" (UID: "0890f1f8-687b-44a1-bfab-48cf79365ee1"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 10:58:43.038199 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:43.038172    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0890f1f8-687b-44a1-bfab-48cf79365ee1-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "0890f1f8-687b-44a1-bfab-48cf79365ee1" (UID: "0890f1f8-687b-44a1-bfab-48cf79365ee1"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 10:58:43.038299 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:43.038206    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0890f1f8-687b-44a1-bfab-48cf79365ee1-local-certs" (OuterVolumeSpecName: "local-certs") pod "0890f1f8-687b-44a1-bfab-48cf79365ee1" (UID: "0890f1f8-687b-44a1-bfab-48cf79365ee1"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:58:43.038410 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:43.038383    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0890f1f8-687b-44a1-bfab-48cf79365ee1-cacerts" (OuterVolumeSpecName: "cacerts") pod "0890f1f8-687b-44a1-bfab-48cf79365ee1" (UID: "0890f1f8-687b-44a1-bfab-48cf79365ee1"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 10:58:43.038524 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:43.038457    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0890f1f8-687b-44a1-bfab-48cf79365ee1-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "0890f1f8-687b-44a1-bfab-48cf79365ee1" (UID: "0890f1f8-687b-44a1-bfab-48cf79365ee1"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 10:58:43.038524 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:43.038464    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0890f1f8-687b-44a1-bfab-48cf79365ee1-istio-token" (OuterVolumeSpecName: "istio-token") pod "0890f1f8-687b-44a1-bfab-48cf79365ee1" (UID: "0890f1f8-687b-44a1-bfab-48cf79365ee1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 10:58:43.038605 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:43.038582    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0890f1f8-687b-44a1-bfab-48cf79365ee1-kube-api-access-7bg7z" (OuterVolumeSpecName: "kube-api-access-7bg7z") pod "0890f1f8-687b-44a1-bfab-48cf79365ee1" (UID: "0890f1f8-687b-44a1-bfab-48cf79365ee1"). InnerVolumeSpecName "kube-api-access-7bg7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 10:58:43.137205 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:43.137179    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0890f1f8-687b-44a1-bfab-48cf79365ee1-istio-token\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 10:58:43.137205 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:43.137202    2563 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0890f1f8-687b-44a1-bfab-48cf79365ee1-local-certs\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 10:58:43.137334 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:43.137210    2563 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0890f1f8-687b-44a1-bfab-48cf79365ee1-istio-csr-dns-cert\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 10:58:43.137334 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:43.137219    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bg7z\" (UniqueName: \"kubernetes.io/projected/0890f1f8-687b-44a1-bfab-48cf79365ee1-kube-api-access-7bg7z\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 10:58:43.137334 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:43.137229    2563 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0890f1f8-687b-44a1-bfab-48cf79365ee1-cacerts\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 10:58:43.137334 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:43.137237    2563 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0890f1f8-687b-44a1-bfab-48cf79365ee1-istio-kubeconfig\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 10:58:43.137334 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:43.137245    2563 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0890f1f8-687b-44a1-bfab-48cf79365ee1-istio-csr-ca-configmap\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 10:58:43.701440 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:43.701397    2563 generic.go:356] "Generic (PLEG): container finished" podID="0890f1f8-687b-44a1-bfab-48cf79365ee1" containerID="478f2bbe5b8c67359a506571ec9bf0e6fb4de41b586c2b14d8f793be554fdc42" exitCode=0
Jul 17 10:58:43.701843 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:43.701472    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bjtft"
Jul 17 10:58:43.701843 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:43.701474    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bjtft" event={"ID":"0890f1f8-687b-44a1-bfab-48cf79365ee1","Type":"ContainerDied","Data":"478f2bbe5b8c67359a506571ec9bf0e6fb4de41b586c2b14d8f793be554fdc42"}
Jul 17 10:58:43.701843 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:43.701545    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bjtft" event={"ID":"0890f1f8-687b-44a1-bfab-48cf79365ee1","Type":"ContainerDied","Data":"54a4886f5b2980c99e29328c84da790a553d79c23f841547eb3626e58154389d"}
Jul 17 10:58:43.701843 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:43.701564    2563 scope.go:117] "RemoveContainer" containerID="478f2bbe5b8c67359a506571ec9bf0e6fb4de41b586c2b14d8f793be554fdc42"
Jul 17 10:58:43.711420 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:43.711405    2563 scope.go:117] "RemoveContainer" containerID="478f2bbe5b8c67359a506571ec9bf0e6fb4de41b586c2b14d8f793be554fdc42"
Jul 17 10:58:43.711687 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:58:43.711658    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"478f2bbe5b8c67359a506571ec9bf0e6fb4de41b586c2b14d8f793be554fdc42\": container with ID starting with 478f2bbe5b8c67359a506571ec9bf0e6fb4de41b586c2b14d8f793be554fdc42 not found: ID does not exist" containerID="478f2bbe5b8c67359a506571ec9bf0e6fb4de41b586c2b14d8f793be554fdc42"
Jul 17 10:58:43.711762 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:43.711688    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"478f2bbe5b8c67359a506571ec9bf0e6fb4de41b586c2b14d8f793be554fdc42"} err="failed to get container status \"478f2bbe5b8c67359a506571ec9bf0e6fb4de41b586c2b14d8f793be554fdc42\": rpc error: code = NotFound desc = could not find container \"478f2bbe5b8c67359a506571ec9bf0e6fb4de41b586c2b14d8f793be554fdc42\": container with ID starting with 478f2bbe5b8c67359a506571ec9bf0e6fb4de41b586c2b14d8f793be554fdc42 not found: ID does not exist"
Jul 17 10:58:43.726026 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:43.726003    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bjtft"]
Jul 17 10:58:43.729319 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:43.729297    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bjtft"]
Jul 17 10:58:45.263486 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:45.263461    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0890f1f8-687b-44a1-bfab-48cf79365ee1" path="/var/lib/kubelet/pods/0890f1f8-687b-44a1-bfab-48cf79365ee1/volumes"
Jul 17 10:58:51.689494 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:58:51.689465    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-9895988c6-p2t2q"
Jul 17 10:59:29.676477 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:29.676446    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7z82g"]
Jul 17 10:59:29.676897 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:29.676694    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0890f1f8-687b-44a1-bfab-48cf79365ee1" containerName="discovery"
Jul 17 10:59:29.676897 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:29.676704    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0890f1f8-687b-44a1-bfab-48cf79365ee1" containerName="discovery"
Jul 17 10:59:29.676897 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:29.676751    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0890f1f8-687b-44a1-bfab-48cf79365ee1" containerName="discovery"
Jul 17 10:59:29.679038 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:29.679023    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7z82g"
Jul 17 10:59:29.681801 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:29.681776    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 17 10:59:29.681916 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:29.681845    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 17 10:59:29.682742 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:29.682726    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-6c2dh\""
Jul 17 10:59:29.691370 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:29.691351    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7z82g"]
Jul 17 10:59:29.753507 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:29.753482    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h2td\" (UniqueName: \"kubernetes.io/projected/ded8f044-5c53-492f-907d-dae55b060b66-kube-api-access-6h2td\") pod \"kuadrant-operator-catalog-7z82g\" (UID: \"ded8f044-5c53-492f-907d-dae55b060b66\") " pod="kuadrant-system/kuadrant-operator-catalog-7z82g"
Jul 17 10:59:29.854445 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:29.854408    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h2td\" (UniqueName: \"kubernetes.io/projected/ded8f044-5c53-492f-907d-dae55b060b66-kube-api-access-6h2td\") pod \"kuadrant-operator-catalog-7z82g\" (UID: \"ded8f044-5c53-492f-907d-dae55b060b66\") " pod="kuadrant-system/kuadrant-operator-catalog-7z82g"
Jul 17 10:59:29.862705 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:29.862682    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h2td\" (UniqueName: \"kubernetes.io/projected/ded8f044-5c53-492f-907d-dae55b060b66-kube-api-access-6h2td\") pod \"kuadrant-operator-catalog-7z82g\" (UID: \"ded8f044-5c53-492f-907d-dae55b060b66\") " pod="kuadrant-system/kuadrant-operator-catalog-7z82g"
Jul 17 10:59:29.988864 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:29.988799    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7z82g"
Jul 17 10:59:30.015587 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:30.015565    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7z82g"]
Jul 17 10:59:30.134316 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:30.134285    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7z82g"]
Jul 17 10:59:30.148636 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:59:30.148611    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podded8f044_5c53_492f_907d_dae55b060b66.slice/crio-4d2291049a3d39967aeab220993bfd2bdde58857d5df4d06f01163ad55ebaefb WatchSource:0}: Error finding container 4d2291049a3d39967aeab220993bfd2bdde58857d5df4d06f01163ad55ebaefb: Status 404 returned error can't find the container with id 4d2291049a3d39967aeab220993bfd2bdde58857d5df4d06f01163ad55ebaefb
Jul 17 10:59:30.223699 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:30.223677    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tzxf9"]
Jul 17 10:59:30.226794 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:30.226775    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tzxf9"
Jul 17 10:59:30.237218 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:30.237192    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tzxf9"]
Jul 17 10:59:30.257722 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:30.257657    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdgb4\" (UniqueName: \"kubernetes.io/projected/8de2a0dd-71a6-4123-a507-9f26494d1b5d-kube-api-access-gdgb4\") pod \"kuadrant-operator-catalog-tzxf9\" (UID: \"8de2a0dd-71a6-4123-a507-9f26494d1b5d\") " pod="kuadrant-system/kuadrant-operator-catalog-tzxf9"
Jul 17 10:59:30.358651 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:30.358619    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdgb4\" (UniqueName: \"kubernetes.io/projected/8de2a0dd-71a6-4123-a507-9f26494d1b5d-kube-api-access-gdgb4\") pod \"kuadrant-operator-catalog-tzxf9\" (UID: \"8de2a0dd-71a6-4123-a507-9f26494d1b5d\") " pod="kuadrant-system/kuadrant-operator-catalog-tzxf9"
Jul 17 10:59:30.366818 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:30.366794    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdgb4\" (UniqueName: \"kubernetes.io/projected/8de2a0dd-71a6-4123-a507-9f26494d1b5d-kube-api-access-gdgb4\") pod \"kuadrant-operator-catalog-tzxf9\" (UID: \"8de2a0dd-71a6-4123-a507-9f26494d1b5d\") " pod="kuadrant-system/kuadrant-operator-catalog-tzxf9"
Jul 17 10:59:30.537496 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:30.537415    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tzxf9"
Jul 17 10:59:30.674342 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:30.674321    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tzxf9"]
Jul 17 10:59:30.679184 ip-10-0-143-12 kubenswrapper[2563]: W0717 10:59:30.679141    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8de2a0dd_71a6_4123_a507_9f26494d1b5d.slice/crio-8f69ac4e19c45c77d52876ecc2f8d87ea476ca1a9ce077846160b4958d74e6ac WatchSource:0}: Error finding container 8f69ac4e19c45c77d52876ecc2f8d87ea476ca1a9ce077846160b4958d74e6ac: Status 404 returned error can't find the container with id 8f69ac4e19c45c77d52876ecc2f8d87ea476ca1a9ce077846160b4958d74e6ac
Jul 17 10:59:30.869678 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:30.869611    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tzxf9" event={"ID":"8de2a0dd-71a6-4123-a507-9f26494d1b5d","Type":"ContainerStarted","Data":"8f69ac4e19c45c77d52876ecc2f8d87ea476ca1a9ce077846160b4958d74e6ac"}
Jul 17 10:59:30.870817 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:30.870778    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7z82g" event={"ID":"ded8f044-5c53-492f-907d-dae55b060b66","Type":"ContainerStarted","Data":"4d2291049a3d39967aeab220993bfd2bdde58857d5df4d06f01163ad55ebaefb"}
Jul 17 10:59:32.879322 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:32.879284    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tzxf9" event={"ID":"8de2a0dd-71a6-4123-a507-9f26494d1b5d","Type":"ContainerStarted","Data":"519ae37671213c5c4be77788bdfce280d1bd70100c8559538bef5ea3f2988287"}
Jul 17 10:59:32.880681 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:32.880652    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7z82g" event={"ID":"ded8f044-5c53-492f-907d-dae55b060b66","Type":"ContainerStarted","Data":"3d9c05154e77e453d441413b8ac09d77f27267fc3442b1edc737c6e7882c7e01"}
Jul 17 10:59:32.880795 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:32.880775    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-7z82g" podUID="ded8f044-5c53-492f-907d-dae55b060b66" containerName="registry-server" containerID="cri-o://3d9c05154e77e453d441413b8ac09d77f27267fc3442b1edc737c6e7882c7e01" gracePeriod=2
Jul 17 10:59:32.895930 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:32.895894    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-tzxf9" podStartSLOduration=1.5801445539999999 podStartE2EDuration="2.895880603s" totalImagesPullingTime="1.315736049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:59:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:59:32.894768881 +0000 UTC m=+438.075801843" watchObservedRunningTime="2026-07-17 10:59:32.895880603 +0000 UTC m=+438.076913542"
Jul 17 10:59:32.909896 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:32.909855    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-7z82g" podStartSLOduration=2.06617884 podStartE2EDuration="3.90984403s" totalImagesPullingTime="1.84366519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:59:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:59:32.909529506 +0000 UTC m=+438.090562470" watchObservedRunningTime="2026-07-17 10:59:32.90984403 +0000 UTC m=+438.090876974"
Jul 17 10:59:33.107847 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:33.107824    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7z82g"
Jul 17 10:59:33.180049 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:33.180029    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6h2td\" (UniqueName: \"kubernetes.io/projected/ded8f044-5c53-492f-907d-dae55b060b66-kube-api-access-6h2td\") pod \"ded8f044-5c53-492f-907d-dae55b060b66\" (UID: \"ded8f044-5c53-492f-907d-dae55b060b66\") "
Jul 17 10:59:33.181959 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:33.181941    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ded8f044-5c53-492f-907d-dae55b060b66-kube-api-access-6h2td" (OuterVolumeSpecName: "kube-api-access-6h2td") pod "ded8f044-5c53-492f-907d-dae55b060b66" (UID: "ded8f044-5c53-492f-907d-dae55b060b66"). InnerVolumeSpecName "kube-api-access-6h2td". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 10:59:33.281348 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:33.281328    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6h2td\" (UniqueName: \"kubernetes.io/projected/ded8f044-5c53-492f-907d-dae55b060b66-kube-api-access-6h2td\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 10:59:33.885332 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:33.885304    2563 generic.go:356] "Generic (PLEG): container finished" podID="ded8f044-5c53-492f-907d-dae55b060b66" containerID="3d9c05154e77e453d441413b8ac09d77f27267fc3442b1edc737c6e7882c7e01" exitCode=0
Jul 17 10:59:33.885721 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:33.885346    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7z82g"
Jul 17 10:59:33.885721 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:33.885399    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7z82g" event={"ID":"ded8f044-5c53-492f-907d-dae55b060b66","Type":"ContainerDied","Data":"3d9c05154e77e453d441413b8ac09d77f27267fc3442b1edc737c6e7882c7e01"}
Jul 17 10:59:33.885721 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:33.885464    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7z82g" event={"ID":"ded8f044-5c53-492f-907d-dae55b060b66","Type":"ContainerDied","Data":"4d2291049a3d39967aeab220993bfd2bdde58857d5df4d06f01163ad55ebaefb"}
Jul 17 10:59:33.885721 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:33.885496    2563 scope.go:117] "RemoveContainer" containerID="3d9c05154e77e453d441413b8ac09d77f27267fc3442b1edc737c6e7882c7e01"
Jul 17 10:59:33.893276 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:33.893259    2563 scope.go:117] "RemoveContainer" containerID="3d9c05154e77e453d441413b8ac09d77f27267fc3442b1edc737c6e7882c7e01"
Jul 17 10:59:33.893513 ip-10-0-143-12 kubenswrapper[2563]: E0717 10:59:33.893496    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d9c05154e77e453d441413b8ac09d77f27267fc3442b1edc737c6e7882c7e01\": container with ID starting with 3d9c05154e77e453d441413b8ac09d77f27267fc3442b1edc737c6e7882c7e01 not found: ID does not exist" containerID="3d9c05154e77e453d441413b8ac09d77f27267fc3442b1edc737c6e7882c7e01"
Jul 17 10:59:33.893576 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:33.893526    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d9c05154e77e453d441413b8ac09d77f27267fc3442b1edc737c6e7882c7e01"} err="failed to get container status \"3d9c05154e77e453d441413b8ac09d77f27267fc3442b1edc737c6e7882c7e01\": rpc error: code = NotFound desc = could not find container \"3d9c05154e77e453d441413b8ac09d77f27267fc3442b1edc737c6e7882c7e01\": container with ID starting with 3d9c05154e77e453d441413b8ac09d77f27267fc3442b1edc737c6e7882c7e01 not found: ID does not exist"
Jul 17 10:59:33.906603 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:33.906575    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7z82g"]
Jul 17 10:59:33.908882 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:33.908857    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7z82g"]
Jul 17 10:59:35.264032 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:35.264006    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ded8f044-5c53-492f-907d-dae55b060b66" path="/var/lib/kubelet/pods/ded8f044-5c53-492f-907d-dae55b060b66/volumes"
Jul 17 10:59:40.538086 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:40.538009    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-tzxf9"
Jul 17 10:59:40.538086 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:40.538066    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-tzxf9"
Jul 17 10:59:40.558928 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:40.558904    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-tzxf9"
Jul 17 10:59:40.928224 ip-10-0-143-12 kubenswrapper[2563]: I0717 10:59:40.928202    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-tzxf9"
Jul 17 11:00:01.542601 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:01.542573    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2lmw"]
Jul 17 11:00:01.543032 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:01.542841    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ded8f044-5c53-492f-907d-dae55b060b66" containerName="registry-server"
Jul 17 11:00:01.543032 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:01.542854    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ded8f044-5c53-492f-907d-dae55b060b66" containerName="registry-server"
Jul 17 11:00:01.543032 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:01.542909    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ded8f044-5c53-492f-907d-dae55b060b66" containerName="registry-server"
Jul 17 11:00:01.549215 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:01.549196    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2lmw"
Jul 17 11:00:01.551761 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:01.551742    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-j29qz\""
Jul 17 11:00:01.551882 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:01.551829    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 17 11:00:01.556167 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:01.556150    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2lmw"]
Jul 17 11:00:01.668950 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:01.668929    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg828\" (UniqueName: \"kubernetes.io/projected/0652b352-b67e-4d5e-a470-196b6d295074-kube-api-access-fg828\") pod \"dns-operator-controller-manager-864dd78c4c-t2lmw\" (UID: \"0652b352-b67e-4d5e-a470-196b6d295074\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2lmw"
Jul 17 11:00:01.769799 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:01.769779    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg828\" (UniqueName: \"kubernetes.io/projected/0652b352-b67e-4d5e-a470-196b6d295074-kube-api-access-fg828\") pod \"dns-operator-controller-manager-864dd78c4c-t2lmw\" (UID: \"0652b352-b67e-4d5e-a470-196b6d295074\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2lmw"
Jul 17 11:00:01.807813 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:01.807768    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg828\" (UniqueName: \"kubernetes.io/projected/0652b352-b67e-4d5e-a470-196b6d295074-kube-api-access-fg828\") pod \"dns-operator-controller-manager-864dd78c4c-t2lmw\" (UID: \"0652b352-b67e-4d5e-a470-196b6d295074\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2lmw"
Jul 17 11:00:01.859295 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:01.859273    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2lmw"
Jul 17 11:00:01.985213 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:01.985185    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2lmw"]
Jul 17 11:00:01.988320 ip-10-0-143-12 kubenswrapper[2563]: W0717 11:00:01.988298    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0652b352_b67e_4d5e_a470_196b6d295074.slice/crio-559b95b843b252cc8cf0494edf138ef32baf78b16b0f4b12b4951b6069840460 WatchSource:0}: Error finding container 559b95b843b252cc8cf0494edf138ef32baf78b16b0f4b12b4951b6069840460: Status 404 returned error can't find the container with id 559b95b843b252cc8cf0494edf138ef32baf78b16b0f4b12b4951b6069840460
Jul 17 11:00:02.985774 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:02.985737    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2lmw" event={"ID":"0652b352-b67e-4d5e-a470-196b6d295074","Type":"ContainerStarted","Data":"559b95b843b252cc8cf0494edf138ef32baf78b16b0f4b12b4951b6069840460"}
Jul 17 11:00:04.995912 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:04.995877    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2lmw" event={"ID":"0652b352-b67e-4d5e-a470-196b6d295074","Type":"ContainerStarted","Data":"61f51156136346f25002cea74b922291eec104a856ce42a23d3e3f2cc05ccf94"}
Jul 17 11:00:04.996233 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:04.995990    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2lmw"
Jul 17 11:00:05.016776 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:05.016732    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2lmw" podStartSLOduration=1.522774947 podStartE2EDuration="4.016718532s" totalImagesPullingTime="2.493943585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:00:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:00:05.014974123 +0000 UTC m=+470.196007104" watchObservedRunningTime="2026-07-17 11:00:05.016718532 +0000 UTC m=+470.197751494"
Jul 17 11:00:06.852306 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:06.852277    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsbgm"]
Jul 17 11:00:06.856285 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:06.856264    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsbgm"
Jul 17 11:00:06.859629 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:06.859600    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-gj76v\""
Jul 17 11:00:06.873119 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:06.873096    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsbgm"]
Jul 17 11:00:06.904957 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:06.904930    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e73ae0f-efad-41e5-9312-b3581058dc95-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bsbgm\" (UID: \"3e73ae0f-efad-41e5-9312-b3581058dc95\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsbgm"
Jul 17 11:00:06.905038 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:06.904971    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hv7t\" (UniqueName: \"kubernetes.io/projected/3e73ae0f-efad-41e5-9312-b3581058dc95-kube-api-access-8hv7t\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bsbgm\" (UID: \"3e73ae0f-efad-41e5-9312-b3581058dc95\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsbgm"
Jul 17 11:00:07.006148 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:07.006119    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e73ae0f-efad-41e5-9312-b3581058dc95-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bsbgm\" (UID: \"3e73ae0f-efad-41e5-9312-b3581058dc95\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsbgm"
Jul 17 11:00:07.006306 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:07.006172    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hv7t\" (UniqueName: \"kubernetes.io/projected/3e73ae0f-efad-41e5-9312-b3581058dc95-kube-api-access-8hv7t\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bsbgm\" (UID: \"3e73ae0f-efad-41e5-9312-b3581058dc95\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsbgm"
Jul 17 11:00:07.006525 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:07.006505    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e73ae0f-efad-41e5-9312-b3581058dc95-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bsbgm\" (UID: \"3e73ae0f-efad-41e5-9312-b3581058dc95\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsbgm"
Jul 17 11:00:07.018054 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:07.018035    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hv7t\" (UniqueName: \"kubernetes.io/projected/3e73ae0f-efad-41e5-9312-b3581058dc95-kube-api-access-8hv7t\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bsbgm\" (UID: \"3e73ae0f-efad-41e5-9312-b3581058dc95\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsbgm"
Jul 17 11:00:07.165907 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:07.165884    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsbgm"
Jul 17 11:00:07.310093 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:07.310070    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsbgm"]
Jul 17 11:00:07.313226 ip-10-0-143-12 kubenswrapper[2563]: W0717 11:00:07.313195    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e73ae0f_efad_41e5_9312_b3581058dc95.slice/crio-ca9d026529fb2f8fcfd621e46404eeb7a5777408307b6075fc11faec3ef31717 WatchSource:0}: Error finding container ca9d026529fb2f8fcfd621e46404eeb7a5777408307b6075fc11faec3ef31717: Status 404 returned error can't find the container with id ca9d026529fb2f8fcfd621e46404eeb7a5777408307b6075fc11faec3ef31717
Jul 17 11:00:08.009677 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:08.009646    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsbgm" event={"ID":"3e73ae0f-efad-41e5-9312-b3581058dc95","Type":"ContainerStarted","Data":"ca9d026529fb2f8fcfd621e46404eeb7a5777408307b6075fc11faec3ef31717"}
Jul 17 11:00:10.235803 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:10.235776    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-hwjf6"]
Jul 17 11:00:10.239137 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:10.239112    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hwjf6"
Jul 17 11:00:10.241906 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:10.241879    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-zz2gl\""
Jul 17 11:00:10.246243 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:10.246187    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-hwjf6"]
Jul 17 11:00:10.331651 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:10.331616    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsjtf\" (UniqueName: \"kubernetes.io/projected/fef1d476-1e14-49ce-92ca-af77a0511610-kube-api-access-rsjtf\") pod \"authorino-operator-75cc8d5cb7-hwjf6\" (UID: \"fef1d476-1e14-49ce-92ca-af77a0511610\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-hwjf6"
Jul 17 11:00:10.432534 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:10.432503    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsjtf\" (UniqueName: \"kubernetes.io/projected/fef1d476-1e14-49ce-92ca-af77a0511610-kube-api-access-rsjtf\") pod \"authorino-operator-75cc8d5cb7-hwjf6\" (UID: \"fef1d476-1e14-49ce-92ca-af77a0511610\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-hwjf6"
Jul 17 11:00:10.441422 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:10.441393    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsjtf\" (UniqueName: \"kubernetes.io/projected/fef1d476-1e14-49ce-92ca-af77a0511610-kube-api-access-rsjtf\") pod \"authorino-operator-75cc8d5cb7-hwjf6\" (UID: \"fef1d476-1e14-49ce-92ca-af77a0511610\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-hwjf6"
Jul 17 11:00:10.551739 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:10.551681    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hwjf6"
Jul 17 11:00:10.684712 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:10.684662    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-hwjf6"]
Jul 17 11:00:10.689048 ip-10-0-143-12 kubenswrapper[2563]: W0717 11:00:10.689012    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfef1d476_1e14_49ce_92ca_af77a0511610.slice/crio-4de77c4250bc9f66183ff2bb262da81d68d19cf23ee81509a6a1d0b9a2d75db1 WatchSource:0}: Error finding container 4de77c4250bc9f66183ff2bb262da81d68d19cf23ee81509a6a1d0b9a2d75db1: Status 404 returned error can't find the container with id 4de77c4250bc9f66183ff2bb262da81d68d19cf23ee81509a6a1d0b9a2d75db1
Jul 17 11:00:11.021750 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:11.021720    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hwjf6" event={"ID":"fef1d476-1e14-49ce-92ca-af77a0511610","Type":"ContainerStarted","Data":"4de77c4250bc9f66183ff2bb262da81d68d19cf23ee81509a6a1d0b9a2d75db1"}
Jul 17 11:00:14.036895 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:14.036857    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hwjf6" event={"ID":"fef1d476-1e14-49ce-92ca-af77a0511610","Type":"ContainerStarted","Data":"0060edb27eb9aeaab8a8e25d5cf1086231808214f8c9f5899ee40c252baadde8"}
Jul 17 11:00:14.037281 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:14.036982    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hwjf6"
Jul 17 11:00:14.038417 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:14.038393    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsbgm" event={"ID":"3e73ae0f-efad-41e5-9312-b3581058dc95","Type":"ContainerStarted","Data":"581b6d97503a13e6616b9d39acd11dbb791be1968b1ba93f5488bb6b99064560"}
Jul 17 11:00:14.038536 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:14.038496    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsbgm"
Jul 17 11:00:14.055324 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:14.055285    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hwjf6" podStartSLOduration=0.894649863 podStartE2EDuration="4.055272004s" totalImagesPullingTime="3.160622141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:00:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:00:14.054338283 +0000 UTC m=+479.235371244" watchObservedRunningTime="2026-07-17 11:00:14.055272004 +0000 UTC m=+479.236304965"
Jul 17 11:00:14.075472 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:14.075386    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsbgm" podStartSLOduration=1.574021865 podStartE2EDuration="8.075377791s" totalImagesPullingTime="6.501355926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:00:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:00:14.074170621 +0000 UTC m=+479.255203594" watchObservedRunningTime="2026-07-17 11:00:14.075377791 +0000 UTC m=+479.256410751"
Jul 17 11:00:16.002301 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:16.002271    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2lmw"
Jul 17 11:00:16.404895 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:16.404868    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-f48h8"]
Jul 17 11:00:16.409295 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:16.409278    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f48h8"
Jul 17 11:00:16.414746 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:16.414715    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 17 11:00:16.414858 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:16.414793    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gl6gr\""
Jul 17 11:00:16.414975 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:16.414926    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 17 11:00:16.423579 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:16.423558    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-f48h8"]
Jul 17 11:00:16.479769 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:16.479739    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxbzp\" (UniqueName: \"kubernetes.io/projected/9fc054d0-6631-448d-86bd-a2ed2b11d29c-kube-api-access-zxbzp\") pod \"kuadrant-console-plugin-66b5774985-f48h8\" (UID: \"9fc054d0-6631-448d-86bd-a2ed2b11d29c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f48h8"
Jul 17 11:00:16.479863 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:16.479786    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9fc054d0-6631-448d-86bd-a2ed2b11d29c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-f48h8\" (UID: \"9fc054d0-6631-448d-86bd-a2ed2b11d29c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f48h8"
Jul 17 11:00:16.479863 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:16.479834    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9fc054d0-6631-448d-86bd-a2ed2b11d29c-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-f48h8\" (UID: \"9fc054d0-6631-448d-86bd-a2ed2b11d29c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f48h8"
Jul 17 11:00:16.581172 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:16.581146    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9fc054d0-6631-448d-86bd-a2ed2b11d29c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-f48h8\" (UID: \"9fc054d0-6631-448d-86bd-a2ed2b11d29c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f48h8"
Jul 17 11:00:16.581279 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:16.581182    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9fc054d0-6631-448d-86bd-a2ed2b11d29c-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-f48h8\" (UID: \"9fc054d0-6631-448d-86bd-a2ed2b11d29c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f48h8"
Jul 17 11:00:16.581279 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:16.581227    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxbzp\" (UniqueName: \"kubernetes.io/projected/9fc054d0-6631-448d-86bd-a2ed2b11d29c-kube-api-access-zxbzp\") pod \"kuadrant-console-plugin-66b5774985-f48h8\" (UID: \"9fc054d0-6631-448d-86bd-a2ed2b11d29c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f48h8"
Jul 17 11:00:16.581811 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:16.581790    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9fc054d0-6631-448d-86bd-a2ed2b11d29c-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-f48h8\" (UID: \"9fc054d0-6631-448d-86bd-a2ed2b11d29c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f48h8"
Jul 17 11:00:16.583262 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:16.583244    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9fc054d0-6631-448d-86bd-a2ed2b11d29c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-f48h8\" (UID: \"9fc054d0-6631-448d-86bd-a2ed2b11d29c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f48h8"
Jul 17 11:00:16.600725 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:16.600702    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxbzp\" (UniqueName: \"kubernetes.io/projected/9fc054d0-6631-448d-86bd-a2ed2b11d29c-kube-api-access-zxbzp\") pod \"kuadrant-console-plugin-66b5774985-f48h8\" (UID: \"9fc054d0-6631-448d-86bd-a2ed2b11d29c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f48h8"
Jul 17 11:00:16.717814 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:16.717750    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f48h8"
Jul 17 11:00:16.847696 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:16.847622    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-f48h8"]
Jul 17 11:00:16.851875 ip-10-0-143-12 kubenswrapper[2563]: W0717 11:00:16.851849    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9fc054d0_6631_448d_86bd_a2ed2b11d29c.slice/crio-a616f31194c31c01f5f08c0d9529e81e79f711d5bf48f75fe1a9d1f56bc4f14c WatchSource:0}: Error finding container a616f31194c31c01f5f08c0d9529e81e79f711d5bf48f75fe1a9d1f56bc4f14c: Status 404 returned error can't find the container with id a616f31194c31c01f5f08c0d9529e81e79f711d5bf48f75fe1a9d1f56bc4f14c
Jul 17 11:00:17.051516 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:17.051454    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f48h8" event={"ID":"9fc054d0-6631-448d-86bd-a2ed2b11d29c","Type":"ContainerStarted","Data":"a616f31194c31c01f5f08c0d9529e81e79f711d5bf48f75fe1a9d1f56bc4f14c"}
Jul 17 11:00:25.044604 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:25.044574    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsbgm"
Jul 17 11:00:25.045107 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:25.044775    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hwjf6"
Jul 17 11:00:26.931387 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:26.931346    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsbgm"]
Jul 17 11:00:26.931893 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:26.931580    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsbgm" podUID="3e73ae0f-efad-41e5-9312-b3581058dc95" containerName="manager" containerID="cri-o://581b6d97503a13e6616b9d39acd11dbb791be1968b1ba93f5488bb6b99064560" gracePeriod=2
Jul 17 11:00:26.950258 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:26.950228    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsbgm"]
Jul 17 11:00:26.958951 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:00:26.958913    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3e73ae0f-efad-41e5-9312-b3581058dc95\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-bsbgm\": pods \"kuadrant-operator-controller-manager-8684c9ff49-bsbgm\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsbgm"
Jul 17 11:00:26.964663 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:26.964636    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbnjk"]
Jul 17 11:00:26.965087 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:26.965058    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e73ae0f-efad-41e5-9312-b3581058dc95" containerName="manager"
Jul 17 11:00:26.965087 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:26.965082    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e73ae0f-efad-41e5-9312-b3581058dc95" containerName="manager"
Jul 17 11:00:26.965232 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:26.965187    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e73ae0f-efad-41e5-9312-b3581058dc95" containerName="manager"
Jul 17 11:00:26.968900 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:26.968580    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbnjk"
Jul 17 11:00:26.982788 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:26.982050    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbnjk"]
Jul 17 11:00:27.015021 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:00:27.014983    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bsbgm\" is forbidden: User \"system:node:ip-10-0-143-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-12.ec2.internal' and this object" podUID="3e73ae0f-efad-41e5-9312-b3581058dc95" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsbgm"
Jul 17 11:00:27.069410 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:27.069373    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scp7k\" (UniqueName: \"kubernetes.io/projected/b27a812d-6746-4cdd-9958-f6e97fd63a80-kube-api-access-scp7k\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pbnjk\" (UID: \"b27a812d-6746-4cdd-9958-f6e97fd63a80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbnjk"
Jul 17 11:00:27.069549 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:27.069457    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b27a812d-6746-4cdd-9958-f6e97fd63a80-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pbnjk\" (UID: \"b27a812d-6746-4cdd-9958-f6e97fd63a80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbnjk"
Jul 17 11:00:27.170117 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:27.170086    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scp7k\" (UniqueName: \"kubernetes.io/projected/b27a812d-6746-4cdd-9958-f6e97fd63a80-kube-api-access-scp7k\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pbnjk\" (UID: \"b27a812d-6746-4cdd-9958-f6e97fd63a80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbnjk"
Jul 17 11:00:27.170261 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:27.170135    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b27a812d-6746-4cdd-9958-f6e97fd63a80-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pbnjk\" (UID: \"b27a812d-6746-4cdd-9958-f6e97fd63a80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbnjk"
Jul 17 11:00:27.170555 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:27.170524    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b27a812d-6746-4cdd-9958-f6e97fd63a80-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pbnjk\" (UID: \"b27a812d-6746-4cdd-9958-f6e97fd63a80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbnjk"
Jul 17 11:00:27.194539 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:27.194485    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scp7k\" (UniqueName: \"kubernetes.io/projected/b27a812d-6746-4cdd-9958-f6e97fd63a80-kube-api-access-scp7k\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pbnjk\" (UID: \"b27a812d-6746-4cdd-9958-f6e97fd63a80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbnjk"
Jul 17 11:00:27.324585 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:27.324555    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbnjk"
Jul 17 11:00:28.062345 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:28.062310    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nbgw9"]
Jul 17 11:00:28.089970 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:28.089943    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nbgw9"
Jul 17 11:00:28.096163 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:28.096134    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nbgw9"]
Jul 17 11:00:28.179453 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:28.179402    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/14f2bba7-0f06-45c4-a3d4-ded60e74ea70-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nbgw9\" (UID: \"14f2bba7-0f06-45c4-a3d4-ded60e74ea70\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nbgw9"
Jul 17 11:00:28.179613 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:28.179509    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhzc8\" (UniqueName: \"kubernetes.io/projected/14f2bba7-0f06-45c4-a3d4-ded60e74ea70-kube-api-access-rhzc8\") pod \"kuadrant-operator-controller-manager-86878c769f-nbgw9\" (UID: \"14f2bba7-0f06-45c4-a3d4-ded60e74ea70\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nbgw9"
Jul 17 11:00:28.280789 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:28.280753    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/14f2bba7-0f06-45c4-a3d4-ded60e74ea70-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nbgw9\" (UID: \"14f2bba7-0f06-45c4-a3d4-ded60e74ea70\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nbgw9"
Jul 17 11:00:28.280922 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:28.280804    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhzc8\" (UniqueName: \"kubernetes.io/projected/14f2bba7-0f06-45c4-a3d4-ded60e74ea70-kube-api-access-rhzc8\") pod \"kuadrant-operator-controller-manager-86878c769f-nbgw9\" (UID: \"14f2bba7-0f06-45c4-a3d4-ded60e74ea70\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nbgw9"
Jul 17 11:00:28.281148 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:28.281127    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/14f2bba7-0f06-45c4-a3d4-ded60e74ea70-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nbgw9\" (UID: \"14f2bba7-0f06-45c4-a3d4-ded60e74ea70\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nbgw9"
Jul 17 11:00:28.293881 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:28.293859    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhzc8\" (UniqueName: \"kubernetes.io/projected/14f2bba7-0f06-45c4-a3d4-ded60e74ea70-kube-api-access-rhzc8\") pod \"kuadrant-operator-controller-manager-86878c769f-nbgw9\" (UID: \"14f2bba7-0f06-45c4-a3d4-ded60e74ea70\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nbgw9"
Jul 17 11:00:28.403206 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:28.403180    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nbgw9"
Jul 17 11:00:37.737628 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:37.737601    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsbgm"
Jul 17 11:00:37.739954 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:00:37.739903    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bsbgm\" is forbidden: User \"system:node:ip-10-0-143-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-12.ec2.internal' and this object" podUID="3e73ae0f-efad-41e5-9312-b3581058dc95" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsbgm"
Jul 17 11:00:37.753594 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:37.753544    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbnjk"]
Jul 17 11:00:37.755790 ip-10-0-143-12 kubenswrapper[2563]: W0717 11:00:37.755762    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb27a812d_6746_4cdd_9958_f6e97fd63a80.slice/crio-dcb0a118e4b26bf54d37e7a9e7532784513053d3faa3b75602f126c0ae373c05 WatchSource:0}: Error finding container dcb0a118e4b26bf54d37e7a9e7532784513053d3faa3b75602f126c0ae373c05: Status 404 returned error can't find the container with id dcb0a118e4b26bf54d37e7a9e7532784513053d3faa3b75602f126c0ae373c05
Jul 17 11:00:37.760655 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:37.760625    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nbgw9"]
Jul 17 11:00:37.762067 ip-10-0-143-12 kubenswrapper[2563]: W0717 11:00:37.762048    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14f2bba7_0f06_45c4_a3d4_ded60e74ea70.slice/crio-29203d3cc73db52d3d2a8840f0ee3492c003a07386c7b8d00f763181838f4b80 WatchSource:0}: Error finding container 29203d3cc73db52d3d2a8840f0ee3492c003a07386c7b8d00f763181838f4b80: Status 404 returned error can't find the container with id 29203d3cc73db52d3d2a8840f0ee3492c003a07386c7b8d00f763181838f4b80
Jul 17 11:00:37.858112 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:37.858069    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hv7t\" (UniqueName: \"kubernetes.io/projected/3e73ae0f-efad-41e5-9312-b3581058dc95-kube-api-access-8hv7t\") pod \"3e73ae0f-efad-41e5-9312-b3581058dc95\" (UID: \"3e73ae0f-efad-41e5-9312-b3581058dc95\") "
Jul 17 11:00:37.858112 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:37.858103    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e73ae0f-efad-41e5-9312-b3581058dc95-extensions-socket-volume\") pod \"3e73ae0f-efad-41e5-9312-b3581058dc95\" (UID: \"3e73ae0f-efad-41e5-9312-b3581058dc95\") "
Jul 17 11:00:37.858521 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:37.858497    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e73ae0f-efad-41e5-9312-b3581058dc95-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3e73ae0f-efad-41e5-9312-b3581058dc95" (UID: "3e73ae0f-efad-41e5-9312-b3581058dc95"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:00:37.859791 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:37.859772    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e73ae0f-efad-41e5-9312-b3581058dc95-kube-api-access-8hv7t" (OuterVolumeSpecName: "kube-api-access-8hv7t") pod "3e73ae0f-efad-41e5-9312-b3581058dc95" (UID: "3e73ae0f-efad-41e5-9312-b3581058dc95"). InnerVolumeSpecName "kube-api-access-8hv7t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:00:37.959093 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:37.959064    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hv7t\" (UniqueName: \"kubernetes.io/projected/3e73ae0f-efad-41e5-9312-b3581058dc95-kube-api-access-8hv7t\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:00:37.959093 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:37.959089    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e73ae0f-efad-41e5-9312-b3581058dc95-extensions-socket-volume\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:00:38.151906 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:38.151865    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f48h8" event={"ID":"9fc054d0-6631-448d-86bd-a2ed2b11d29c","Type":"ContainerStarted","Data":"027d82cee14445734ebdf5e7efa9bd3e17f67ff24f1d5079cc8da5058641469f"}
Jul 17 11:00:38.153362 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:38.153336    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbnjk" event={"ID":"b27a812d-6746-4cdd-9958-f6e97fd63a80","Type":"ContainerStarted","Data":"71465ce2ffaa01fbf060fee446b233025ef6964f8b62601aa83c7c535aa4d9ec"}
Jul 17 11:00:38.153507 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:38.153389    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbnjk"
Jul 17 11:00:38.153507 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:38.153406    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbnjk" event={"ID":"b27a812d-6746-4cdd-9958-f6e97fd63a80","Type":"ContainerStarted","Data":"dcb0a118e4b26bf54d37e7a9e7532784513053d3faa3b75602f126c0ae373c05"}
Jul 17 11:00:38.154902 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:38.154877    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nbgw9" event={"ID":"14f2bba7-0f06-45c4-a3d4-ded60e74ea70","Type":"ContainerStarted","Data":"4d3cbf5516925d6bb1b8db6a695cd08ac2f582ce5e72f4b873061c9b842d5e0f"}
Jul 17 11:00:38.154902 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:00:38.154888    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bsbgm\" is forbidden: User \"system:node:ip-10-0-143-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-12.ec2.internal' and this object" podUID="3e73ae0f-efad-41e5-9312-b3581058dc95" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsbgm"
Jul 17 11:00:38.155078 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:38.154925    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nbgw9" event={"ID":"14f2bba7-0f06-45c4-a3d4-ded60e74ea70","Type":"ContainerStarted","Data":"29203d3cc73db52d3d2a8840f0ee3492c003a07386c7b8d00f763181838f4b80"}
Jul 17 11:00:38.155078 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:38.154956    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nbgw9"
Jul 17 11:00:38.156055 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:38.156035    2563 generic.go:356] "Generic (PLEG): container finished" podID="3e73ae0f-efad-41e5-9312-b3581058dc95" containerID="581b6d97503a13e6616b9d39acd11dbb791be1968b1ba93f5488bb6b99064560" exitCode=0
Jul 17 11:00:38.156136 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:38.156066    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsbgm"
Jul 17 11:00:38.156136 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:38.156072    2563 scope.go:117] "RemoveContainer" containerID="581b6d97503a13e6616b9d39acd11dbb791be1968b1ba93f5488bb6b99064560"
Jul 17 11:00:38.164337 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:38.164322    2563 scope.go:117] "RemoveContainer" containerID="581b6d97503a13e6616b9d39acd11dbb791be1968b1ba93f5488bb6b99064560"
Jul 17 11:00:38.164607 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:00:38.164588    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"581b6d97503a13e6616b9d39acd11dbb791be1968b1ba93f5488bb6b99064560\": container with ID starting with 581b6d97503a13e6616b9d39acd11dbb791be1968b1ba93f5488bb6b99064560 not found: ID does not exist" containerID="581b6d97503a13e6616b9d39acd11dbb791be1968b1ba93f5488bb6b99064560"
Jul 17 11:00:38.164652 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:38.164615    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"581b6d97503a13e6616b9d39acd11dbb791be1968b1ba93f5488bb6b99064560"} err="failed to get container status \"581b6d97503a13e6616b9d39acd11dbb791be1968b1ba93f5488bb6b99064560\": rpc error: code = NotFound desc = could not find container \"581b6d97503a13e6616b9d39acd11dbb791be1968b1ba93f5488bb6b99064560\": container with ID starting with 581b6d97503a13e6616b9d39acd11dbb791be1968b1ba93f5488bb6b99064560 not found: ID does not exist"
Jul 17 11:00:38.176915 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:38.175687    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f48h8" podStartSLOduration=1.367446364 podStartE2EDuration="22.175670267s" totalImagesPullingTime="20.808223903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:00:38.174834153 +0000 UTC m=+503.355867116" watchObservedRunningTime="2026-07-17 11:00:38.175670267 +0000 UTC m=+503.356703230"
Jul 17 11:00:38.201040 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:38.200991    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbnjk" podStartSLOduration=12.200974711 podStartE2EDuration="12.200974711s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:00:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:00:38.200180833 +0000 UTC m=+503.381213793" watchObservedRunningTime="2026-07-17 11:00:38.200974711 +0000 UTC m=+503.382007672"
Jul 17 11:00:38.224874 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:38.224831    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nbgw9" podStartSLOduration=10.224819092 podStartE2EDuration="10.224819092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:00:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:00:38.222790619 +0000 UTC m=+503.403823582" watchObservedRunningTime="2026-07-17 11:00:38.224819092 +0000 UTC m=+503.405852052"
Jul 17 11:00:38.225251 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:00:38.225230    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bsbgm\" is forbidden: User \"system:node:ip-10-0-143-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-12.ec2.internal' and this object" podUID="3e73ae0f-efad-41e5-9312-b3581058dc95" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsbgm"
Jul 17 11:00:39.264774 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:39.264744    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e73ae0f-efad-41e5-9312-b3581058dc95" path="/var/lib/kubelet/pods/3e73ae0f-efad-41e5-9312-b3581058dc95/volumes"
Jul 17 11:00:49.166546 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:49.166513    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nbgw9"
Jul 17 11:00:49.166931 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:49.166608    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbnjk"
Jul 17 11:00:49.267806 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:49.267780    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbnjk"]
Jul 17 11:00:49.268000 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:49.267978    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbnjk" podUID="b27a812d-6746-4cdd-9958-f6e97fd63a80" containerName="manager" containerID="cri-o://71465ce2ffaa01fbf060fee446b233025ef6964f8b62601aa83c7c535aa4d9ec" gracePeriod=10
Jul 17 11:00:49.511244 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:49.511221    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbnjk"
Jul 17 11:00:49.534686 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:49.534664    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-scp7k\" (UniqueName: \"kubernetes.io/projected/b27a812d-6746-4cdd-9958-f6e97fd63a80-kube-api-access-scp7k\") pod \"b27a812d-6746-4cdd-9958-f6e97fd63a80\" (UID: \"b27a812d-6746-4cdd-9958-f6e97fd63a80\") "
Jul 17 11:00:49.534804 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:49.534714    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b27a812d-6746-4cdd-9958-f6e97fd63a80-extensions-socket-volume\") pod \"b27a812d-6746-4cdd-9958-f6e97fd63a80\" (UID: \"b27a812d-6746-4cdd-9958-f6e97fd63a80\") "
Jul 17 11:00:49.535073 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:49.535053    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b27a812d-6746-4cdd-9958-f6e97fd63a80-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b27a812d-6746-4cdd-9958-f6e97fd63a80" (UID: "b27a812d-6746-4cdd-9958-f6e97fd63a80"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:00:49.536631 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:49.536609    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b27a812d-6746-4cdd-9958-f6e97fd63a80-kube-api-access-scp7k" (OuterVolumeSpecName: "kube-api-access-scp7k") pod "b27a812d-6746-4cdd-9958-f6e97fd63a80" (UID: "b27a812d-6746-4cdd-9958-f6e97fd63a80"). InnerVolumeSpecName "kube-api-access-scp7k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:00:49.635217 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:49.635190    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-scp7k\" (UniqueName: \"kubernetes.io/projected/b27a812d-6746-4cdd-9958-f6e97fd63a80-kube-api-access-scp7k\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:00:49.635217 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:49.635210    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b27a812d-6746-4cdd-9958-f6e97fd63a80-extensions-socket-volume\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:00:50.210048 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:50.210017    2563 generic.go:356] "Generic (PLEG): container finished" podID="b27a812d-6746-4cdd-9958-f6e97fd63a80" containerID="71465ce2ffaa01fbf060fee446b233025ef6964f8b62601aa83c7c535aa4d9ec" exitCode=0
Jul 17 11:00:50.210363 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:50.210070    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbnjk"
Jul 17 11:00:50.210363 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:50.210078    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbnjk" event={"ID":"b27a812d-6746-4cdd-9958-f6e97fd63a80","Type":"ContainerDied","Data":"71465ce2ffaa01fbf060fee446b233025ef6964f8b62601aa83c7c535aa4d9ec"}
Jul 17 11:00:50.210363 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:50.210118    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbnjk" event={"ID":"b27a812d-6746-4cdd-9958-f6e97fd63a80","Type":"ContainerDied","Data":"dcb0a118e4b26bf54d37e7a9e7532784513053d3faa3b75602f126c0ae373c05"}
Jul 17 11:00:50.210363 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:50.210138    2563 scope.go:117] "RemoveContainer" containerID="71465ce2ffaa01fbf060fee446b233025ef6964f8b62601aa83c7c535aa4d9ec"
Jul 17 11:00:50.218063 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:50.218046    2563 scope.go:117] "RemoveContainer" containerID="71465ce2ffaa01fbf060fee446b233025ef6964f8b62601aa83c7c535aa4d9ec"
Jul 17 11:00:50.218289 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:00:50.218264    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71465ce2ffaa01fbf060fee446b233025ef6964f8b62601aa83c7c535aa4d9ec\": container with ID starting with 71465ce2ffaa01fbf060fee446b233025ef6964f8b62601aa83c7c535aa4d9ec not found: ID does not exist" containerID="71465ce2ffaa01fbf060fee446b233025ef6964f8b62601aa83c7c535aa4d9ec"
Jul 17 11:00:50.218340 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:50.218297    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71465ce2ffaa01fbf060fee446b233025ef6964f8b62601aa83c7c535aa4d9ec"} err="failed to get container status \"71465ce2ffaa01fbf060fee446b233025ef6964f8b62601aa83c7c535aa4d9ec\": rpc error: code = NotFound desc = could not find container \"71465ce2ffaa01fbf060fee446b233025ef6964f8b62601aa83c7c535aa4d9ec\": container with ID starting with 71465ce2ffaa01fbf060fee446b233025ef6964f8b62601aa83c7c535aa4d9ec not found: ID does not exist"
Jul 17 11:00:50.231950 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:50.231927    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbnjk"]
Jul 17 11:00:50.236179 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:50.236159    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbnjk"]
Jul 17 11:00:51.264025 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:00:51.263995    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b27a812d-6746-4cdd-9958-f6e97fd63a80" path="/var/lib/kubelet/pods/b27a812d-6746-4cdd-9958-f6e97fd63a80/volumes"
Jul 17 11:01:10.344031 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:10.343950    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zkzjk"]
Jul 17 11:01:10.344563 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:10.344280    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b27a812d-6746-4cdd-9958-f6e97fd63a80" containerName="manager"
Jul 17 11:01:10.344563 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:10.344294    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b27a812d-6746-4cdd-9958-f6e97fd63a80" containerName="manager"
Jul 17 11:01:10.344563 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:10.344371    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b27a812d-6746-4cdd-9958-f6e97fd63a80" containerName="manager"
Jul 17 11:01:10.346908 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:10.346887    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zkzjk"
Jul 17 11:01:10.349510 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:10.349492    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 17 11:01:10.357914 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:10.357890    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zkzjk"]
Jul 17 11:01:10.369153 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:10.369129    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f7db1be6-83b8-4b00-a666-a38ee1b3d544-config-file\") pod \"limitador-limitador-64c94fd64f-zkzjk\" (UID: \"f7db1be6-83b8-4b00-a666-a38ee1b3d544\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zkzjk"
Jul 17 11:01:10.369283 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:10.369185    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24k7l\" (UniqueName: \"kubernetes.io/projected/f7db1be6-83b8-4b00-a666-a38ee1b3d544-kube-api-access-24k7l\") pod \"limitador-limitador-64c94fd64f-zkzjk\" (UID: \"f7db1be6-83b8-4b00-a666-a38ee1b3d544\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zkzjk"
Jul 17 11:01:10.438008 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:10.437980    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zkzjk"]
Jul 17 11:01:10.470086 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:10.470043    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f7db1be6-83b8-4b00-a666-a38ee1b3d544-config-file\") pod \"limitador-limitador-64c94fd64f-zkzjk\" (UID: \"f7db1be6-83b8-4b00-a666-a38ee1b3d544\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zkzjk"
Jul 17 11:01:10.470198 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:10.470120    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24k7l\" (UniqueName: \"kubernetes.io/projected/f7db1be6-83b8-4b00-a666-a38ee1b3d544-kube-api-access-24k7l\") pod \"limitador-limitador-64c94fd64f-zkzjk\" (UID: \"f7db1be6-83b8-4b00-a666-a38ee1b3d544\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zkzjk"
Jul 17 11:01:10.475842 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:10.470950    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f7db1be6-83b8-4b00-a666-a38ee1b3d544-config-file\") pod \"limitador-limitador-64c94fd64f-zkzjk\" (UID: \"f7db1be6-83b8-4b00-a666-a38ee1b3d544\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zkzjk"
Jul 17 11:01:10.479267 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:10.479242    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24k7l\" (UniqueName: \"kubernetes.io/projected/f7db1be6-83b8-4b00-a666-a38ee1b3d544-kube-api-access-24k7l\") pod \"limitador-limitador-64c94fd64f-zkzjk\" (UID: \"f7db1be6-83b8-4b00-a666-a38ee1b3d544\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zkzjk"
Jul 17 11:01:10.659856 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:10.659824    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zkzjk"
Jul 17 11:01:10.789714 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:10.789699    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zkzjk"]
Jul 17 11:01:10.791888 ip-10-0-143-12 kubenswrapper[2563]: W0717 11:01:10.791865    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7db1be6_83b8_4b00_a666_a38ee1b3d544.slice/crio-1a3057c5a247418796245ca6e9406781b7acfbce0391efdaf293c7b554a12c4a WatchSource:0}: Error finding container 1a3057c5a247418796245ca6e9406781b7acfbce0391efdaf293c7b554a12c4a: Status 404 returned error can't find the container with id 1a3057c5a247418796245ca6e9406781b7acfbce0391efdaf293c7b554a12c4a
Jul 17 11:01:11.296128 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:11.296095    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zkzjk" event={"ID":"f7db1be6-83b8-4b00-a666-a38ee1b3d544","Type":"ContainerStarted","Data":"1a3057c5a247418796245ca6e9406781b7acfbce0391efdaf293c7b554a12c4a"}
Jul 17 11:01:14.309780 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:14.309746    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zkzjk" event={"ID":"f7db1be6-83b8-4b00-a666-a38ee1b3d544","Type":"ContainerStarted","Data":"fed85540c28a2f7fefd546d743a1792d1f745e47bfd2c795ca8271e3b1d9013f"}
Jul 17 11:01:14.310163 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:14.309913    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-zkzjk"
Jul 17 11:01:14.326107 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:14.326064    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-zkzjk" podStartSLOduration=1.457026572 podStartE2EDuration="4.326049676s" totalImagesPullingTime="2.869023104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:01:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:01:14.325253539 +0000 UTC m=+539.506286519" watchObservedRunningTime="2026-07-17 11:01:14.326049676 +0000 UTC m=+539.507082671"
Jul 17 11:01:25.314001 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:25.313968    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-zkzjk"
Jul 17 11:01:25.327320 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:25.327295    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zkzjk"]
Jul 17 11:01:25.350373 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:25.350317    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-zkzjk" podUID="f7db1be6-83b8-4b00-a666-a38ee1b3d544" containerName="limitador" containerID="cri-o://fed85540c28a2f7fefd546d743a1792d1f745e47bfd2c795ca8271e3b1d9013f" gracePeriod=30
Jul 17 11:01:25.891942 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:25.891920    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zkzjk"
Jul 17 11:01:25.975331 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:25.975279    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-24k7l\" (UniqueName: \"kubernetes.io/projected/f7db1be6-83b8-4b00-a666-a38ee1b3d544-kube-api-access-24k7l\") pod \"f7db1be6-83b8-4b00-a666-a38ee1b3d544\" (UID: \"f7db1be6-83b8-4b00-a666-a38ee1b3d544\") "
Jul 17 11:01:25.975331 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:25.975325    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f7db1be6-83b8-4b00-a666-a38ee1b3d544-config-file\") pod \"f7db1be6-83b8-4b00-a666-a38ee1b3d544\" (UID: \"f7db1be6-83b8-4b00-a666-a38ee1b3d544\") "
Jul 17 11:01:25.975671 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:25.975648    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7db1be6-83b8-4b00-a666-a38ee1b3d544-config-file" (OuterVolumeSpecName: "config-file") pod "f7db1be6-83b8-4b00-a666-a38ee1b3d544" (UID: "f7db1be6-83b8-4b00-a666-a38ee1b3d544"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:01:25.977109 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:25.977079    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7db1be6-83b8-4b00-a666-a38ee1b3d544-kube-api-access-24k7l" (OuterVolumeSpecName: "kube-api-access-24k7l") pod "f7db1be6-83b8-4b00-a666-a38ee1b3d544" (UID: "f7db1be6-83b8-4b00-a666-a38ee1b3d544"). InnerVolumeSpecName "kube-api-access-24k7l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:01:26.076376 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:26.076355    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24k7l\" (UniqueName: \"kubernetes.io/projected/f7db1be6-83b8-4b00-a666-a38ee1b3d544-kube-api-access-24k7l\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:01:26.076376 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:26.076374    2563 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f7db1be6-83b8-4b00-a666-a38ee1b3d544-config-file\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:01:26.355837 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:26.355782    2563 generic.go:356] "Generic (PLEG): container finished" podID="f7db1be6-83b8-4b00-a666-a38ee1b3d544" containerID="fed85540c28a2f7fefd546d743a1792d1f745e47bfd2c795ca8271e3b1d9013f" exitCode=0
Jul 17 11:01:26.355837 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:26.355819    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zkzjk"
Jul 17 11:01:26.356219 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:26.355853    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zkzjk" event={"ID":"f7db1be6-83b8-4b00-a666-a38ee1b3d544","Type":"ContainerDied","Data":"fed85540c28a2f7fefd546d743a1792d1f745e47bfd2c795ca8271e3b1d9013f"}
Jul 17 11:01:26.356219 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:26.355903    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zkzjk" event={"ID":"f7db1be6-83b8-4b00-a666-a38ee1b3d544","Type":"ContainerDied","Data":"1a3057c5a247418796245ca6e9406781b7acfbce0391efdaf293c7b554a12c4a"}
Jul 17 11:01:26.356219 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:26.355937    2563 scope.go:117] "RemoveContainer" containerID="fed85540c28a2f7fefd546d743a1792d1f745e47bfd2c795ca8271e3b1d9013f"
Jul 17 11:01:26.363688 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:26.363672    2563 scope.go:117] "RemoveContainer" containerID="fed85540c28a2f7fefd546d743a1792d1f745e47bfd2c795ca8271e3b1d9013f"
Jul 17 11:01:26.363922 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:01:26.363906    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fed85540c28a2f7fefd546d743a1792d1f745e47bfd2c795ca8271e3b1d9013f\": container with ID starting with fed85540c28a2f7fefd546d743a1792d1f745e47bfd2c795ca8271e3b1d9013f not found: ID does not exist" containerID="fed85540c28a2f7fefd546d743a1792d1f745e47bfd2c795ca8271e3b1d9013f"
Jul 17 11:01:26.363967 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:26.363930    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fed85540c28a2f7fefd546d743a1792d1f745e47bfd2c795ca8271e3b1d9013f"} err="failed to get container status \"fed85540c28a2f7fefd546d743a1792d1f745e47bfd2c795ca8271e3b1d9013f\": rpc error: code = NotFound desc = could not find container \"fed85540c28a2f7fefd546d743a1792d1f745e47bfd2c795ca8271e3b1d9013f\": container with ID starting with fed85540c28a2f7fefd546d743a1792d1f745e47bfd2c795ca8271e3b1d9013f not found: ID does not exist"
Jul 17 11:01:26.376985 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:26.376962    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zkzjk"]
Jul 17 11:01:26.381317 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:26.381298    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zkzjk"]
Jul 17 11:01:26.938445 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:26.938402    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-8bml2"]
Jul 17 11:01:26.938699 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:26.938686    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7db1be6-83b8-4b00-a666-a38ee1b3d544" containerName="limitador"
Jul 17 11:01:26.938744 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:26.938700    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7db1be6-83b8-4b00-a666-a38ee1b3d544" containerName="limitador"
Jul 17 11:01:26.938776 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:26.938760    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7db1be6-83b8-4b00-a666-a38ee1b3d544" containerName="limitador"
Jul 17 11:01:26.942913 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:26.942898    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8bml2"
Jul 17 11:01:26.946309 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:26.946293    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 17 11:01:26.947053 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:26.947039    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-xzxzp\""
Jul 17 11:01:26.947772 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:26.947755    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 11:01:26.948319 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:26.948304    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 17 11:01:26.955800 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:26.955780    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-8bml2"]
Jul 17 11:01:26.983797 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:26.983771    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhgvf\" (UniqueName: \"kubernetes.io/projected/cad15fee-0785-4f3b-9394-54129ee30b46-kube-api-access-fhgvf\") pod \"postgres-69fb4594cf-8bml2\" (UID: \"cad15fee-0785-4f3b-9394-54129ee30b46\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8bml2"
Jul 17 11:01:26.983876 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:26.983820    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cad15fee-0785-4f3b-9394-54129ee30b46-data\") pod \"postgres-69fb4594cf-8bml2\" (UID: \"cad15fee-0785-4f3b-9394-54129ee30b46\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8bml2"
Jul 17 11:01:27.084628 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:27.084606    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhgvf\" (UniqueName: \"kubernetes.io/projected/cad15fee-0785-4f3b-9394-54129ee30b46-kube-api-access-fhgvf\") pod \"postgres-69fb4594cf-8bml2\" (UID: \"cad15fee-0785-4f3b-9394-54129ee30b46\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8bml2"
Jul 17 11:01:27.084718 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:27.084663    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cad15fee-0785-4f3b-9394-54129ee30b46-data\") pod \"postgres-69fb4594cf-8bml2\" (UID: \"cad15fee-0785-4f3b-9394-54129ee30b46\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8bml2"
Jul 17 11:01:27.084953 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:27.084935    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cad15fee-0785-4f3b-9394-54129ee30b46-data\") pod \"postgres-69fb4594cf-8bml2\" (UID: \"cad15fee-0785-4f3b-9394-54129ee30b46\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8bml2"
Jul 17 11:01:27.093608 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:27.093590    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhgvf\" (UniqueName: \"kubernetes.io/projected/cad15fee-0785-4f3b-9394-54129ee30b46-kube-api-access-fhgvf\") pod \"postgres-69fb4594cf-8bml2\" (UID: \"cad15fee-0785-4f3b-9394-54129ee30b46\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8bml2"
Jul 17 11:01:27.251941 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:27.251883    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8bml2"
Jul 17 11:01:27.270691 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:27.270660    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7db1be6-83b8-4b00-a666-a38ee1b3d544" path="/var/lib/kubelet/pods/f7db1be6-83b8-4b00-a666-a38ee1b3d544/volumes"
Jul 17 11:01:27.374196 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:27.374154    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-8bml2"]
Jul 17 11:01:27.377167 ip-10-0-143-12 kubenswrapper[2563]: W0717 11:01:27.377143    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcad15fee_0785_4f3b_9394_54129ee30b46.slice/crio-778e4d6230f804eebd991b9fdd3b6604a426b891ec3bc96a24312a26fba5bb34 WatchSource:0}: Error finding container 778e4d6230f804eebd991b9fdd3b6604a426b891ec3bc96a24312a26fba5bb34: Status 404 returned error can't find the container with id 778e4d6230f804eebd991b9fdd3b6604a426b891ec3bc96a24312a26fba5bb34
Jul 17 11:01:28.368126 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:28.368090    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8bml2" event={"ID":"cad15fee-0785-4f3b-9394-54129ee30b46","Type":"ContainerStarted","Data":"778e4d6230f804eebd991b9fdd3b6604a426b891ec3bc96a24312a26fba5bb34"}
Jul 17 11:01:32.389519 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:32.389484    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8bml2" event={"ID":"cad15fee-0785-4f3b-9394-54129ee30b46","Type":"ContainerStarted","Data":"d8237613616736cc758056136a208840e4312970ce9cf5b5c95dc1b948fd6237"}
Jul 17 11:01:32.389904 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:32.389619    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8bml2"
Jul 17 11:01:32.405755 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:32.405707    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8bml2" podStartSLOduration=1.621346812 podStartE2EDuration="6.40568721s" totalImagesPullingTime="4.784340398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:01:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:01:32.40516963 +0000 UTC m=+557.586202614" watchObservedRunningTime="2026-07-17 11:01:32.40568721 +0000 UTC m=+557.586720180"
Jul 17 11:01:38.421008 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:38.420981    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8bml2"
Jul 17 11:01:38.987096 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:38.987055    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rgjph"]
Jul 17 11:01:38.993252 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:38.993230    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rgjph"
Jul 17 11:01:38.996226 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:38.996194    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-t74t7\""
Jul 17 11:01:38.997593 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:38.997575    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rgjph"]
Jul 17 11:01:39.079089 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:39.079062    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg92w\" (UniqueName: \"kubernetes.io/projected/37325037-f202-4596-bd25-dd99ea93b4a0-kube-api-access-mg92w\") pod \"authorino-5d4b67c446-rgjph\" (UID: \"37325037-f202-4596-bd25-dd99ea93b4a0\") " pod="kuadrant-system/authorino-5d4b67c446-rgjph"
Jul 17 11:01:39.180080 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:39.180056    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg92w\" (UniqueName: \"kubernetes.io/projected/37325037-f202-4596-bd25-dd99ea93b4a0-kube-api-access-mg92w\") pod \"authorino-5d4b67c446-rgjph\" (UID: \"37325037-f202-4596-bd25-dd99ea93b4a0\") " pod="kuadrant-system/authorino-5d4b67c446-rgjph"
Jul 17 11:01:39.188277 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:39.188253    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg92w\" (UniqueName: \"kubernetes.io/projected/37325037-f202-4596-bd25-dd99ea93b4a0-kube-api-access-mg92w\") pod \"authorino-5d4b67c446-rgjph\" (UID: \"37325037-f202-4596-bd25-dd99ea93b4a0\") " pod="kuadrant-system/authorino-5d4b67c446-rgjph"
Jul 17 11:01:39.231510 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:39.231485    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rgjph"]
Jul 17 11:01:39.231664 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:39.231652    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rgjph"
Jul 17 11:01:39.361410 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:39.361381    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rgjph"]
Jul 17 11:01:39.363084 ip-10-0-143-12 kubenswrapper[2563]: W0717 11:01:39.363056    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod37325037_f202_4596_bd25_dd99ea93b4a0.slice/crio-3ce8019279e15ad96ccd5019046dd4e687268e7e8360258a1afdcd949a841761 WatchSource:0}: Error finding container 3ce8019279e15ad96ccd5019046dd4e687268e7e8360258a1afdcd949a841761: Status 404 returned error can't find the container with id 3ce8019279e15ad96ccd5019046dd4e687268e7e8360258a1afdcd949a841761
Jul 17 11:01:39.418199 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:39.418171    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-rgjph" event={"ID":"37325037-f202-4596-bd25-dd99ea93b4a0","Type":"ContainerStarted","Data":"3ce8019279e15ad96ccd5019046dd4e687268e7e8360258a1afdcd949a841761"}
Jul 17 11:01:42.437210 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:42.437179    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-rgjph" event={"ID":"37325037-f202-4596-bd25-dd99ea93b4a0","Type":"ContainerStarted","Data":"947615ca29b1d035bdfa8abde3a9c330f222e95840b3212ec476b4395e85be03"}
Jul 17 11:01:42.437598 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:42.437249    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-rgjph" podUID="37325037-f202-4596-bd25-dd99ea93b4a0" containerName="authorino" containerID="cri-o://947615ca29b1d035bdfa8abde3a9c330f222e95840b3212ec476b4395e85be03" gracePeriod=30
Jul 17 11:01:42.453042 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:42.452993    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-rgjph" podStartSLOduration=1.694800469 podStartE2EDuration="4.452978988s" totalImagesPullingTime="2.758178519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:01:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:01:42.452024433 +0000 UTC m=+567.633057394" watchObservedRunningTime="2026-07-17 11:01:42.452978988 +0000 UTC m=+567.634011948"
Jul 17 11:01:42.671133 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:42.671109    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rgjph"
Jul 17 11:01:42.810064 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:42.810011    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mg92w\" (UniqueName: \"kubernetes.io/projected/37325037-f202-4596-bd25-dd99ea93b4a0-kube-api-access-mg92w\") pod \"37325037-f202-4596-bd25-dd99ea93b4a0\" (UID: \"37325037-f202-4596-bd25-dd99ea93b4a0\") "
Jul 17 11:01:42.811822 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:42.811782    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37325037-f202-4596-bd25-dd99ea93b4a0-kube-api-access-mg92w" (OuterVolumeSpecName: "kube-api-access-mg92w") pod "37325037-f202-4596-bd25-dd99ea93b4a0" (UID: "37325037-f202-4596-bd25-dd99ea93b4a0"). InnerVolumeSpecName "kube-api-access-mg92w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:01:42.911225 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:42.911201    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mg92w\" (UniqueName: \"kubernetes.io/projected/37325037-f202-4596-bd25-dd99ea93b4a0-kube-api-access-mg92w\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:01:43.442767 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:43.442739    2563 generic.go:356] "Generic (PLEG): container finished" podID="37325037-f202-4596-bd25-dd99ea93b4a0" containerID="947615ca29b1d035bdfa8abde3a9c330f222e95840b3212ec476b4395e85be03" exitCode=0
Jul 17 11:01:43.443063 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:43.442784    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rgjph"
Jul 17 11:01:43.443063 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:43.442806    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-rgjph" event={"ID":"37325037-f202-4596-bd25-dd99ea93b4a0","Type":"ContainerDied","Data":"947615ca29b1d035bdfa8abde3a9c330f222e95840b3212ec476b4395e85be03"}
Jul 17 11:01:43.443063 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:43.442849    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-rgjph" event={"ID":"37325037-f202-4596-bd25-dd99ea93b4a0","Type":"ContainerDied","Data":"3ce8019279e15ad96ccd5019046dd4e687268e7e8360258a1afdcd949a841761"}
Jul 17 11:01:43.443063 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:43.442866    2563 scope.go:117] "RemoveContainer" containerID="947615ca29b1d035bdfa8abde3a9c330f222e95840b3212ec476b4395e85be03"
Jul 17 11:01:43.450079 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:43.450062    2563 scope.go:117] "RemoveContainer" containerID="947615ca29b1d035bdfa8abde3a9c330f222e95840b3212ec476b4395e85be03"
Jul 17 11:01:43.450338 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:01:43.450320    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"947615ca29b1d035bdfa8abde3a9c330f222e95840b3212ec476b4395e85be03\": container with ID starting with 947615ca29b1d035bdfa8abde3a9c330f222e95840b3212ec476b4395e85be03 not found: ID does not exist" containerID="947615ca29b1d035bdfa8abde3a9c330f222e95840b3212ec476b4395e85be03"
Jul 17 11:01:43.450396 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:43.450344    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"947615ca29b1d035bdfa8abde3a9c330f222e95840b3212ec476b4395e85be03"} err="failed to get container status \"947615ca29b1d035bdfa8abde3a9c330f222e95840b3212ec476b4395e85be03\": rpc error: code = NotFound desc = could not find container \"947615ca29b1d035bdfa8abde3a9c330f222e95840b3212ec476b4395e85be03\": container with ID starting with 947615ca29b1d035bdfa8abde3a9c330f222e95840b3212ec476b4395e85be03 not found: ID does not exist"
Jul 17 11:01:43.458825 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:43.458804    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rgjph"]
Jul 17 11:01:43.463249 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:43.463229    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rgjph"]
Jul 17 11:01:45.263741 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:45.263708    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37325037-f202-4596-bd25-dd99ea93b4a0" path="/var/lib/kubelet/pods/37325037-f202-4596-bd25-dd99ea93b4a0/volumes"
Jul 17 11:01:45.893019 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:45.892985    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6869dc5d45-btq7d"]
Jul 17 11:01:45.893382 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:45.893365    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37325037-f202-4596-bd25-dd99ea93b4a0" containerName="authorino"
Jul 17 11:01:45.893457 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:45.893385    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="37325037-f202-4596-bd25-dd99ea93b4a0" containerName="authorino"
Jul 17 11:01:45.893497 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:45.893474    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="37325037-f202-4596-bd25-dd99ea93b4a0" containerName="authorino"
Jul 17 11:01:46.052788 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:46.052759    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6869dc5d45-btq7d"]
Jul 17 11:01:46.052915 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:46.052845    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6869dc5d45-btq7d"
Jul 17 11:01:46.055673 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:46.055646    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 17 11:01:46.055673 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:46.055656    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-wfblj\""
Jul 17 11:01:46.055864 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:46.055755    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 17 11:01:46.095208 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:46.095184    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76b5fcbfd-6hgcf"]
Jul 17 11:01:46.117442 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:46.117403    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76b5fcbfd-6hgcf"]
Jul 17 11:01:46.117537 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:46.117523    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76b5fcbfd-6hgcf"
Jul 17 11:01:46.137206 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:46.137180    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4eb6284-216c-4de5-8e83-6a6d140f561a-webhook-cert\") pod \"maas-controller-6869dc5d45-btq7d\" (UID: \"b4eb6284-216c-4de5-8e83-6a6d140f561a\") " pod="opendatahub/maas-controller-6869dc5d45-btq7d"
Jul 17 11:01:46.137398 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:46.137366    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzwvm\" (UniqueName: \"kubernetes.io/projected/b4eb6284-216c-4de5-8e83-6a6d140f561a-kube-api-access-wzwvm\") pod \"maas-controller-6869dc5d45-btq7d\" (UID: \"b4eb6284-216c-4de5-8e83-6a6d140f561a\") " pod="opendatahub/maas-controller-6869dc5d45-btq7d"
Jul 17 11:01:46.238357 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:46.238307    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-794pp\" (UniqueName: \"kubernetes.io/projected/625e2829-ded4-4dce-a33f-6fb1165fea34-kube-api-access-794pp\") pod \"maas-controller-76b5fcbfd-6hgcf\" (UID: \"625e2829-ded4-4dce-a33f-6fb1165fea34\") " pod="opendatahub/maas-controller-76b5fcbfd-6hgcf"
Jul 17 11:01:46.238481 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:46.238365    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/625e2829-ded4-4dce-a33f-6fb1165fea34-webhook-cert\") pod \"maas-controller-76b5fcbfd-6hgcf\" (UID: \"625e2829-ded4-4dce-a33f-6fb1165fea34\") " pod="opendatahub/maas-controller-76b5fcbfd-6hgcf"
Jul 17 11:01:46.238481 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:46.238406    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4eb6284-216c-4de5-8e83-6a6d140f561a-webhook-cert\") pod \"maas-controller-6869dc5d45-btq7d\" (UID: \"b4eb6284-216c-4de5-8e83-6a6d140f561a\") " pod="opendatahub/maas-controller-6869dc5d45-btq7d"
Jul 17 11:01:46.238481 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:46.238424    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzwvm\" (UniqueName: \"kubernetes.io/projected/b4eb6284-216c-4de5-8e83-6a6d140f561a-kube-api-access-wzwvm\") pod \"maas-controller-6869dc5d45-btq7d\" (UID: \"b4eb6284-216c-4de5-8e83-6a6d140f561a\") " pod="opendatahub/maas-controller-6869dc5d45-btq7d"
Jul 17 11:01:46.240562 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:46.240535    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4eb6284-216c-4de5-8e83-6a6d140f561a-webhook-cert\") pod \"maas-controller-6869dc5d45-btq7d\" (UID: \"b4eb6284-216c-4de5-8e83-6a6d140f561a\") " pod="opendatahub/maas-controller-6869dc5d45-btq7d"
Jul 17 11:01:46.246540 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:46.246518    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzwvm\" (UniqueName: \"kubernetes.io/projected/b4eb6284-216c-4de5-8e83-6a6d140f561a-kube-api-access-wzwvm\") pod \"maas-controller-6869dc5d45-btq7d\" (UID: \"b4eb6284-216c-4de5-8e83-6a6d140f561a\") " pod="opendatahub/maas-controller-6869dc5d45-btq7d"
Jul 17 11:01:46.338895 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:46.338869    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/625e2829-ded4-4dce-a33f-6fb1165fea34-webhook-cert\") pod \"maas-controller-76b5fcbfd-6hgcf\" (UID: \"625e2829-ded4-4dce-a33f-6fb1165fea34\") " pod="opendatahub/maas-controller-76b5fcbfd-6hgcf"
Jul 17 11:01:46.339242 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:46.338923    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-794pp\" (UniqueName: \"kubernetes.io/projected/625e2829-ded4-4dce-a33f-6fb1165fea34-kube-api-access-794pp\") pod \"maas-controller-76b5fcbfd-6hgcf\" (UID: \"625e2829-ded4-4dce-a33f-6fb1165fea34\") " pod="opendatahub/maas-controller-76b5fcbfd-6hgcf"
Jul 17 11:01:46.340982 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:46.340963    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/625e2829-ded4-4dce-a33f-6fb1165fea34-webhook-cert\") pod \"maas-controller-76b5fcbfd-6hgcf\" (UID: \"625e2829-ded4-4dce-a33f-6fb1165fea34\") " pod="opendatahub/maas-controller-76b5fcbfd-6hgcf"
Jul 17 11:01:46.347969 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:46.347948    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-794pp\" (UniqueName: \"kubernetes.io/projected/625e2829-ded4-4dce-a33f-6fb1165fea34-kube-api-access-794pp\") pod \"maas-controller-76b5fcbfd-6hgcf\" (UID: \"625e2829-ded4-4dce-a33f-6fb1165fea34\") " pod="opendatahub/maas-controller-76b5fcbfd-6hgcf"
Jul 17 11:01:46.361833 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:46.361815    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6869dc5d45-btq7d"
Jul 17 11:01:46.431129 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:46.431102    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76b5fcbfd-6hgcf"
Jul 17 11:01:46.490288 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:46.490263    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6869dc5d45-btq7d"]
Jul 17 11:01:46.492212 ip-10-0-143-12 kubenswrapper[2563]: W0717 11:01:46.492186    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4eb6284_216c_4de5_8e83_6a6d140f561a.slice/crio-d6ca9373fbccf0483dc9e0f0f713343e7cb8b102a4f88fb2b204918b31f2de15 WatchSource:0}: Error finding container d6ca9373fbccf0483dc9e0f0f713343e7cb8b102a4f88fb2b204918b31f2de15: Status 404 returned error can't find the container with id d6ca9373fbccf0483dc9e0f0f713343e7cb8b102a4f88fb2b204918b31f2de15
Jul 17 11:01:46.575345 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:46.575322    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76b5fcbfd-6hgcf"]
Jul 17 11:01:46.577564 ip-10-0-143-12 kubenswrapper[2563]: W0717 11:01:46.577538    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod625e2829_ded4_4dce_a33f_6fb1165fea34.slice/crio-f6cdd3e45d88cd2b278878772dd255238839cff4ddc76da4121c8cf7751afaea WatchSource:0}: Error finding container f6cdd3e45d88cd2b278878772dd255238839cff4ddc76da4121c8cf7751afaea: Status 404 returned error can't find the container with id f6cdd3e45d88cd2b278878772dd255238839cff4ddc76da4121c8cf7751afaea
Jul 17 11:01:47.468812 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:47.468710    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6869dc5d45-btq7d" event={"ID":"b4eb6284-216c-4de5-8e83-6a6d140f561a","Type":"ContainerStarted","Data":"d6ca9373fbccf0483dc9e0f0f713343e7cb8b102a4f88fb2b204918b31f2de15"}
Jul 17 11:01:47.471171 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:47.471132    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76b5fcbfd-6hgcf" event={"ID":"625e2829-ded4-4dce-a33f-6fb1165fea34","Type":"ContainerStarted","Data":"f6cdd3e45d88cd2b278878772dd255238839cff4ddc76da4121c8cf7751afaea"}
Jul 17 11:01:49.481262 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:49.481170    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6869dc5d45-btq7d" event={"ID":"b4eb6284-216c-4de5-8e83-6a6d140f561a","Type":"ContainerStarted","Data":"a91e717578a49133db3e4bb6befb9759a8f8e5336d6fdaa620754b36cf8c1c0f"}
Jul 17 11:01:49.481687 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:49.481281    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6869dc5d45-btq7d"
Jul 17 11:01:49.482654 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:49.482631    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76b5fcbfd-6hgcf" event={"ID":"625e2829-ded4-4dce-a33f-6fb1165fea34","Type":"ContainerStarted","Data":"573cf88df9fd4e288a6b01db44508c35e5260a65f73205d98b27df380de5a6b5"}
Jul 17 11:01:49.482752 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:49.482685    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76b5fcbfd-6hgcf"
Jul 17 11:01:49.507034 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:49.506991    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6869dc5d45-btq7d" podStartSLOduration=1.774719684 podStartE2EDuration="4.506979015s" totalImagesPullingTime="2.732259331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:01:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:01:49.505103496 +0000 UTC m=+574.686136460" watchObservedRunningTime="2026-07-17 11:01:49.506979015 +0000 UTC m=+574.688011997"
Jul 17 11:01:49.531034 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:01:49.530999    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-76b5fcbfd-6hgcf" podStartSLOduration=0.87382744 podStartE2EDuration="3.530988956s" totalImagesPullingTime="2.657161516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:01:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:01:49.528592486 +0000 UTC m=+574.709625448" watchObservedRunningTime="2026-07-17 11:01:49.530988956 +0000 UTC m=+574.712021917"
Jul 17 11:02:00.489590 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:00.489561    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6869dc5d45-btq7d"
Jul 17 11:02:00.489934 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:00.489628    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76b5fcbfd-6hgcf"
Jul 17 11:02:00.552236 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:00.552207    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6869dc5d45-btq7d"]
Jul 17 11:02:00.552444 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:00.552409    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6869dc5d45-btq7d" podUID="b4eb6284-216c-4de5-8e83-6a6d140f561a" containerName="manager" containerID="cri-o://a91e717578a49133db3e4bb6befb9759a8f8e5336d6fdaa620754b36cf8c1c0f" gracePeriod=30
Jul 17 11:02:00.806182 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:00.806151    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6869dc5d45-btq7d"
Jul 17 11:02:00.948329 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:00.948305    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzwvm\" (UniqueName: \"kubernetes.io/projected/b4eb6284-216c-4de5-8e83-6a6d140f561a-kube-api-access-wzwvm\") pod \"b4eb6284-216c-4de5-8e83-6a6d140f561a\" (UID: \"b4eb6284-216c-4de5-8e83-6a6d140f561a\") "
Jul 17 11:02:00.948464 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:00.948340    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4eb6284-216c-4de5-8e83-6a6d140f561a-webhook-cert\") pod \"b4eb6284-216c-4de5-8e83-6a6d140f561a\" (UID: \"b4eb6284-216c-4de5-8e83-6a6d140f561a\") "
Jul 17 11:02:00.950254 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:00.950230    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4eb6284-216c-4de5-8e83-6a6d140f561a-kube-api-access-wzwvm" (OuterVolumeSpecName: "kube-api-access-wzwvm") pod "b4eb6284-216c-4de5-8e83-6a6d140f561a" (UID: "b4eb6284-216c-4de5-8e83-6a6d140f561a"). InnerVolumeSpecName "kube-api-access-wzwvm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:02:00.950356 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:00.950301    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4eb6284-216c-4de5-8e83-6a6d140f561a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b4eb6284-216c-4de5-8e83-6a6d140f561a" (UID: "b4eb6284-216c-4de5-8e83-6a6d140f561a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:02:01.049802 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:01.049740    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzwvm\" (UniqueName: \"kubernetes.io/projected/b4eb6284-216c-4de5-8e83-6a6d140f561a-kube-api-access-wzwvm\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:02:01.049802 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:01.049770    2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4eb6284-216c-4de5-8e83-6a6d140f561a-webhook-cert\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:02:01.532318 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:01.532283    2563 generic.go:356] "Generic (PLEG): container finished" podID="b4eb6284-216c-4de5-8e83-6a6d140f561a" containerID="a91e717578a49133db3e4bb6befb9759a8f8e5336d6fdaa620754b36cf8c1c0f" exitCode=0
Jul 17 11:02:01.532633 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:01.532325    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6869dc5d45-btq7d"
Jul 17 11:02:01.532633 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:01.532340    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6869dc5d45-btq7d" event={"ID":"b4eb6284-216c-4de5-8e83-6a6d140f561a","Type":"ContainerDied","Data":"a91e717578a49133db3e4bb6befb9759a8f8e5336d6fdaa620754b36cf8c1c0f"}
Jul 17 11:02:01.532633 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:01.532375    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6869dc5d45-btq7d" event={"ID":"b4eb6284-216c-4de5-8e83-6a6d140f561a","Type":"ContainerDied","Data":"d6ca9373fbccf0483dc9e0f0f713343e7cb8b102a4f88fb2b204918b31f2de15"}
Jul 17 11:02:01.532633 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:01.532397    2563 scope.go:117] "RemoveContainer" containerID="a91e717578a49133db3e4bb6befb9759a8f8e5336d6fdaa620754b36cf8c1c0f"
Jul 17 11:02:01.539954 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:01.539937    2563 scope.go:117] "RemoveContainer" containerID="a91e717578a49133db3e4bb6befb9759a8f8e5336d6fdaa620754b36cf8c1c0f"
Jul 17 11:02:01.540197 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:02:01.540180    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a91e717578a49133db3e4bb6befb9759a8f8e5336d6fdaa620754b36cf8c1c0f\": container with ID starting with a91e717578a49133db3e4bb6befb9759a8f8e5336d6fdaa620754b36cf8c1c0f not found: ID does not exist" containerID="a91e717578a49133db3e4bb6befb9759a8f8e5336d6fdaa620754b36cf8c1c0f"
Jul 17 11:02:01.540255 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:01.540208    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a91e717578a49133db3e4bb6befb9759a8f8e5336d6fdaa620754b36cf8c1c0f"} err="failed to get container status \"a91e717578a49133db3e4bb6befb9759a8f8e5336d6fdaa620754b36cf8c1c0f\": rpc error: code = NotFound desc = could not find container \"a91e717578a49133db3e4bb6befb9759a8f8e5336d6fdaa620754b36cf8c1c0f\": container with ID starting with a91e717578a49133db3e4bb6befb9759a8f8e5336d6fdaa620754b36cf8c1c0f not found: ID does not exist"
Jul 17 11:02:01.548012 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:01.547990    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6869dc5d45-btq7d"]
Jul 17 11:02:01.551928 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:01.551909    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6869dc5d45-btq7d"]
Jul 17 11:02:03.264416 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:03.264390    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4eb6284-216c-4de5-8e83-6a6d140f561a" path="/var/lib/kubelet/pods/b4eb6284-216c-4de5-8e83-6a6d140f561a/volumes"
Jul 17 11:02:15.205919 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:15.205890    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xdrhl_48cc1998-ebc5-4702-8b08-027479580e57/ovn-acl-logging/0.log"
Jul 17 11:02:15.209264 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:15.209240    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xdrhl_48cc1998-ebc5-4702-8b08-027479580e57/ovn-acl-logging/0.log"
Jul 17 11:02:21.756106 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:21.756075    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5cbc55679f-lz6l8"]
Jul 17 11:02:21.756470 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:21.756360    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4eb6284-216c-4de5-8e83-6a6d140f561a" containerName="manager"
Jul 17 11:02:21.756470 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:21.756370    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4eb6284-216c-4de5-8e83-6a6d140f561a" containerName="manager"
Jul 17 11:02:21.756470 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:21.756443    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4eb6284-216c-4de5-8e83-6a6d140f561a" containerName="manager"
Jul 17 11:02:21.763906 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:21.763887    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5cbc55679f-lz6l8"
Jul 17 11:02:21.766724 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:21.766704    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vx26k\""
Jul 17 11:02:21.766865 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:21.766739    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 17 11:02:21.771377 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:21.770633    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5cbc55679f-lz6l8"]
Jul 17 11:02:21.890193 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:21.890166    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b022cf2-51c3-4af9-b358-ab791b075a6e-maas-api-tls\") pod \"maas-api-5cbc55679f-lz6l8\" (UID: \"1b022cf2-51c3-4af9-b358-ab791b075a6e\") " pod="odh-ai-gateway-infra/maas-api-5cbc55679f-lz6l8"
Jul 17 11:02:21.890310 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:21.890235    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b022cf2-51c3-4af9-b358-ab791b075a6e-openshift-service-ca\") pod \"maas-api-5cbc55679f-lz6l8\" (UID: \"1b022cf2-51c3-4af9-b358-ab791b075a6e\") " pod="odh-ai-gateway-infra/maas-api-5cbc55679f-lz6l8"
Jul 17 11:02:21.890310 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:21.890274    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m48c2\" (UniqueName: \"kubernetes.io/projected/1b022cf2-51c3-4af9-b358-ab791b075a6e-kube-api-access-m48c2\") pod \"maas-api-5cbc55679f-lz6l8\" (UID: \"1b022cf2-51c3-4af9-b358-ab791b075a6e\") " pod="odh-ai-gateway-infra/maas-api-5cbc55679f-lz6l8"
Jul 17 11:02:21.991518 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:21.991495    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b022cf2-51c3-4af9-b358-ab791b075a6e-maas-api-tls\") pod \"maas-api-5cbc55679f-lz6l8\" (UID: \"1b022cf2-51c3-4af9-b358-ab791b075a6e\") " pod="odh-ai-gateway-infra/maas-api-5cbc55679f-lz6l8"
Jul 17 11:02:21.991621 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:21.991537    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b022cf2-51c3-4af9-b358-ab791b075a6e-openshift-service-ca\") pod \"maas-api-5cbc55679f-lz6l8\" (UID: \"1b022cf2-51c3-4af9-b358-ab791b075a6e\") " pod="odh-ai-gateway-infra/maas-api-5cbc55679f-lz6l8"
Jul 17 11:02:21.991621 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:21.991578    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m48c2\" (UniqueName: \"kubernetes.io/projected/1b022cf2-51c3-4af9-b358-ab791b075a6e-kube-api-access-m48c2\") pod \"maas-api-5cbc55679f-lz6l8\" (UID: \"1b022cf2-51c3-4af9-b358-ab791b075a6e\") " pod="odh-ai-gateway-infra/maas-api-5cbc55679f-lz6l8"
Jul 17 11:02:21.992191 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:21.992170    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b022cf2-51c3-4af9-b358-ab791b075a6e-openshift-service-ca\") pod \"maas-api-5cbc55679f-lz6l8\" (UID: \"1b022cf2-51c3-4af9-b358-ab791b075a6e\") " pod="odh-ai-gateway-infra/maas-api-5cbc55679f-lz6l8"
Jul 17 11:02:21.993733 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:21.993714    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b022cf2-51c3-4af9-b358-ab791b075a6e-maas-api-tls\") pod \"maas-api-5cbc55679f-lz6l8\" (UID: \"1b022cf2-51c3-4af9-b358-ab791b075a6e\") " pod="odh-ai-gateway-infra/maas-api-5cbc55679f-lz6l8"
Jul 17 11:02:22.001153 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:22.001134    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m48c2\" (UniqueName: \"kubernetes.io/projected/1b022cf2-51c3-4af9-b358-ab791b075a6e-kube-api-access-m48c2\") pod \"maas-api-5cbc55679f-lz6l8\" (UID: \"1b022cf2-51c3-4af9-b358-ab791b075a6e\") " pod="odh-ai-gateway-infra/maas-api-5cbc55679f-lz6l8"
Jul 17 11:02:22.075623 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:22.075575    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5cbc55679f-lz6l8"
Jul 17 11:02:22.204745 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:22.204715    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5cbc55679f-lz6l8"]
Jul 17 11:02:22.207012 ip-10-0-143-12 kubenswrapper[2563]: W0717 11:02:22.206986    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b022cf2_51c3_4af9_b358_ab791b075a6e.slice/crio-bd9ae849e5aa8624119633ac8f3d51669c49ea15f381919fb6084547b3afd649 WatchSource:0}: Error finding container bd9ae849e5aa8624119633ac8f3d51669c49ea15f381919fb6084547b3afd649: Status 404 returned error can't find the container with id bd9ae849e5aa8624119633ac8f3d51669c49ea15f381919fb6084547b3afd649
Jul 17 11:02:22.425050 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:22.425021    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-vx4g4"]
Jul 17 11:02:22.427661 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:22.427646    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-vx4g4"
Jul 17 11:02:22.430227 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:22.430206    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-h7fnb\""
Jul 17 11:02:22.430555 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:22.430536    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 17 11:02:22.430942 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:22.430923    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 17 11:02:22.431181 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:22.431166    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 17 11:02:22.441675 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:22.441655    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-vx4g4"]
Jul 17 11:02:22.466461 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:22.466439    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-zhvgn"]
Jul 17 11:02:22.468496 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:22.468481    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-zhvgn"
Jul 17 11:02:22.483213 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:22.483187    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-zhvgn"]
Jul 17 11:02:22.597325 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:22.597299    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51edfb3d-8631-4e95-8141-148110c6bfc1-plugins-config-volume\") pod \"payload-processing-5bf47cd988-vx4g4\" (UID: \"51edfb3d-8631-4e95-8141-148110c6bfc1\") " pod="openshift-ingress/payload-processing-5bf47cd988-vx4g4"
Jul 17 11:02:22.597467 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:22.597342    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da34ff4e-059d-480d-9814-c935bbb18fd5-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-zhvgn\" (UID: \"da34ff4e-059d-480d-9814-c935bbb18fd5\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-zhvgn"
Jul 17 11:02:22.597467 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:22.597372    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tg2w\" (UniqueName: \"kubernetes.io/projected/51edfb3d-8631-4e95-8141-148110c6bfc1-kube-api-access-9tg2w\") pod \"payload-processing-5bf47cd988-vx4g4\" (UID: \"51edfb3d-8631-4e95-8141-148110c6bfc1\") " pod="openshift-ingress/payload-processing-5bf47cd988-vx4g4"
Jul 17 11:02:22.597467 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:22.597458    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5796l\" (UniqueName: \"kubernetes.io/projected/da34ff4e-059d-480d-9814-c935bbb18fd5-kube-api-access-5796l\") pod \"payload-pre-processing-7677b774bb-zhvgn\" (UID: \"da34ff4e-059d-480d-9814-c935bbb18fd5\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-zhvgn"
Jul 17 11:02:22.618053 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:22.618025    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5cbc55679f-lz6l8" event={"ID":"1b022cf2-51c3-4af9-b358-ab791b075a6e","Type":"ContainerStarted","Data":"bd9ae849e5aa8624119633ac8f3d51669c49ea15f381919fb6084547b3afd649"}
Jul 17 11:02:22.698274 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:22.698217    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51edfb3d-8631-4e95-8141-148110c6bfc1-plugins-config-volume\") pod \"payload-processing-5bf47cd988-vx4g4\" (UID: \"51edfb3d-8631-4e95-8141-148110c6bfc1\") " pod="openshift-ingress/payload-processing-5bf47cd988-vx4g4"
Jul 17 11:02:22.698274 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:22.698252    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da34ff4e-059d-480d-9814-c935bbb18fd5-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-zhvgn\" (UID: \"da34ff4e-059d-480d-9814-c935bbb18fd5\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-zhvgn"
Jul 17 11:02:22.698274 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:22.698274    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tg2w\" (UniqueName: \"kubernetes.io/projected/51edfb3d-8631-4e95-8141-148110c6bfc1-kube-api-access-9tg2w\") pod \"payload-processing-5bf47cd988-vx4g4\" (UID: \"51edfb3d-8631-4e95-8141-148110c6bfc1\") " pod="openshift-ingress/payload-processing-5bf47cd988-vx4g4"
Jul 17 11:02:22.698558 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:22.698313    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5796l\" (UniqueName: \"kubernetes.io/projected/da34ff4e-059d-480d-9814-c935bbb18fd5-kube-api-access-5796l\") pod \"payload-pre-processing-7677b774bb-zhvgn\" (UID: \"da34ff4e-059d-480d-9814-c935bbb18fd5\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-zhvgn"
Jul 17 11:02:22.698980 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:22.698960    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51edfb3d-8631-4e95-8141-148110c6bfc1-plugins-config-volume\") pod \"payload-processing-5bf47cd988-vx4g4\" (UID: \"51edfb3d-8631-4e95-8141-148110c6bfc1\") " pod="openshift-ingress/payload-processing-5bf47cd988-vx4g4"
Jul 17 11:02:22.699038 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:22.699014    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da34ff4e-059d-480d-9814-c935bbb18fd5-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-zhvgn\" (UID: \"da34ff4e-059d-480d-9814-c935bbb18fd5\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-zhvgn"
Jul 17 11:02:22.707774 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:22.707757    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tg2w\" (UniqueName: \"kubernetes.io/projected/51edfb3d-8631-4e95-8141-148110c6bfc1-kube-api-access-9tg2w\") pod \"payload-processing-5bf47cd988-vx4g4\" (UID: \"51edfb3d-8631-4e95-8141-148110c6bfc1\") " pod="openshift-ingress/payload-processing-5bf47cd988-vx4g4"
Jul 17 11:02:22.709505 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:22.709488    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5796l\" (UniqueName: \"kubernetes.io/projected/da34ff4e-059d-480d-9814-c935bbb18fd5-kube-api-access-5796l\") pod \"payload-pre-processing-7677b774bb-zhvgn\" (UID: \"da34ff4e-059d-480d-9814-c935bbb18fd5\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-zhvgn"
Jul 17 11:02:22.738277 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:22.738256    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-vx4g4"
Jul 17 11:02:22.777565 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:22.777497    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-zhvgn"
Jul 17 11:02:22.875983 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:22.875957    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-vx4g4"]
Jul 17 11:02:22.879049 ip-10-0-143-12 kubenswrapper[2563]: W0717 11:02:22.879025    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51edfb3d_8631_4e95_8141_148110c6bfc1.slice/crio-5bd78f954cef2da48cf1af35e50b6eb3ba696269cb741a8578ce3fe28a6b6ad3 WatchSource:0}: Error finding container 5bd78f954cef2da48cf1af35e50b6eb3ba696269cb741a8578ce3fe28a6b6ad3: Status 404 returned error can't find the container with id 5bd78f954cef2da48cf1af35e50b6eb3ba696269cb741a8578ce3fe28a6b6ad3
Jul 17 11:02:23.124887 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:23.124848    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-zhvgn"]
Jul 17 11:02:23.127231 ip-10-0-143-12 kubenswrapper[2563]: W0717 11:02:23.127194    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda34ff4e_059d_480d_9814_c935bbb18fd5.slice/crio-636bc670817a607567ac4ffe9ccdf13a9844447c44fbd45824483463a2118d59 WatchSource:0}: Error finding container 636bc670817a607567ac4ffe9ccdf13a9844447c44fbd45824483463a2118d59: Status 404 returned error can't find the container with id 636bc670817a607567ac4ffe9ccdf13a9844447c44fbd45824483463a2118d59
Jul 17 11:02:23.626461 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:23.626297    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-vx4g4" event={"ID":"51edfb3d-8631-4e95-8141-148110c6bfc1","Type":"ContainerStarted","Data":"5bd78f954cef2da48cf1af35e50b6eb3ba696269cb741a8578ce3fe28a6b6ad3"}
Jul 17 11:02:23.627835 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:23.627770    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-zhvgn" event={"ID":"da34ff4e-059d-480d-9814-c935bbb18fd5","Type":"ContainerStarted","Data":"636bc670817a607567ac4ffe9ccdf13a9844447c44fbd45824483463a2118d59"}
Jul 17 11:02:24.635076 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:24.635035    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5cbc55679f-lz6l8" event={"ID":"1b022cf2-51c3-4af9-b358-ab791b075a6e","Type":"ContainerStarted","Data":"069d14c7345e7ec65024c96b75376ef5c890ae20be1309729b35b669e7d320eb"}
Jul 17 11:02:24.635520 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:24.635145    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5cbc55679f-lz6l8"
Jul 17 11:02:24.656197 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:24.656153    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5cbc55679f-lz6l8" podStartSLOduration=1.440289483 podStartE2EDuration="3.656139322s" totalImagesPullingTime="2.215849839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:02:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:02:24.654589416 +0000 UTC m=+609.835622379" watchObservedRunningTime="2026-07-17 11:02:24.656139322 +0000 UTC m=+609.837172282"
Jul 17 11:02:25.641344 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:25.641316    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-vx4g4" event={"ID":"51edfb3d-8631-4e95-8141-148110c6bfc1","Type":"ContainerStarted","Data":"cdeb4e46f15ffb3072dd138688c1674fe33bded881751620412d750fb088d2b1"}
Jul 17 11:02:25.641747 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:25.641422    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-vx4g4"
Jul 17 11:02:25.642909 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:25.642867    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-zhvgn" event={"ID":"da34ff4e-059d-480d-9814-c935bbb18fd5","Type":"ContainerStarted","Data":"375c8586d8d8de7625b77ae9fc0622bb2c9cebcc5fb0c6812116987fd3ac0ac2"}
Jul 17 11:02:25.643029 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:25.642984    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-zhvgn"
Jul 17 11:02:25.664735 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:25.664695    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-vx4g4" podStartSLOduration=1.031573631 podStartE2EDuration="3.664667959s" totalImagesPullingTime="2.633094328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:02:25.663476508 +0000 UTC m=+610.844509464" watchObservedRunningTime="2026-07-17 11:02:25.664667959 +0000 UTC m=+610.845700920"
Jul 17 11:02:25.685288 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:25.685243    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-zhvgn" podStartSLOduration=1.293456268 podStartE2EDuration="3.685226723s" totalImagesPullingTime="2.391770455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:02:25.684816297 +0000 UTC m=+610.865849259" watchObservedRunningTime="2026-07-17 11:02:25.685226723 +0000 UTC m=+610.866259687"
Jul 17 11:02:30.648225 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:30.648198    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5cbc55679f-lz6l8"
Jul 17 11:02:36.649283 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:36.649256    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-vx4g4"
Jul 17 11:02:36.649642 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:36.649320    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-zhvgn"
Jul 17 11:02:52.863559 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:52.863523    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg"]
Jul 17 11:02:52.866966 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:52.866950    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg"
Jul 17 11:02:52.870590 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:52.870570    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 17 11:02:52.873595 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:52.873575    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 17 11:02:52.874992 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:52.874974    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 17 11:02:52.875101 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:52.875021    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-shjnc\""
Jul 17 11:02:52.882738 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:52.882720    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg"]
Jul 17 11:02:52.907841 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:52.907813    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca558ead-0418-4e9b-9b1f-b6a5a43c35d0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg\" (UID: \"ca558ead-0418-4e9b-9b1f-b6a5a43c35d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg"
Jul 17 11:02:52.907942 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:52.907878    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca558ead-0418-4e9b-9b1f-b6a5a43c35d0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg\" (UID: \"ca558ead-0418-4e9b-9b1f-b6a5a43c35d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg"
Jul 17 11:02:52.907942 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:52.907906    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca558ead-0418-4e9b-9b1f-b6a5a43c35d0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg\" (UID: \"ca558ead-0418-4e9b-9b1f-b6a5a43c35d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg"
Jul 17 11:02:52.908047 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:52.907942    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca558ead-0418-4e9b-9b1f-b6a5a43c35d0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg\" (UID: \"ca558ead-0418-4e9b-9b1f-b6a5a43c35d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg"
Jul 17 11:02:52.908047 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:52.907979    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca558ead-0418-4e9b-9b1f-b6a5a43c35d0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg\" (UID: \"ca558ead-0418-4e9b-9b1f-b6a5a43c35d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg"
Jul 17 11:02:52.908047 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:52.908012    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9hjw\" (UniqueName: \"kubernetes.io/projected/ca558ead-0418-4e9b-9b1f-b6a5a43c35d0-kube-api-access-j9hjw\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg\" (UID: \"ca558ead-0418-4e9b-9b1f-b6a5a43c35d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg"
Jul 17 11:02:53.008416 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:53.008392    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca558ead-0418-4e9b-9b1f-b6a5a43c35d0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg\" (UID: \"ca558ead-0418-4e9b-9b1f-b6a5a43c35d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg"
Jul 17 11:02:53.008539 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:53.008459    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca558ead-0418-4e9b-9b1f-b6a5a43c35d0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg\" (UID: \"ca558ead-0418-4e9b-9b1f-b6a5a43c35d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg"
Jul 17 11:02:53.008539 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:53.008480    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca558ead-0418-4e9b-9b1f-b6a5a43c35d0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg\" (UID: \"ca558ead-0418-4e9b-9b1f-b6a5a43c35d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg"
Jul 17 11:02:53.008539 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:53.008501    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca558ead-0418-4e9b-9b1f-b6a5a43c35d0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg\" (UID: \"ca558ead-0418-4e9b-9b1f-b6a5a43c35d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg"
Jul 17 11:02:53.008539 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:53.008530    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca558ead-0418-4e9b-9b1f-b6a5a43c35d0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg\" (UID: \"ca558ead-0418-4e9b-9b1f-b6a5a43c35d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg"
Jul 17 11:02:53.008717 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:53.008552    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9hjw\" (UniqueName: \"kubernetes.io/projected/ca558ead-0418-4e9b-9b1f-b6a5a43c35d0-kube-api-access-j9hjw\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg\" (UID: \"ca558ead-0418-4e9b-9b1f-b6a5a43c35d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg"
Jul 17 11:02:53.008889 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:53.008864    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca558ead-0418-4e9b-9b1f-b6a5a43c35d0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg\" (UID: \"ca558ead-0418-4e9b-9b1f-b6a5a43c35d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg"
Jul 17 11:02:53.008992 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:53.008920    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca558ead-0418-4e9b-9b1f-b6a5a43c35d0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg\" (UID: \"ca558ead-0418-4e9b-9b1f-b6a5a43c35d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg"
Jul 17 11:02:53.008992 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:53.008971    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca558ead-0418-4e9b-9b1f-b6a5a43c35d0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg\" (UID: \"ca558ead-0418-4e9b-9b1f-b6a5a43c35d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg"
Jul 17 11:02:53.010571 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:53.010544    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca558ead-0418-4e9b-9b1f-b6a5a43c35d0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg\" (UID: \"ca558ead-0418-4e9b-9b1f-b6a5a43c35d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg"
Jul 17 11:02:53.010760 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:53.010744    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca558ead-0418-4e9b-9b1f-b6a5a43c35d0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg\" (UID: \"ca558ead-0418-4e9b-9b1f-b6a5a43c35d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg"
Jul 17 11:02:53.018594 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:53.018576    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9hjw\" (UniqueName: \"kubernetes.io/projected/ca558ead-0418-4e9b-9b1f-b6a5a43c35d0-kube-api-access-j9hjw\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg\" (UID: \"ca558ead-0418-4e9b-9b1f-b6a5a43c35d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg"
Jul 17 11:02:53.176649 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:53.176629    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg"
Jul 17 11:02:53.304630 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:53.304608    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg"]
Jul 17 11:02:53.307044 ip-10-0-143-12 kubenswrapper[2563]: W0717 11:02:53.307001    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca558ead_0418_4e9b_9b1f_b6a5a43c35d0.slice/crio-89da23cdf3eeaf96da9a4a5fa58b3c3509870bfa78081647834852c671cd90fa WatchSource:0}: Error finding container 89da23cdf3eeaf96da9a4a5fa58b3c3509870bfa78081647834852c671cd90fa: Status 404 returned error can't find the container with id 89da23cdf3eeaf96da9a4a5fa58b3c3509870bfa78081647834852c671cd90fa
Jul 17 11:02:53.757063 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:53.757026    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg" event={"ID":"ca558ead-0418-4e9b-9b1f-b6a5a43c35d0","Type":"ContainerStarted","Data":"89da23cdf3eeaf96da9a4a5fa58b3c3509870bfa78081647834852c671cd90fa"}
Jul 17 11:02:54.762781 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:54.762703    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg" event={"ID":"ca558ead-0418-4e9b-9b1f-b6a5a43c35d0","Type":"ContainerStarted","Data":"0461be2f6e2f5cb77f168b2d93180fe465720de28debf13bdd0b148f24d11b33"}
Jul 17 11:02:54.783379 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:02:54.783129    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg" podStartSLOduration=1.616864798 podStartE2EDuration="2.783109761s" totalImagesPullingTime="1.166244963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:02:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:02:54.78265453 +0000 UTC m=+639.963687492" watchObservedRunningTime="2026-07-17 11:02:54.783109761 +0000 UTC m=+639.964142724"
Jul 17 11:03:03.177199 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:03.177159    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg"
Jul 17 11:03:03.177573 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:03.177216    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg"
Jul 17 11:03:03.189270 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:03.189242    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg"
Jul 17 11:03:03.811995 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:03.811971    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg"
Jul 17 11:03:05.986164 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:05.986131    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ddrns"]
Jul 17 11:03:05.990968 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:05.990946    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ddrns"
Jul 17 11:03:06.000260 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:06.000234    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 17 11:03:06.020621 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:06.020602    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ddrns"]
Jul 17 11:03:06.104484 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:06.104463    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30ba9185-7fb6-4631-9433-cec280bdfdcc-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ddrns\" (UID: \"30ba9185-7fb6-4631-9433-cec280bdfdcc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ddrns"
Jul 17 11:03:06.104580 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:06.104491    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30ba9185-7fb6-4631-9433-cec280bdfdcc-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ddrns\" (UID: \"30ba9185-7fb6-4631-9433-cec280bdfdcc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ddrns"
Jul 17 11:03:06.104580 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:06.104530    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30ba9185-7fb6-4631-9433-cec280bdfdcc-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ddrns\" (UID: \"30ba9185-7fb6-4631-9433-cec280bdfdcc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ddrns"
Jul 17 11:03:06.104687 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:06.104597    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30ba9185-7fb6-4631-9433-cec280bdfdcc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ddrns\" (UID: \"30ba9185-7fb6-4631-9433-cec280bdfdcc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ddrns"
Jul 17 11:03:06.104687 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:06.104639    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30ba9185-7fb6-4631-9433-cec280bdfdcc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ddrns\" (UID: \"30ba9185-7fb6-4631-9433-cec280bdfdcc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ddrns"
Jul 17 11:03:06.104687 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:06.104669    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x47tv\" (UniqueName: \"kubernetes.io/projected/30ba9185-7fb6-4631-9433-cec280bdfdcc-kube-api-access-x47tv\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ddrns\" (UID: \"30ba9185-7fb6-4631-9433-cec280bdfdcc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ddrns"
Jul 17 11:03:06.204997 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:06.204971    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30ba9185-7fb6-4631-9433-cec280bdfdcc-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ddrns\" (UID: \"30ba9185-7fb6-4631-9433-cec280bdfdcc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ddrns"
Jul 17 11:03:06.205095 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:06.205008    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30ba9185-7fb6-4631-9433-cec280bdfdcc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ddrns\" (UID: \"30ba9185-7fb6-4631-9433-cec280bdfdcc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ddrns"
Jul 17 11:03:06.205095 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:06.205039    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30ba9185-7fb6-4631-9433-cec280bdfdcc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ddrns\" (UID: \"30ba9185-7fb6-4631-9433-cec280bdfdcc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ddrns"
Jul 17 11:03:06.205095 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:06.205063    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x47tv\" (UniqueName: \"kubernetes.io/projected/30ba9185-7fb6-4631-9433-cec280bdfdcc-kube-api-access-x47tv\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ddrns\" (UID: \"30ba9185-7fb6-4631-9433-cec280bdfdcc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ddrns"
Jul 17 11:03:06.205242 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:06.205111    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30ba9185-7fb6-4631-9433-cec280bdfdcc-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ddrns\" (UID: \"30ba9185-7fb6-4631-9433-cec280bdfdcc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ddrns"
Jul 17 11:03:06.205242 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:06.205134    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30ba9185-7fb6-4631-9433-cec280bdfdcc-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ddrns\" (UID: \"30ba9185-7fb6-4631-9433-cec280bdfdcc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ddrns"
Jul 17 11:03:06.205386 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:06.205364    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30ba9185-7fb6-4631-9433-cec280bdfdcc-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ddrns\" (UID: \"30ba9185-7fb6-4631-9433-cec280bdfdcc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ddrns"
Jul 17 11:03:06.205470 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:06.205415    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30ba9185-7fb6-4631-9433-cec280bdfdcc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ddrns\" (UID: \"30ba9185-7fb6-4631-9433-cec280bdfdcc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ddrns"
Jul 17 11:03:06.205527 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:06.205506    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30ba9185-7fb6-4631-9433-cec280bdfdcc-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ddrns\" (UID: \"30ba9185-7fb6-4631-9433-cec280bdfdcc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ddrns"
Jul 17 11:03:06.207259 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:06.207235    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30ba9185-7fb6-4631-9433-cec280bdfdcc-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ddrns\" (UID: \"30ba9185-7fb6-4631-9433-cec280bdfdcc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ddrns"
Jul 17 11:03:06.207398 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:06.207381    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30ba9185-7fb6-4631-9433-cec280bdfdcc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ddrns\" (UID: \"30ba9185-7fb6-4631-9433-cec280bdfdcc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ddrns"
Jul 17 11:03:06.216852 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:06.216817    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x47tv\" (UniqueName: \"kubernetes.io/projected/30ba9185-7fb6-4631-9433-cec280bdfdcc-kube-api-access-x47tv\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ddrns\" (UID: \"30ba9185-7fb6-4631-9433-cec280bdfdcc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ddrns"
Jul 17 11:03:06.300039 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:06.299989    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ddrns"
Jul 17 11:03:06.445368 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:06.445327    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ddrns"]
Jul 17 11:03:06.447613 ip-10-0-143-12 kubenswrapper[2563]: W0717 11:03:06.447591    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30ba9185_7fb6_4631_9433_cec280bdfdcc.slice/crio-3351f3a65916152f482390763276e52be0d1cb9cfe7721810cdae0b0b8800c43 WatchSource:0}: Error finding container 3351f3a65916152f482390763276e52be0d1cb9cfe7721810cdae0b0b8800c43: Status 404 returned error can't find the container with id 3351f3a65916152f482390763276e52be0d1cb9cfe7721810cdae0b0b8800c43
Jul 17 11:03:06.815576 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:06.815543    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ddrns" event={"ID":"30ba9185-7fb6-4631-9433-cec280bdfdcc","Type":"ContainerStarted","Data":"5a63610ea7bacd474ecf6c2363ab5352f970d4e67f1aa3eb122990a9a18d53a9"}
Jul 17 11:03:06.815719 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:06.815605    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ddrns" event={"ID":"30ba9185-7fb6-4631-9433-cec280bdfdcc","Type":"ContainerStarted","Data":"3351f3a65916152f482390763276e52be0d1cb9cfe7721810cdae0b0b8800c43"}
Jul 17 11:03:06.846949 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:06.846900    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ddrns" podStartSLOduration=1.680112826 podStartE2EDuration="1.846884862s" totalImagesPullingTime="166.772036ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:03:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:03:06.846187764 +0000 UTC m=+652.027220724" watchObservedRunningTime="2026-07-17 11:03:06.846884862 +0000 UTC m=+652.027917822"
Jul 17 11:03:16.300403 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:16.300373    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ddrns"
Jul 17 11:03:16.300762 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:16.300424    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ddrns"
Jul 17 11:03:16.312134 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:16.312108    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ddrns"
Jul 17 11:03:16.866818 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:16.866794    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ddrns"
Jul 17 11:03:31.359219 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:31.359189    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-vgdjk"]
Jul 17 11:03:31.365708 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:31.365688    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vgdjk"
Jul 17 11:03:31.368217 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:31.368198    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 17 11:03:31.373808 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:31.373788    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-vgdjk"]
Jul 17 11:03:31.495050 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:31.495023    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f29e967a-0a1c-4243-93f6-8b54e421ee50-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vgdjk\" (UID: \"f29e967a-0a1c-4243-93f6-8b54e421ee50\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vgdjk"
Jul 17 11:03:31.495173 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:31.495056    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f29e967a-0a1c-4243-93f6-8b54e421ee50-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vgdjk\" (UID: \"f29e967a-0a1c-4243-93f6-8b54e421ee50\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vgdjk"
Jul 17 11:03:31.495173 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:31.495078    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f29e967a-0a1c-4243-93f6-8b54e421ee50-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vgdjk\" (UID: \"f29e967a-0a1c-4243-93f6-8b54e421ee50\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vgdjk"
Jul 17 11:03:31.495173 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:31.495096    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f29e967a-0a1c-4243-93f6-8b54e421ee50-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vgdjk\" (UID: \"f29e967a-0a1c-4243-93f6-8b54e421ee50\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vgdjk"
Jul 17 11:03:31.495303 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:31.495207    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq2h6\" (UniqueName: \"kubernetes.io/projected/f29e967a-0a1c-4243-93f6-8b54e421ee50-kube-api-access-kq2h6\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vgdjk\" (UID: \"f29e967a-0a1c-4243-93f6-8b54e421ee50\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vgdjk"
Jul 17 11:03:31.495303 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:31.495237    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f29e967a-0a1c-4243-93f6-8b54e421ee50-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vgdjk\" (UID: \"f29e967a-0a1c-4243-93f6-8b54e421ee50\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vgdjk"
Jul 17 11:03:31.596335 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:31.596308    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f29e967a-0a1c-4243-93f6-8b54e421ee50-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vgdjk\" (UID: \"f29e967a-0a1c-4243-93f6-8b54e421ee50\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vgdjk"
Jul 17 11:03:31.596470 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:31.596342    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f29e967a-0a1c-4243-93f6-8b54e421ee50-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vgdjk\" (UID: \"f29e967a-0a1c-4243-93f6-8b54e421ee50\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vgdjk"
Jul 17 11:03:31.596470 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:31.596362    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f29e967a-0a1c-4243-93f6-8b54e421ee50-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vgdjk\" (UID: \"f29e967a-0a1c-4243-93f6-8b54e421ee50\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vgdjk"
Jul 17 11:03:31.596470 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:31.596379    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f29e967a-0a1c-4243-93f6-8b54e421ee50-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vgdjk\" (UID: \"f29e967a-0a1c-4243-93f6-8b54e421ee50\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vgdjk"
Jul 17 11:03:31.596470 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:31.596449    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq2h6\" (UniqueName: \"kubernetes.io/projected/f29e967a-0a1c-4243-93f6-8b54e421ee50-kube-api-access-kq2h6\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vgdjk\" (UID: \"f29e967a-0a1c-4243-93f6-8b54e421ee50\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vgdjk"
Jul 17 11:03:31.596673 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:31.596475    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f29e967a-0a1c-4243-93f6-8b54e421ee50-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vgdjk\" (UID: \"f29e967a-0a1c-4243-93f6-8b54e421ee50\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vgdjk"
Jul 17 11:03:31.596794 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:31.596773    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f29e967a-0a1c-4243-93f6-8b54e421ee50-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vgdjk\" (UID: \"f29e967a-0a1c-4243-93f6-8b54e421ee50\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vgdjk"
Jul 17 11:03:31.596886 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:31.596819    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f29e967a-0a1c-4243-93f6-8b54e421ee50-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vgdjk\" (UID: \"f29e967a-0a1c-4243-93f6-8b54e421ee50\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vgdjk"
Jul 17 11:03:31.596886 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:31.596846    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f29e967a-0a1c-4243-93f6-8b54e421ee50-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vgdjk\" (UID: \"f29e967a-0a1c-4243-93f6-8b54e421ee50\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vgdjk"
Jul 17 11:03:31.598753 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:31.598732    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f29e967a-0a1c-4243-93f6-8b54e421ee50-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vgdjk\" (UID: \"f29e967a-0a1c-4243-93f6-8b54e421ee50\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vgdjk"
Jul 17 11:03:31.599020 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:31.598998    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f29e967a-0a1c-4243-93f6-8b54e421ee50-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vgdjk\" (UID: \"f29e967a-0a1c-4243-93f6-8b54e421ee50\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vgdjk"
Jul 17 11:03:31.604802 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:31.604780    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq2h6\" (UniqueName: \"kubernetes.io/projected/f29e967a-0a1c-4243-93f6-8b54e421ee50-kube-api-access-kq2h6\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vgdjk\" (UID: \"f29e967a-0a1c-4243-93f6-8b54e421ee50\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vgdjk"
Jul 17 11:03:31.676163 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:31.676137    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vgdjk"
Jul 17 11:03:31.804230 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:31.804206    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-vgdjk"]
Jul 17 11:03:31.807236 ip-10-0-143-12 kubenswrapper[2563]: W0717 11:03:31.807204    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf29e967a_0a1c_4243_93f6_8b54e421ee50.slice/crio-ad4fe84e8d068defa32a7bc975e33d107f59e6555fe95782c40df02a1b8b04eb WatchSource:0}: Error finding container ad4fe84e8d068defa32a7bc975e33d107f59e6555fe95782c40df02a1b8b04eb: Status 404 returned error can't find the container with id ad4fe84e8d068defa32a7bc975e33d107f59e6555fe95782c40df02a1b8b04eb
Jul 17 11:03:31.808711 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:31.808694    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 11:03:31.918996 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:31.918969    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vgdjk" event={"ID":"f29e967a-0a1c-4243-93f6-8b54e421ee50","Type":"ContainerStarted","Data":"ad4fe84e8d068defa32a7bc975e33d107f59e6555fe95782c40df02a1b8b04eb"}
Jul 17 11:03:32.925203 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:32.925173    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vgdjk" event={"ID":"f29e967a-0a1c-4243-93f6-8b54e421ee50","Type":"ContainerStarted","Data":"fc68297ba75f389dadf16a79a23bc06439c634e3b3b9f42aaa243eb9fbc0092d"}
Jul 17 11:03:32.946315 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:32.946270    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vgdjk" podStartSLOduration=1.752815978 podStartE2EDuration="1.946255528s" totalImagesPullingTime="193.43955ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:03:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:03:32.944313234 +0000 UTC m=+678.125346196" watchObservedRunningTime="2026-07-17 11:03:32.946255528 +0000 UTC m=+678.127288488"
Jul 17 11:03:41.677265 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:41.677231    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vgdjk"
Jul 17 11:03:41.677651 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:41.677292    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vgdjk"
Jul 17 11:03:41.689656 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:41.689635    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vgdjk"
Jul 17 11:03:41.978233 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:03:41.978164    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vgdjk"
Jul 17 11:05:18.436066 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:05:18.436036    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76b5fcbfd-6hgcf"]
Jul 17 11:05:18.436528 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:05:18.436236    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-76b5fcbfd-6hgcf" podUID="625e2829-ded4-4dce-a33f-6fb1165fea34" containerName="manager" containerID="cri-o://573cf88df9fd4e288a6b01db44508c35e5260a65f73205d98b27df380de5a6b5" gracePeriod=30
Jul 17 11:05:18.681714 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:05:18.681692    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76b5fcbfd-6hgcf"
Jul 17 11:05:18.786206 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:05:18.786137    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-794pp\" (UniqueName: \"kubernetes.io/projected/625e2829-ded4-4dce-a33f-6fb1165fea34-kube-api-access-794pp\") pod \"625e2829-ded4-4dce-a33f-6fb1165fea34\" (UID: \"625e2829-ded4-4dce-a33f-6fb1165fea34\") "
Jul 17 11:05:18.786348 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:05:18.786223    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/625e2829-ded4-4dce-a33f-6fb1165fea34-webhook-cert\") pod \"625e2829-ded4-4dce-a33f-6fb1165fea34\" (UID: \"625e2829-ded4-4dce-a33f-6fb1165fea34\") "
Jul 17 11:05:18.788202 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:05:18.788172    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/625e2829-ded4-4dce-a33f-6fb1165fea34-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "625e2829-ded4-4dce-a33f-6fb1165fea34" (UID: "625e2829-ded4-4dce-a33f-6fb1165fea34"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:05:18.788202 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:05:18.788182    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/625e2829-ded4-4dce-a33f-6fb1165fea34-kube-api-access-794pp" (OuterVolumeSpecName: "kube-api-access-794pp") pod "625e2829-ded4-4dce-a33f-6fb1165fea34" (UID: "625e2829-ded4-4dce-a33f-6fb1165fea34"). InnerVolumeSpecName "kube-api-access-794pp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:05:18.886742 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:05:18.886715    2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/625e2829-ded4-4dce-a33f-6fb1165fea34-webhook-cert\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:05:18.886742 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:05:18.886737    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-794pp\" (UniqueName: \"kubernetes.io/projected/625e2829-ded4-4dce-a33f-6fb1165fea34-kube-api-access-794pp\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:05:19.373284 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:05:19.373257    2563 generic.go:356] "Generic (PLEG): container finished" podID="625e2829-ded4-4dce-a33f-6fb1165fea34" containerID="573cf88df9fd4e288a6b01db44508c35e5260a65f73205d98b27df380de5a6b5" exitCode=0
Jul 17 11:05:19.373400 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:05:19.373295    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76b5fcbfd-6hgcf"
Jul 17 11:05:19.373400 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:05:19.373343    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76b5fcbfd-6hgcf" event={"ID":"625e2829-ded4-4dce-a33f-6fb1165fea34","Type":"ContainerDied","Data":"573cf88df9fd4e288a6b01db44508c35e5260a65f73205d98b27df380de5a6b5"}
Jul 17 11:05:19.373400 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:05:19.373386    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76b5fcbfd-6hgcf" event={"ID":"625e2829-ded4-4dce-a33f-6fb1165fea34","Type":"ContainerDied","Data":"f6cdd3e45d88cd2b278878772dd255238839cff4ddc76da4121c8cf7751afaea"}
Jul 17 11:05:19.374155 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:05:19.373410    2563 scope.go:117] "RemoveContainer" containerID="573cf88df9fd4e288a6b01db44508c35e5260a65f73205d98b27df380de5a6b5"
Jul 17 11:05:19.382943 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:05:19.382913    2563 scope.go:117] "RemoveContainer" containerID="573cf88df9fd4e288a6b01db44508c35e5260a65f73205d98b27df380de5a6b5"
Jul 17 11:05:19.387747 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:05:19.387720    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"573cf88df9fd4e288a6b01db44508c35e5260a65f73205d98b27df380de5a6b5\": container with ID starting with 573cf88df9fd4e288a6b01db44508c35e5260a65f73205d98b27df380de5a6b5 not found: ID does not exist" containerID="573cf88df9fd4e288a6b01db44508c35e5260a65f73205d98b27df380de5a6b5"
Jul 17 11:05:19.387889 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:05:19.387870    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"573cf88df9fd4e288a6b01db44508c35e5260a65f73205d98b27df380de5a6b5"} err="failed to get container status \"573cf88df9fd4e288a6b01db44508c35e5260a65f73205d98b27df380de5a6b5\": rpc error: code = NotFound desc = could not find container \"573cf88df9fd4e288a6b01db44508c35e5260a65f73205d98b27df380de5a6b5\": container with ID starting with 573cf88df9fd4e288a6b01db44508c35e5260a65f73205d98b27df380de5a6b5 not found: ID does not exist"
Jul 17 11:05:19.398410 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:05:19.398387    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76b5fcbfd-6hgcf"]
Jul 17 11:05:19.411204 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:05:19.411182    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-76b5fcbfd-6hgcf"]
Jul 17 11:05:21.265064 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:05:21.265034    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="625e2829-ded4-4dce-a33f-6fb1165fea34" path="/var/lib/kubelet/pods/625e2829-ded4-4dce-a33f-6fb1165fea34/volumes"
Jul 17 11:06:20.277891 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:20.277857    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76b5fcbfd-jf2zf"]
Jul 17 11:06:20.278288 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:20.278273    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="625e2829-ded4-4dce-a33f-6fb1165fea34" containerName="manager"
Jul 17 11:06:20.278330 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:20.278290    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="625e2829-ded4-4dce-a33f-6fb1165fea34" containerName="manager"
Jul 17 11:06:20.278385 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:20.278374    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="625e2829-ded4-4dce-a33f-6fb1165fea34" containerName="manager"
Jul 17 11:06:20.282746 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:20.282724    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76b5fcbfd-jf2zf"
Jul 17 11:06:20.285962 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:20.285941    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-wfblj\""
Jul 17 11:06:20.286190 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:20.286177    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 17 11:06:20.287302 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:20.287285    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 17 11:06:20.294817 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:20.294789    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76b5fcbfd-jf2zf"]
Jul 17 11:06:20.431482 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:20.431422    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzstm\" (UniqueName: \"kubernetes.io/projected/fe844bb0-77d8-4d26-9b00-dff204d4ac01-kube-api-access-bzstm\") pod \"maas-controller-76b5fcbfd-jf2zf\" (UID: \"fe844bb0-77d8-4d26-9b00-dff204d4ac01\") " pod="opendatahub/maas-controller-76b5fcbfd-jf2zf"
Jul 17 11:06:20.431639 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:20.431491    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe844bb0-77d8-4d26-9b00-dff204d4ac01-webhook-cert\") pod \"maas-controller-76b5fcbfd-jf2zf\" (UID: \"fe844bb0-77d8-4d26-9b00-dff204d4ac01\") " pod="opendatahub/maas-controller-76b5fcbfd-jf2zf"
Jul 17 11:06:20.532696 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:20.532638    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzstm\" (UniqueName: \"kubernetes.io/projected/fe844bb0-77d8-4d26-9b00-dff204d4ac01-kube-api-access-bzstm\") pod \"maas-controller-76b5fcbfd-jf2zf\" (UID: \"fe844bb0-77d8-4d26-9b00-dff204d4ac01\") " pod="opendatahub/maas-controller-76b5fcbfd-jf2zf"
Jul 17 11:06:20.532696 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:20.532667    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe844bb0-77d8-4d26-9b00-dff204d4ac01-webhook-cert\") pod \"maas-controller-76b5fcbfd-jf2zf\" (UID: \"fe844bb0-77d8-4d26-9b00-dff204d4ac01\") " pod="opendatahub/maas-controller-76b5fcbfd-jf2zf"
Jul 17 11:06:20.534919 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:20.534897    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe844bb0-77d8-4d26-9b00-dff204d4ac01-webhook-cert\") pod \"maas-controller-76b5fcbfd-jf2zf\" (UID: \"fe844bb0-77d8-4d26-9b00-dff204d4ac01\") " pod="opendatahub/maas-controller-76b5fcbfd-jf2zf"
Jul 17 11:06:20.540825 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:20.540806    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzstm\" (UniqueName: \"kubernetes.io/projected/fe844bb0-77d8-4d26-9b00-dff204d4ac01-kube-api-access-bzstm\") pod \"maas-controller-76b5fcbfd-jf2zf\" (UID: \"fe844bb0-77d8-4d26-9b00-dff204d4ac01\") " pod="opendatahub/maas-controller-76b5fcbfd-jf2zf"
Jul 17 11:06:20.592223 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:20.592202    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76b5fcbfd-jf2zf"
Jul 17 11:06:20.719789 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:20.719767    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76b5fcbfd-jf2zf"]
Jul 17 11:06:20.722605 ip-10-0-143-12 kubenswrapper[2563]: W0717 11:06:20.722580    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe844bb0_77d8_4d26_9b00_dff204d4ac01.slice/crio-54fe2121e4e6f7ab2b77fb0f894f3a210a306ffe165010331895774e3da717a9 WatchSource:0}: Error finding container 54fe2121e4e6f7ab2b77fb0f894f3a210a306ffe165010331895774e3da717a9: Status 404 returned error can't find the container with id 54fe2121e4e6f7ab2b77fb0f894f3a210a306ffe165010331895774e3da717a9
Jul 17 11:06:21.646330 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:21.646296    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76b5fcbfd-jf2zf" event={"ID":"fe844bb0-77d8-4d26-9b00-dff204d4ac01","Type":"ContainerStarted","Data":"54fe2121e4e6f7ab2b77fb0f894f3a210a306ffe165010331895774e3da717a9"}
Jul 17 11:06:22.657608 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:22.657574    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76b5fcbfd-jf2zf" event={"ID":"fe844bb0-77d8-4d26-9b00-dff204d4ac01","Type":"ContainerStarted","Data":"6fda0d5ba845c1e1eebde90812136bd064aec2f27a6b8f4665a3bb7c5b2f53b7"}
Jul 17 11:06:22.657957 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:22.657696    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76b5fcbfd-jf2zf"
Jul 17 11:06:22.677502 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:22.677461    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-76b5fcbfd-jf2zf" podStartSLOduration=1.655189986 podStartE2EDuration="2.677449651s" totalImagesPullingTime="1.022259665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:06:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:06:22.67510627 +0000 UTC m=+847.856139245" watchObservedRunningTime="2026-07-17 11:06:22.677449651 +0000 UTC m=+847.858482611"
Jul 17 11:06:33.663535 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:33.663507    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76b5fcbfd-jf2zf"
Jul 17 11:06:38.316857 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:38.316824    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76b5fcbfd-jf2zf"]
Jul 17 11:06:38.317409 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:38.317013    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-76b5fcbfd-jf2zf" podUID="fe844bb0-77d8-4d26-9b00-dff204d4ac01" containerName="manager" containerID="cri-o://6fda0d5ba845c1e1eebde90812136bd064aec2f27a6b8f4665a3bb7c5b2f53b7" gracePeriod=30
Jul 17 11:06:38.555967 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:38.555946    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76b5fcbfd-jf2zf"
Jul 17 11:06:38.661326 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:38.661300    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe844bb0-77d8-4d26-9b00-dff204d4ac01-webhook-cert\") pod \"fe844bb0-77d8-4d26-9b00-dff204d4ac01\" (UID: \"fe844bb0-77d8-4d26-9b00-dff204d4ac01\") "
Jul 17 11:06:38.661465 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:38.661418    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzstm\" (UniqueName: \"kubernetes.io/projected/fe844bb0-77d8-4d26-9b00-dff204d4ac01-kube-api-access-bzstm\") pod \"fe844bb0-77d8-4d26-9b00-dff204d4ac01\" (UID: \"fe844bb0-77d8-4d26-9b00-dff204d4ac01\") "
Jul 17 11:06:38.663175 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:38.663143    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe844bb0-77d8-4d26-9b00-dff204d4ac01-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "fe844bb0-77d8-4d26-9b00-dff204d4ac01" (UID: "fe844bb0-77d8-4d26-9b00-dff204d4ac01"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:06:38.663299 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:38.663214    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe844bb0-77d8-4d26-9b00-dff204d4ac01-kube-api-access-bzstm" (OuterVolumeSpecName: "kube-api-access-bzstm") pod "fe844bb0-77d8-4d26-9b00-dff204d4ac01" (UID: "fe844bb0-77d8-4d26-9b00-dff204d4ac01"). InnerVolumeSpecName "kube-api-access-bzstm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:06:38.727687 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:38.727648    2563 generic.go:356] "Generic (PLEG): container finished" podID="fe844bb0-77d8-4d26-9b00-dff204d4ac01" containerID="6fda0d5ba845c1e1eebde90812136bd064aec2f27a6b8f4665a3bb7c5b2f53b7" exitCode=0
Jul 17 11:06:38.727805 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:38.727692    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76b5fcbfd-jf2zf"
Jul 17 11:06:38.727805 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:38.727724    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76b5fcbfd-jf2zf" event={"ID":"fe844bb0-77d8-4d26-9b00-dff204d4ac01","Type":"ContainerDied","Data":"6fda0d5ba845c1e1eebde90812136bd064aec2f27a6b8f4665a3bb7c5b2f53b7"}
Jul 17 11:06:38.727805 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:38.727777    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76b5fcbfd-jf2zf" event={"ID":"fe844bb0-77d8-4d26-9b00-dff204d4ac01","Type":"ContainerDied","Data":"54fe2121e4e6f7ab2b77fb0f894f3a210a306ffe165010331895774e3da717a9"}
Jul 17 11:06:38.727805 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:38.727799    2563 scope.go:117] "RemoveContainer" containerID="6fda0d5ba845c1e1eebde90812136bd064aec2f27a6b8f4665a3bb7c5b2f53b7"
Jul 17 11:06:38.736149 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:38.736131    2563 scope.go:117] "RemoveContainer" containerID="6fda0d5ba845c1e1eebde90812136bd064aec2f27a6b8f4665a3bb7c5b2f53b7"
Jul 17 11:06:38.736369 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:06:38.736352    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fda0d5ba845c1e1eebde90812136bd064aec2f27a6b8f4665a3bb7c5b2f53b7\": container with ID starting with 6fda0d5ba845c1e1eebde90812136bd064aec2f27a6b8f4665a3bb7c5b2f53b7 not found: ID does not exist" containerID="6fda0d5ba845c1e1eebde90812136bd064aec2f27a6b8f4665a3bb7c5b2f53b7"
Jul 17 11:06:38.736416 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:38.736378    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fda0d5ba845c1e1eebde90812136bd064aec2f27a6b8f4665a3bb7c5b2f53b7"} err="failed to get container status \"6fda0d5ba845c1e1eebde90812136bd064aec2f27a6b8f4665a3bb7c5b2f53b7\": rpc error: code = NotFound desc = could not find container \"6fda0d5ba845c1e1eebde90812136bd064aec2f27a6b8f4665a3bb7c5b2f53b7\": container with ID starting with 6fda0d5ba845c1e1eebde90812136bd064aec2f27a6b8f4665a3bb7c5b2f53b7 not found: ID does not exist"
Jul 17 11:06:38.748882 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:38.748860    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76b5fcbfd-jf2zf"]
Jul 17 11:06:38.752066 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:38.752047    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-76b5fcbfd-jf2zf"]
Jul 17 11:06:38.762010 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:38.761991    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzstm\" (UniqueName: \"kubernetes.io/projected/fe844bb0-77d8-4d26-9b00-dff204d4ac01-kube-api-access-bzstm\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:06:38.762010 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:38.762011    2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe844bb0-77d8-4d26-9b00-dff204d4ac01-webhook-cert\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:06:39.264544 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:39.264520    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe844bb0-77d8-4d26-9b00-dff204d4ac01" path="/var/lib/kubelet/pods/fe844bb0-77d8-4d26-9b00-dff204d4ac01/volumes"
Jul 17 11:06:39.554474 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:39.554409    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76b5fcbfd-bt5lk"]
Jul 17 11:06:39.554779 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:39.554760    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe844bb0-77d8-4d26-9b00-dff204d4ac01" containerName="manager"
Jul 17 11:06:39.554779 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:39.554772    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe844bb0-77d8-4d26-9b00-dff204d4ac01" containerName="manager"
Jul 17 11:06:39.554858 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:39.554824    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe844bb0-77d8-4d26-9b00-dff204d4ac01" containerName="manager"
Jul 17 11:06:39.559014 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:39.558996    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76b5fcbfd-bt5lk"
Jul 17 11:06:39.562302 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:39.562284    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 17 11:06:39.562422 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:39.562284    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-wfblj\""
Jul 17 11:06:39.562422 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:39.562290    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 17 11:06:39.569312 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:39.569287    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76b5fcbfd-bt5lk"]
Jul 17 11:06:39.668720 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:39.668698    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a2d69d0a-6d06-44c3-995b-b75a48582b92-webhook-cert\") pod \"maas-controller-76b5fcbfd-bt5lk\" (UID: \"a2d69d0a-6d06-44c3-995b-b75a48582b92\") " pod="opendatahub/maas-controller-76b5fcbfd-bt5lk"
Jul 17 11:06:39.668835 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:39.668741    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdljw\" (UniqueName: \"kubernetes.io/projected/a2d69d0a-6d06-44c3-995b-b75a48582b92-kube-api-access-pdljw\") pod \"maas-controller-76b5fcbfd-bt5lk\" (UID: \"a2d69d0a-6d06-44c3-995b-b75a48582b92\") " pod="opendatahub/maas-controller-76b5fcbfd-bt5lk"
Jul 17 11:06:39.769403 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:39.769380    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a2d69d0a-6d06-44c3-995b-b75a48582b92-webhook-cert\") pod \"maas-controller-76b5fcbfd-bt5lk\" (UID: \"a2d69d0a-6d06-44c3-995b-b75a48582b92\") " pod="opendatahub/maas-controller-76b5fcbfd-bt5lk"
Jul 17 11:06:39.769510 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:39.769415    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdljw\" (UniqueName: \"kubernetes.io/projected/a2d69d0a-6d06-44c3-995b-b75a48582b92-kube-api-access-pdljw\") pod \"maas-controller-76b5fcbfd-bt5lk\" (UID: \"a2d69d0a-6d06-44c3-995b-b75a48582b92\") " pod="opendatahub/maas-controller-76b5fcbfd-bt5lk"
Jul 17 11:06:39.771759 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:39.771739    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a2d69d0a-6d06-44c3-995b-b75a48582b92-webhook-cert\") pod \"maas-controller-76b5fcbfd-bt5lk\" (UID: \"a2d69d0a-6d06-44c3-995b-b75a48582b92\") " pod="opendatahub/maas-controller-76b5fcbfd-bt5lk"
Jul 17 11:06:39.777791 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:39.777766    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdljw\" (UniqueName: \"kubernetes.io/projected/a2d69d0a-6d06-44c3-995b-b75a48582b92-kube-api-access-pdljw\") pod \"maas-controller-76b5fcbfd-bt5lk\" (UID: \"a2d69d0a-6d06-44c3-995b-b75a48582b92\") " pod="opendatahub/maas-controller-76b5fcbfd-bt5lk"
Jul 17 11:06:39.869100 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:39.869050    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76b5fcbfd-bt5lk"
Jul 17 11:06:39.994708 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:39.994547    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76b5fcbfd-bt5lk"]
Jul 17 11:06:39.998131 ip-10-0-143-12 kubenswrapper[2563]: W0717 11:06:39.998101    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2d69d0a_6d06_44c3_995b_b75a48582b92.slice/crio-0efbf7b534e8765cf453611df8dd6de089ff4a3a72c6bf9f978c867eb752aa49 WatchSource:0}: Error finding container 0efbf7b534e8765cf453611df8dd6de089ff4a3a72c6bf9f978c867eb752aa49: Status 404 returned error can't find the container with id 0efbf7b534e8765cf453611df8dd6de089ff4a3a72c6bf9f978c867eb752aa49
Jul 17 11:06:40.737314 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:40.737282    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76b5fcbfd-bt5lk" event={"ID":"a2d69d0a-6d06-44c3-995b-b75a48582b92","Type":"ContainerStarted","Data":"0efbf7b534e8765cf453611df8dd6de089ff4a3a72c6bf9f978c867eb752aa49"}
Jul 17 11:06:41.743505 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:41.743459    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76b5fcbfd-bt5lk" event={"ID":"a2d69d0a-6d06-44c3-995b-b75a48582b92","Type":"ContainerStarted","Data":"5aa71c770d28081e3de0e2c9a837078b9cc3b1e05fd152ecb9345903e60fda9d"}
Jul 17 11:06:41.743904 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:41.743528    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76b5fcbfd-bt5lk"
Jul 17 11:06:41.763788 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:41.763742    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-76b5fcbfd-bt5lk" podStartSLOduration=1.59822637 podStartE2EDuration="2.763727655s" totalImagesPullingTime="1.165501285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:06:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:06:41.761890037 +0000 UTC m=+866.942923001" watchObservedRunningTime="2026-07-17 11:06:41.763727655 +0000 UTC m=+866.944760615"
Jul 17 11:06:52.749445 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:06:52.749399    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76b5fcbfd-bt5lk"
Jul 17 11:07:15.235550 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:07:15.235485    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xdrhl_48cc1998-ebc5-4702-8b08-027479580e57/ovn-acl-logging/0.log"
Jul 17 11:07:15.236062 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:07:15.235618    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xdrhl_48cc1998-ebc5-4702-8b08-027479580e57/ovn-acl-logging/0.log"
Jul 17 11:11:20.302460 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:11:20.302414    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nbgw9"]
Jul 17 11:11:20.303008 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:11:20.302592    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nbgw9" podUID="14f2bba7-0f06-45c4-a3d4-ded60e74ea70" containerName="manager" containerID="cri-o://4d3cbf5516925d6bb1b8db6a695cd08ac2f582ce5e72f4b873061c9b842d5e0f" gracePeriod=10
Jul 17 11:11:22.252474 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:11:22.252447    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nbgw9"
Jul 17 11:11:22.431127 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:11:22.431098    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhzc8\" (UniqueName: \"kubernetes.io/projected/14f2bba7-0f06-45c4-a3d4-ded60e74ea70-kube-api-access-rhzc8\") pod \"14f2bba7-0f06-45c4-a3d4-ded60e74ea70\" (UID: \"14f2bba7-0f06-45c4-a3d4-ded60e74ea70\") "
Jul 17 11:11:22.431252 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:11:22.431207    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/14f2bba7-0f06-45c4-a3d4-ded60e74ea70-extensions-socket-volume\") pod \"14f2bba7-0f06-45c4-a3d4-ded60e74ea70\" (UID: \"14f2bba7-0f06-45c4-a3d4-ded60e74ea70\") "
Jul 17 11:11:22.431559 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:11:22.431532    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14f2bba7-0f06-45c4-a3d4-ded60e74ea70-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "14f2bba7-0f06-45c4-a3d4-ded60e74ea70" (UID: "14f2bba7-0f06-45c4-a3d4-ded60e74ea70"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:11:22.433142 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:11:22.433118    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14f2bba7-0f06-45c4-a3d4-ded60e74ea70-kube-api-access-rhzc8" (OuterVolumeSpecName: "kube-api-access-rhzc8") pod "14f2bba7-0f06-45c4-a3d4-ded60e74ea70" (UID: "14f2bba7-0f06-45c4-a3d4-ded60e74ea70"). InnerVolumeSpecName "kube-api-access-rhzc8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:11:22.532044 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:11:22.532013    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/14f2bba7-0f06-45c4-a3d4-ded60e74ea70-extensions-socket-volume\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:11:22.532044 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:11:22.532042    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhzc8\" (UniqueName: \"kubernetes.io/projected/14f2bba7-0f06-45c4-a3d4-ded60e74ea70-kube-api-access-rhzc8\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:11:22.969680 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:11:22.969654    2563 generic.go:356] "Generic (PLEG): container finished" podID="14f2bba7-0f06-45c4-a3d4-ded60e74ea70" containerID="4d3cbf5516925d6bb1b8db6a695cd08ac2f582ce5e72f4b873061c9b842d5e0f" exitCode=0
Jul 17 11:11:22.969772 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:11:22.969697    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nbgw9" event={"ID":"14f2bba7-0f06-45c4-a3d4-ded60e74ea70","Type":"ContainerDied","Data":"4d3cbf5516925d6bb1b8db6a695cd08ac2f582ce5e72f4b873061c9b842d5e0f"}
Jul 17 11:11:22.969772 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:11:22.969702    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nbgw9"
Jul 17 11:11:22.969772 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:11:22.969735    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nbgw9" event={"ID":"14f2bba7-0f06-45c4-a3d4-ded60e74ea70","Type":"ContainerDied","Data":"29203d3cc73db52d3d2a8840f0ee3492c003a07386c7b8d00f763181838f4b80"}
Jul 17 11:11:22.969772 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:11:22.969754    2563 scope.go:117] "RemoveContainer" containerID="4d3cbf5516925d6bb1b8db6a695cd08ac2f582ce5e72f4b873061c9b842d5e0f"
Jul 17 11:11:22.979175 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:11:22.979159    2563 scope.go:117] "RemoveContainer" containerID="4d3cbf5516925d6bb1b8db6a695cd08ac2f582ce5e72f4b873061c9b842d5e0f"
Jul 17 11:11:22.979404 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:11:22.979386    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d3cbf5516925d6bb1b8db6a695cd08ac2f582ce5e72f4b873061c9b842d5e0f\": container with ID starting with 4d3cbf5516925d6bb1b8db6a695cd08ac2f582ce5e72f4b873061c9b842d5e0f not found: ID does not exist" containerID="4d3cbf5516925d6bb1b8db6a695cd08ac2f582ce5e72f4b873061c9b842d5e0f"
Jul 17 11:11:22.979497 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:11:22.979414    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d3cbf5516925d6bb1b8db6a695cd08ac2f582ce5e72f4b873061c9b842d5e0f"} err="failed to get container status \"4d3cbf5516925d6bb1b8db6a695cd08ac2f582ce5e72f4b873061c9b842d5e0f\": rpc error: code = NotFound desc = could not find container \"4d3cbf5516925d6bb1b8db6a695cd08ac2f582ce5e72f4b873061c9b842d5e0f\": container with ID starting with 4d3cbf5516925d6bb1b8db6a695cd08ac2f582ce5e72f4b873061c9b842d5e0f not found: ID does not exist"
Jul 17 11:11:22.990780 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:11:22.990760    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nbgw9"]
Jul 17 11:11:22.995667 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:11:22.995649    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nbgw9"]
Jul 17 11:11:23.263564 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:11:23.263508    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14f2bba7-0f06-45c4-a3d4-ded60e74ea70" path="/var/lib/kubelet/pods/14f2bba7-0f06-45c4-a3d4-ded60e74ea70/volumes"
Jul 17 11:12:15.261932 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:12:15.261855    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xdrhl_48cc1998-ebc5-4702-8b08-027479580e57/ovn-acl-logging/0.log"
Jul 17 11:12:15.261932 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:12:15.261922    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xdrhl_48cc1998-ebc5-4702-8b08-027479580e57/ovn-acl-logging/0.log"
Jul 17 11:12:21.486678 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:12:21.486650    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rh72m"]
Jul 17 11:12:21.487021 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:12:21.486962    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14f2bba7-0f06-45c4-a3d4-ded60e74ea70" containerName="manager"
Jul 17 11:12:21.487021 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:12:21.486972    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="14f2bba7-0f06-45c4-a3d4-ded60e74ea70" containerName="manager"
Jul 17 11:12:21.487093 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:12:21.487040    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="14f2bba7-0f06-45c4-a3d4-ded60e74ea70" containerName="manager"
Jul 17 11:12:21.491396 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:12:21.491375    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rh72m"
Jul 17 11:12:21.495808 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:12:21.495789    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-gj76v\""
Jul 17 11:12:21.504460 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:12:21.504422    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rh72m"]
Jul 17 11:12:21.535046 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:12:21.535023    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg5sv\" (UniqueName: \"kubernetes.io/projected/65890766-1d01-4ae8-adb1-3ddc746531c2-kube-api-access-lg5sv\") pod \"kuadrant-operator-controller-manager-86878c769f-rh72m\" (UID: \"65890766-1d01-4ae8-adb1-3ddc746531c2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rh72m"
Jul 17 11:12:21.535146 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:12:21.535054    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/65890766-1d01-4ae8-adb1-3ddc746531c2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rh72m\" (UID: \"65890766-1d01-4ae8-adb1-3ddc746531c2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rh72m"
Jul 17 11:12:21.636411 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:12:21.636386    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg5sv\" (UniqueName: \"kubernetes.io/projected/65890766-1d01-4ae8-adb1-3ddc746531c2-kube-api-access-lg5sv\") pod \"kuadrant-operator-controller-manager-86878c769f-rh72m\" (UID: \"65890766-1d01-4ae8-adb1-3ddc746531c2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rh72m"
Jul 17 11:12:21.636544 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:12:21.636419    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/65890766-1d01-4ae8-adb1-3ddc746531c2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rh72m\" (UID: \"65890766-1d01-4ae8-adb1-3ddc746531c2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rh72m"
Jul 17 11:12:21.636774 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:12:21.636759    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/65890766-1d01-4ae8-adb1-3ddc746531c2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rh72m\" (UID: \"65890766-1d01-4ae8-adb1-3ddc746531c2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rh72m"
Jul 17 11:12:21.649148 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:12:21.649124    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg5sv\" (UniqueName: \"kubernetes.io/projected/65890766-1d01-4ae8-adb1-3ddc746531c2-kube-api-access-lg5sv\") pod \"kuadrant-operator-controller-manager-86878c769f-rh72m\" (UID: \"65890766-1d01-4ae8-adb1-3ddc746531c2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rh72m"
Jul 17 11:12:21.800530 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:12:21.800466    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rh72m"
Jul 17 11:12:21.939957 ip-10-0-143-12 kubenswrapper[2563]: W0717 11:12:21.939923    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65890766_1d01_4ae8_adb1_3ddc746531c2.slice/crio-5377866e1d9719bed6e37ec52e7dee3831d12665215f372e8389b9456713eabe WatchSource:0}: Error finding container 5377866e1d9719bed6e37ec52e7dee3831d12665215f372e8389b9456713eabe: Status 404 returned error can't find the container with id 5377866e1d9719bed6e37ec52e7dee3831d12665215f372e8389b9456713eabe
Jul 17 11:12:21.941202 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:12:21.941167    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rh72m"]
Jul 17 11:12:22.223729 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:12:22.223696    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rh72m" event={"ID":"65890766-1d01-4ae8-adb1-3ddc746531c2","Type":"ContainerStarted","Data":"57c4328ce9e31452af431d16a2a366b649e007bcb4a9df87aa7e6822228f461b"}
Jul 17 11:12:22.223877 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:12:22.223758    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rh72m" event={"ID":"65890766-1d01-4ae8-adb1-3ddc746531c2","Type":"ContainerStarted","Data":"5377866e1d9719bed6e37ec52e7dee3831d12665215f372e8389b9456713eabe"}
Jul 17 11:12:22.223877 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:12:22.223783    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rh72m"
Jul 17 11:12:22.245510 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:12:22.245454    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rh72m" podStartSLOduration=1.245418971 podStartE2EDuration="1.245418971s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:12:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:12:22.241800397 +0000 UTC m=+1207.422833357" watchObservedRunningTime="2026-07-17 11:12:22.245418971 +0000 UTC m=+1207.426451932"
Jul 17 11:12:33.230726 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:12:33.230696    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rh72m"
Jul 17 11:17:15.297633 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:17:15.297604    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xdrhl_48cc1998-ebc5-4702-8b08-027479580e57/ovn-acl-logging/0.log"
Jul 17 11:17:15.299306 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:17:15.299282    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xdrhl_48cc1998-ebc5-4702-8b08-027479580e57/ovn-acl-logging/0.log"
Jul 17 11:18:17.937042 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:18:17.937003    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth"]
Jul 17 11:18:17.940443 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:18:17.940412    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth"
Jul 17 11:18:17.943667 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:18:17.943635    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-0839e276-serving-cert\""
Jul 17 11:18:17.958120 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:18:17.958099    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4af8948d-3ab8-483a-85df-1399e3a79fb0-maas-api-tls\") pod \"maas-api-e2e-ait-0839e276-585c8cbf46-twtth\" (UID: \"4af8948d-3ab8-483a-85df-1399e3a79fb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth"
Jul 17 11:18:17.958229 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:18:17.958129    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4af8948d-3ab8-483a-85df-1399e3a79fb0-openshift-service-ca\") pod \"maas-api-e2e-ait-0839e276-585c8cbf46-twtth\" (UID: \"4af8948d-3ab8-483a-85df-1399e3a79fb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth"
Jul 17 11:18:17.958229 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:18:17.958185    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2brr8\" (UniqueName: \"kubernetes.io/projected/4af8948d-3ab8-483a-85df-1399e3a79fb0-kube-api-access-2brr8\") pod \"maas-api-e2e-ait-0839e276-585c8cbf46-twtth\" (UID: \"4af8948d-3ab8-483a-85df-1399e3a79fb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth"
Jul 17 11:18:17.959061 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:18:17.959040    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth"]
Jul 17 11:18:18.058853 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:18:18.058829    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4af8948d-3ab8-483a-85df-1399e3a79fb0-maas-api-tls\") pod \"maas-api-e2e-ait-0839e276-585c8cbf46-twtth\" (UID: \"4af8948d-3ab8-483a-85df-1399e3a79fb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth"
Jul 17 11:18:18.058951 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:18:18.058860    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4af8948d-3ab8-483a-85df-1399e3a79fb0-openshift-service-ca\") pod \"maas-api-e2e-ait-0839e276-585c8cbf46-twtth\" (UID: \"4af8948d-3ab8-483a-85df-1399e3a79fb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth"
Jul 17 11:18:18.058951 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:18:18.058890    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2brr8\" (UniqueName: \"kubernetes.io/projected/4af8948d-3ab8-483a-85df-1399e3a79fb0-kube-api-access-2brr8\") pod \"maas-api-e2e-ait-0839e276-585c8cbf46-twtth\" (UID: \"4af8948d-3ab8-483a-85df-1399e3a79fb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth"
Jul 17 11:18:18.059023 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:18:18.058972    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-serving-cert: secret "maas-api-e2e-ait-0839e276-serving-cert" not found
Jul 17 11:18:18.059065 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:18:18.059032    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4af8948d-3ab8-483a-85df-1399e3a79fb0-maas-api-tls podName:4af8948d-3ab8-483a-85df-1399e3a79fb0 nodeName:}" failed. No retries permitted until 2026-07-17 11:18:18.559016756 +0000 UTC m=+1563.740049696 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4af8948d-3ab8-483a-85df-1399e3a79fb0-maas-api-tls") pod "maas-api-e2e-ait-0839e276-585c8cbf46-twtth" (UID: "4af8948d-3ab8-483a-85df-1399e3a79fb0") : secret "maas-api-e2e-ait-0839e276-serving-cert" not found
Jul 17 11:18:18.059580 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:18:18.059558    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4af8948d-3ab8-483a-85df-1399e3a79fb0-openshift-service-ca\") pod \"maas-api-e2e-ait-0839e276-585c8cbf46-twtth\" (UID: \"4af8948d-3ab8-483a-85df-1399e3a79fb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth"
Jul 17 11:18:18.080941 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:18:18.080915    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2brr8\" (UniqueName: \"kubernetes.io/projected/4af8948d-3ab8-483a-85df-1399e3a79fb0-kube-api-access-2brr8\") pod \"maas-api-e2e-ait-0839e276-585c8cbf46-twtth\" (UID: \"4af8948d-3ab8-483a-85df-1399e3a79fb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth"
Jul 17 11:18:18.561948 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:18:18.561919    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4af8948d-3ab8-483a-85df-1399e3a79fb0-maas-api-tls\") pod \"maas-api-e2e-ait-0839e276-585c8cbf46-twtth\" (UID: \"4af8948d-3ab8-483a-85df-1399e3a79fb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth"
Jul 17 11:18:18.564144 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:18:18.564119    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4af8948d-3ab8-483a-85df-1399e3a79fb0-maas-api-tls\") pod \"maas-api-e2e-ait-0839e276-585c8cbf46-twtth\" (UID: \"4af8948d-3ab8-483a-85df-1399e3a79fb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth"
Jul 17 11:18:18.852792 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:18:18.852725    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth"
Jul 17 11:18:19.002029 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:18:19.001999    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth"]
Jul 17 11:18:19.004444 ip-10-0-143-12 kubenswrapper[2563]: W0717 11:18:19.004409    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4af8948d_3ab8_483a_85df_1399e3a79fb0.slice/crio-cedaacdcc948bcf505cafc5dde6a90657db63bf00bd8ce7739194b2d0763f4fc WatchSource:0}: Error finding container cedaacdcc948bcf505cafc5dde6a90657db63bf00bd8ce7739194b2d0763f4fc: Status 404 returned error can't find the container with id cedaacdcc948bcf505cafc5dde6a90657db63bf00bd8ce7739194b2d0763f4fc
Jul 17 11:18:19.005829 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:18:19.005812    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 11:18:19.808180 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:18:19.808152    2563 generic.go:356] "Generic (PLEG): container finished" podID="4af8948d-3ab8-483a-85df-1399e3a79fb0" containerID="cc67562ed25217c14c95f0c114166a8ebd580cef74c54c8626863770a57b0179" exitCode=1
Jul 17 11:18:19.808287 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:18:19.808243    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth" event={"ID":"4af8948d-3ab8-483a-85df-1399e3a79fb0","Type":"ContainerDied","Data":"cc67562ed25217c14c95f0c114166a8ebd580cef74c54c8626863770a57b0179"}
Jul 17 11:18:19.808327 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:18:19.808304    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth" event={"ID":"4af8948d-3ab8-483a-85df-1399e3a79fb0","Type":"ContainerStarted","Data":"cedaacdcc948bcf505cafc5dde6a90657db63bf00bd8ce7739194b2d0763f4fc"}
Jul 17 11:18:19.808485 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:18:19.808472    2563 scope.go:117] "RemoveContainer" containerID="cc67562ed25217c14c95f0c114166a8ebd580cef74c54c8626863770a57b0179"
Jul 17 11:18:20.814153 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:18:20.814108    2563 generic.go:356] "Generic (PLEG): container finished" podID="4af8948d-3ab8-483a-85df-1399e3a79fb0" containerID="152befd80aaa6b4ef26c583dbff34b327ba2a7e14dfa6fd823d20f49aefca4fb" exitCode=1
Jul 17 11:18:20.814511 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:18:20.814184    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth" event={"ID":"4af8948d-3ab8-483a-85df-1399e3a79fb0","Type":"ContainerDied","Data":"152befd80aaa6b4ef26c583dbff34b327ba2a7e14dfa6fd823d20f49aefca4fb"}
Jul 17 11:18:20.814511 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:18:20.814267    2563 scope.go:117] "RemoveContainer" containerID="cc67562ed25217c14c95f0c114166a8ebd580cef74c54c8626863770a57b0179"
Jul 17 11:18:20.814651 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:18:20.814536    2563 scope.go:117] "RemoveContainer" containerID="152befd80aaa6b4ef26c583dbff34b327ba2a7e14dfa6fd823d20f49aefca4fb"
Jul 17 11:18:20.814755 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:18:20.814736    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-0839e276-585c8cbf46-twtth_odh-ai-gateway-infra(4af8948d-3ab8-483a-85df-1399e3a79fb0)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth" podUID="4af8948d-3ab8-483a-85df-1399e3a79fb0"
Jul 17 11:18:21.820994 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:18:21.820965    2563 scope.go:117] "RemoveContainer" containerID="152befd80aaa6b4ef26c583dbff34b327ba2a7e14dfa6fd823d20f49aefca4fb"
Jul 17 11:18:21.821347 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:18:21.821110    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-0839e276-585c8cbf46-twtth_odh-ai-gateway-infra(4af8948d-3ab8-483a-85df-1399e3a79fb0)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth" podUID="4af8948d-3ab8-483a-85df-1399e3a79fb0"
Jul 17 11:18:23.852850 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:18:23.852819    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth"
Jul 17 11:18:23.853205 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:18:23.853159    2563 scope.go:117] "RemoveContainer" containerID="152befd80aaa6b4ef26c583dbff34b327ba2a7e14dfa6fd823d20f49aefca4fb"
Jul 17 11:18:23.853349 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:18:23.853330    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-0839e276-585c8cbf46-twtth_odh-ai-gateway-infra(4af8948d-3ab8-483a-85df-1399e3a79fb0)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth" podUID="4af8948d-3ab8-483a-85df-1399e3a79fb0"
Jul 17 11:18:28.852892 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:18:28.852859    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth"
Jul 17 11:18:28.853337 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:18:28.853283    2563 scope.go:117] "RemoveContainer" containerID="152befd80aaa6b4ef26c583dbff34b327ba2a7e14dfa6fd823d20f49aefca4fb"
Jul 17 11:18:28.853542 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:18:28.853515    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-0839e276-585c8cbf46-twtth_odh-ai-gateway-infra(4af8948d-3ab8-483a-85df-1399e3a79fb0)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth" podUID="4af8948d-3ab8-483a-85df-1399e3a79fb0"
Jul 17 11:18:40.259221 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:18:40.259186    2563 scope.go:117] "RemoveContainer" containerID="152befd80aaa6b4ef26c583dbff34b327ba2a7e14dfa6fd823d20f49aefca4fb"
Jul 17 11:18:40.915092 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:18:40.915067    2563 generic.go:356] "Generic (PLEG): container finished" podID="4af8948d-3ab8-483a-85df-1399e3a79fb0" containerID="fa7946bb292b0d5ebac4bdaaa357779cfcd1600dafb61e0ca2bf311e85293b2c" exitCode=1
Jul 17 11:18:40.915210 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:18:40.915141    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth" event={"ID":"4af8948d-3ab8-483a-85df-1399e3a79fb0","Type":"ContainerDied","Data":"fa7946bb292b0d5ebac4bdaaa357779cfcd1600dafb61e0ca2bf311e85293b2c"}
Jul 17 11:18:40.915280 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:18:40.915212    2563 scope.go:117] "RemoveContainer" containerID="152befd80aaa6b4ef26c583dbff34b327ba2a7e14dfa6fd823d20f49aefca4fb"
Jul 17 11:18:40.915575 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:18:40.915557    2563 scope.go:117] "RemoveContainer" containerID="fa7946bb292b0d5ebac4bdaaa357779cfcd1600dafb61e0ca2bf311e85293b2c"
Jul 17 11:18:40.915770 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:18:40.915746    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-0839e276-585c8cbf46-twtth_odh-ai-gateway-infra(4af8948d-3ab8-483a-85df-1399e3a79fb0)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth" podUID="4af8948d-3ab8-483a-85df-1399e3a79fb0"
Jul 17 11:18:43.853019 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:18:43.852988    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth"
Jul 17 11:18:43.853480 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:18:43.853342    2563 scope.go:117] "RemoveContainer" containerID="fa7946bb292b0d5ebac4bdaaa357779cfcd1600dafb61e0ca2bf311e85293b2c"
Jul 17 11:18:43.853590 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:18:43.853563    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-0839e276-585c8cbf46-twtth_odh-ai-gateway-infra(4af8948d-3ab8-483a-85df-1399e3a79fb0)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth" podUID="4af8948d-3ab8-483a-85df-1399e3a79fb0"
Jul 17 11:18:48.853420 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:18:48.853390    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth"
Jul 17 11:18:48.853867 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:18:48.853733    2563 scope.go:117] "RemoveContainer" containerID="fa7946bb292b0d5ebac4bdaaa357779cfcd1600dafb61e0ca2bf311e85293b2c"
Jul 17 11:18:48.853917 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:18:48.853879    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-0839e276-585c8cbf46-twtth_odh-ai-gateway-infra(4af8948d-3ab8-483a-85df-1399e3a79fb0)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth" podUID="4af8948d-3ab8-483a-85df-1399e3a79fb0"
Jul 17 11:19:02.259779 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:19:02.259752    2563 scope.go:117] "RemoveContainer" containerID="fa7946bb292b0d5ebac4bdaaa357779cfcd1600dafb61e0ca2bf311e85293b2c"
Jul 17 11:19:04.015875 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:19:04.015846    2563 generic.go:356] "Generic (PLEG): container finished" podID="4af8948d-3ab8-483a-85df-1399e3a79fb0" containerID="95b12cdac294de2bbb0e44f7d87995a85b47e2112a79045943b60a69e717afa2" exitCode=1
Jul 17 11:19:04.016216 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:19:04.015912    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth" event={"ID":"4af8948d-3ab8-483a-85df-1399e3a79fb0","Type":"ContainerDied","Data":"95b12cdac294de2bbb0e44f7d87995a85b47e2112a79045943b60a69e717afa2"}
Jul 17 11:19:04.016216 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:19:04.015965    2563 scope.go:117] "RemoveContainer" containerID="fa7946bb292b0d5ebac4bdaaa357779cfcd1600dafb61e0ca2bf311e85293b2c"
Jul 17 11:19:04.016313 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:19:04.016249    2563 scope.go:117] "RemoveContainer" containerID="95b12cdac294de2bbb0e44f7d87995a85b47e2112a79045943b60a69e717afa2"
Jul 17 11:19:04.016451 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:19:04.016419    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-0839e276-585c8cbf46-twtth_odh-ai-gateway-infra(4af8948d-3ab8-483a-85df-1399e3a79fb0)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth" podUID="4af8948d-3ab8-483a-85df-1399e3a79fb0"
Jul 17 11:19:08.853406 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:19:08.853331    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth"
Jul 17 11:19:08.853406 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:19:08.853381    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth"
Jul 17 11:19:08.853877 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:19:08.853643    2563 scope.go:117] "RemoveContainer" containerID="95b12cdac294de2bbb0e44f7d87995a85b47e2112a79045943b60a69e717afa2"
Jul 17 11:19:08.853877 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:19:08.853783    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-0839e276-585c8cbf46-twtth_odh-ai-gateway-infra(4af8948d-3ab8-483a-85df-1399e3a79fb0)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth" podUID="4af8948d-3ab8-483a-85df-1399e3a79fb0"
Jul 17 11:19:20.259531 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:19:20.259502    2563 scope.go:117] "RemoveContainer" containerID="95b12cdac294de2bbb0e44f7d87995a85b47e2112a79045943b60a69e717afa2"
Jul 17 11:19:20.259884 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:19:20.259663    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-0839e276-585c8cbf46-twtth_odh-ai-gateway-infra(4af8948d-3ab8-483a-85df-1399e3a79fb0)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth" podUID="4af8948d-3ab8-483a-85df-1399e3a79fb0"
Jul 17 11:19:35.261969 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:19:35.261943    2563 scope.go:117] "RemoveContainer" containerID="95b12cdac294de2bbb0e44f7d87995a85b47e2112a79045943b60a69e717afa2"
Jul 17 11:19:35.264334 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:19:35.262125    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-0839e276-585c8cbf46-twtth_odh-ai-gateway-infra(4af8948d-3ab8-483a-85df-1399e3a79fb0)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth" podUID="4af8948d-3ab8-483a-85df-1399e3a79fb0"
Jul 17 11:19:50.259297 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:19:50.259269    2563 scope.go:117] "RemoveContainer" containerID="95b12cdac294de2bbb0e44f7d87995a85b47e2112a79045943b60a69e717afa2"
Jul 17 11:19:51.222600 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:19:51.222575    2563 generic.go:356] "Generic (PLEG): container finished" podID="4af8948d-3ab8-483a-85df-1399e3a79fb0" containerID="e0139238e6aa3a38cf6dfd48cec13fdcc405abad0eb8224b116541ce1cb5754e" exitCode=1
Jul 17 11:19:51.222716 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:19:51.222634    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth" event={"ID":"4af8948d-3ab8-483a-85df-1399e3a79fb0","Type":"ContainerDied","Data":"e0139238e6aa3a38cf6dfd48cec13fdcc405abad0eb8224b116541ce1cb5754e"}
Jul 17 11:19:51.222716 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:19:51.222680    2563 scope.go:117] "RemoveContainer" containerID="95b12cdac294de2bbb0e44f7d87995a85b47e2112a79045943b60a69e717afa2"
Jul 17 11:19:51.222959 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:19:51.222943    2563 scope.go:117] "RemoveContainer" containerID="e0139238e6aa3a38cf6dfd48cec13fdcc405abad0eb8224b116541ce1cb5754e"
Jul 17 11:19:51.223143 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:19:51.223116    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-0839e276-585c8cbf46-twtth_odh-ai-gateway-infra(4af8948d-3ab8-483a-85df-1399e3a79fb0)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth" podUID="4af8948d-3ab8-483a-85df-1399e3a79fb0"
Jul 17 11:19:53.852857 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:19:53.852828    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth"
Jul 17 11:19:53.853233 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:19:53.853122    2563 scope.go:117] "RemoveContainer" containerID="e0139238e6aa3a38cf6dfd48cec13fdcc405abad0eb8224b116541ce1cb5754e"
Jul 17 11:19:53.853291 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:19:53.853271    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-0839e276-585c8cbf46-twtth_odh-ai-gateway-infra(4af8948d-3ab8-483a-85df-1399e3a79fb0)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth" podUID="4af8948d-3ab8-483a-85df-1399e3a79fb0"
Jul 17 11:19:58.853788 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:19:58.853760    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth"
Jul 17 11:19:58.854137 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:19:58.854045    2563 scope.go:117] "RemoveContainer" containerID="e0139238e6aa3a38cf6dfd48cec13fdcc405abad0eb8224b116541ce1cb5754e"
Jul 17 11:19:58.854209 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:19:58.854191    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-0839e276-585c8cbf46-twtth_odh-ai-gateway-infra(4af8948d-3ab8-483a-85df-1399e3a79fb0)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth" podUID="4af8948d-3ab8-483a-85df-1399e3a79fb0"
Jul 17 11:20:10.259404 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:20:10.259379    2563 scope.go:117] "RemoveContainer" containerID="e0139238e6aa3a38cf6dfd48cec13fdcc405abad0eb8224b116541ce1cb5754e"
Jul 17 11:20:10.259781 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:20:10.259583    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-0839e276-585c8cbf46-twtth_odh-ai-gateway-infra(4af8948d-3ab8-483a-85df-1399e3a79fb0)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth" podUID="4af8948d-3ab8-483a-85df-1399e3a79fb0"
Jul 17 11:20:23.259956 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:20:23.259926    2563 scope.go:117] "RemoveContainer" containerID="e0139238e6aa3a38cf6dfd48cec13fdcc405abad0eb8224b116541ce1cb5754e"
Jul 17 11:20:23.260386 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:20:23.260101    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-0839e276-585c8cbf46-twtth_odh-ai-gateway-infra(4af8948d-3ab8-483a-85df-1399e3a79fb0)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth" podUID="4af8948d-3ab8-483a-85df-1399e3a79fb0"
Jul 17 11:20:38.259240 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:20:38.259215    2563 scope.go:117] "RemoveContainer" containerID="e0139238e6aa3a38cf6dfd48cec13fdcc405abad0eb8224b116541ce1cb5754e"
Jul 17 11:20:38.259636 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:20:38.259369    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-0839e276-585c8cbf46-twtth_odh-ai-gateway-infra(4af8948d-3ab8-483a-85df-1399e3a79fb0)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth" podUID="4af8948d-3ab8-483a-85df-1399e3a79fb0"
Jul 17 11:20:51.259694 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:20:51.259666    2563 scope.go:117] "RemoveContainer" containerID="e0139238e6aa3a38cf6dfd48cec13fdcc405abad0eb8224b116541ce1cb5754e"
Jul 17 11:20:51.260015 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:20:51.259818    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-0839e276-585c8cbf46-twtth_odh-ai-gateway-infra(4af8948d-3ab8-483a-85df-1399e3a79fb0)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth" podUID="4af8948d-3ab8-483a-85df-1399e3a79fb0"
Jul 17 11:21:06.259151 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:06.259122    2563 scope.go:117] "RemoveContainer" containerID="e0139238e6aa3a38cf6dfd48cec13fdcc405abad0eb8224b116541ce1cb5754e"
Jul 17 11:21:06.259613 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:21:06.259261    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-0839e276-585c8cbf46-twtth_odh-ai-gateway-infra(4af8948d-3ab8-483a-85df-1399e3a79fb0)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth" podUID="4af8948d-3ab8-483a-85df-1399e3a79fb0"
Jul 17 11:21:21.259374 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:21.259341    2563 scope.go:117] "RemoveContainer" containerID="e0139238e6aa3a38cf6dfd48cec13fdcc405abad0eb8224b116541ce1cb5754e"
Jul 17 11:21:22.613719 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:22.613691    2563 generic.go:356] "Generic (PLEG): container finished" podID="4af8948d-3ab8-483a-85df-1399e3a79fb0" containerID="78d759da2c54640befdeb98bbd75cbec0880b38ea03fe82e122db246fe66141b" exitCode=1
Jul 17 11:21:22.614097 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:22.613759    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth" event={"ID":"4af8948d-3ab8-483a-85df-1399e3a79fb0","Type":"ContainerDied","Data":"78d759da2c54640befdeb98bbd75cbec0880b38ea03fe82e122db246fe66141b"}
Jul 17 11:21:22.614097 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:22.613810    2563 scope.go:117] "RemoveContainer" containerID="e0139238e6aa3a38cf6dfd48cec13fdcc405abad0eb8224b116541ce1cb5754e"
Jul 17 11:21:22.614216 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:22.614108    2563 scope.go:117] "RemoveContainer" containerID="78d759da2c54640befdeb98bbd75cbec0880b38ea03fe82e122db246fe66141b"
Jul 17 11:21:22.614313 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:21:22.614287    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-0839e276-585c8cbf46-twtth_odh-ai-gateway-infra(4af8948d-3ab8-483a-85df-1399e3a79fb0)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth" podUID="4af8948d-3ab8-483a-85df-1399e3a79fb0"
Jul 17 11:21:23.806689 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:23.806640    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-76b5fcbfd-bt5lk_a2d69d0a-6d06-44c3-995b-b75a48582b92/manager/0.log"
Jul 17 11:21:23.853110 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:23.853089    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth"
Jul 17 11:21:23.853418 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:23.853404    2563 scope.go:117] "RemoveContainer" containerID="78d759da2c54640befdeb98bbd75cbec0880b38ea03fe82e122db246fe66141b"
Jul 17 11:21:23.853607 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:21:23.853587    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-0839e276-585c8cbf46-twtth_odh-ai-gateway-infra(4af8948d-3ab8-483a-85df-1399e3a79fb0)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth" podUID="4af8948d-3ab8-483a-85df-1399e3a79fb0"
Jul 17 11:21:28.853002 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:28.852959    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth"
Jul 17 11:21:28.853349 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:28.853306    2563 scope.go:117] "RemoveContainer" containerID="78d759da2c54640befdeb98bbd75cbec0880b38ea03fe82e122db246fe66141b"
Jul 17 11:21:28.853503 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:21:28.853483    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-0839e276-585c8cbf46-twtth_odh-ai-gateway-infra(4af8948d-3ab8-483a-85df-1399e3a79fb0)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth" podUID="4af8948d-3ab8-483a-85df-1399e3a79fb0"
Jul 17 11:21:30.106817 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:30.106774    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth"]
Jul 17 11:21:30.239036 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:30.239013    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth"
Jul 17 11:21:30.261715 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:30.261687    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4af8948d-3ab8-483a-85df-1399e3a79fb0-openshift-service-ca\") pod \"4af8948d-3ab8-483a-85df-1399e3a79fb0\" (UID: \"4af8948d-3ab8-483a-85df-1399e3a79fb0\") "
Jul 17 11:21:30.261885 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:30.261732    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4af8948d-3ab8-483a-85df-1399e3a79fb0-maas-api-tls\") pod \"4af8948d-3ab8-483a-85df-1399e3a79fb0\" (UID: \"4af8948d-3ab8-483a-85df-1399e3a79fb0\") "
Jul 17 11:21:30.261885 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:30.261855    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2brr8\" (UniqueName: \"kubernetes.io/projected/4af8948d-3ab8-483a-85df-1399e3a79fb0-kube-api-access-2brr8\") pod \"4af8948d-3ab8-483a-85df-1399e3a79fb0\" (UID: \"4af8948d-3ab8-483a-85df-1399e3a79fb0\") "
Jul 17 11:21:30.262512 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:30.262470    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4af8948d-3ab8-483a-85df-1399e3a79fb0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4af8948d-3ab8-483a-85df-1399e3a79fb0" (UID: "4af8948d-3ab8-483a-85df-1399e3a79fb0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:21:30.264520 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:30.264217    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4af8948d-3ab8-483a-85df-1399e3a79fb0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4af8948d-3ab8-483a-85df-1399e3a79fb0" (UID: "4af8948d-3ab8-483a-85df-1399e3a79fb0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:21:30.264520 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:30.264405    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4af8948d-3ab8-483a-85df-1399e3a79fb0-kube-api-access-2brr8" (OuterVolumeSpecName: "kube-api-access-2brr8") pod "4af8948d-3ab8-483a-85df-1399e3a79fb0" (UID: "4af8948d-3ab8-483a-85df-1399e3a79fb0"). InnerVolumeSpecName "kube-api-access-2brr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:21:30.363603 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:30.363545    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4af8948d-3ab8-483a-85df-1399e3a79fb0-openshift-service-ca\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:21:30.363603 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:30.363569    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4af8948d-3ab8-483a-85df-1399e3a79fb0-maas-api-tls\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:21:30.363603 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:30.363578    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2brr8\" (UniqueName: \"kubernetes.io/projected/4af8948d-3ab8-483a-85df-1399e3a79fb0-kube-api-access-2brr8\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:21:30.651419 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:30.651396    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth"
Jul 17 11:21:30.651557 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:30.651392    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth" event={"ID":"4af8948d-3ab8-483a-85df-1399e3a79fb0","Type":"ContainerDied","Data":"cedaacdcc948bcf505cafc5dde6a90657db63bf00bd8ce7739194b2d0763f4fc"}
Jul 17 11:21:30.651557 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:30.651526    2563 scope.go:117] "RemoveContainer" containerID="78d759da2c54640befdeb98bbd75cbec0880b38ea03fe82e122db246fe66141b"
Jul 17 11:21:30.675326 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:30.675303    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth"]
Jul 17 11:21:30.678637 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:30.678620    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0839e276-585c8cbf46-twtth"]
Jul 17 11:21:31.264011 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:31.263981    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4af8948d-3ab8-483a-85df-1399e3a79fb0" path="/var/lib/kubelet/pods/4af8948d-3ab8-483a-85df-1399e3a79fb0/volumes"
Jul 17 11:21:38.253868 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:38.253835    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9"]
Jul 17 11:21:38.254280 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:38.254170    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4af8948d-3ab8-483a-85df-1399e3a79fb0" containerName="maas-api"
Jul 17 11:21:38.254280 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:38.254182    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4af8948d-3ab8-483a-85df-1399e3a79fb0" containerName="maas-api"
Jul 17 11:21:38.254280 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:38.254195    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4af8948d-3ab8-483a-85df-1399e3a79fb0" containerName="maas-api"
Jul 17 11:21:38.254280 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:38.254200    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4af8948d-3ab8-483a-85df-1399e3a79fb0" containerName="maas-api"
Jul 17 11:21:38.254280 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:38.254212    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4af8948d-3ab8-483a-85df-1399e3a79fb0" containerName="maas-api"
Jul 17 11:21:38.254280 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:38.254218    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4af8948d-3ab8-483a-85df-1399e3a79fb0" containerName="maas-api"
Jul 17 11:21:38.254280 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:38.254225    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4af8948d-3ab8-483a-85df-1399e3a79fb0" containerName="maas-api"
Jul 17 11:21:38.254280 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:38.254230    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4af8948d-3ab8-483a-85df-1399e3a79fb0" containerName="maas-api"
Jul 17 11:21:38.254280 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:38.254243    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4af8948d-3ab8-483a-85df-1399e3a79fb0" containerName="maas-api"
Jul 17 11:21:38.254280 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:38.254247    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4af8948d-3ab8-483a-85df-1399e3a79fb0" containerName="maas-api"
Jul 17 11:21:38.254280 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:38.254255    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4af8948d-3ab8-483a-85df-1399e3a79fb0" containerName="maas-api"
Jul 17 11:21:38.254280 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:38.254260    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4af8948d-3ab8-483a-85df-1399e3a79fb0" containerName="maas-api"
Jul 17 11:21:38.254662 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:38.254322    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4af8948d-3ab8-483a-85df-1399e3a79fb0" containerName="maas-api"
Jul 17 11:21:38.254662 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:38.254330    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4af8948d-3ab8-483a-85df-1399e3a79fb0" containerName="maas-api"
Jul 17 11:21:38.254662 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:38.254335    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4af8948d-3ab8-483a-85df-1399e3a79fb0" containerName="maas-api"
Jul 17 11:21:38.254662 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:38.254341    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4af8948d-3ab8-483a-85df-1399e3a79fb0" containerName="maas-api"
Jul 17 11:21:38.257144 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:38.257128    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9"
Jul 17 11:21:38.259848 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:38.259827    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-4d5573f1-serving-cert\""
Jul 17 11:21:38.269881 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:38.269858    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9"]
Jul 17 11:21:38.326904 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:38.326883    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5lkq\" (UniqueName: \"kubernetes.io/projected/76c7c2ef-4b21-4e97-a931-9a1888d3dfaa-kube-api-access-m5lkq\") pod \"maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9\" (UID: \"76c7c2ef-4b21-4e97-a931-9a1888d3dfaa\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9"
Jul 17 11:21:38.327012 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:38.326919    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76c7c2ef-4b21-4e97-a931-9a1888d3dfaa-maas-api-tls\") pod \"maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9\" (UID: \"76c7c2ef-4b21-4e97-a931-9a1888d3dfaa\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9"
Jul 17 11:21:38.327012 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:38.326961    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76c7c2ef-4b21-4e97-a931-9a1888d3dfaa-openshift-service-ca\") pod \"maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9\" (UID: \"76c7c2ef-4b21-4e97-a931-9a1888d3dfaa\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9"
Jul 17 11:21:38.427765 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:38.427741    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76c7c2ef-4b21-4e97-a931-9a1888d3dfaa-openshift-service-ca\") pod \"maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9\" (UID: \"76c7c2ef-4b21-4e97-a931-9a1888d3dfaa\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9"
Jul 17 11:21:38.427872 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:38.427800    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5lkq\" (UniqueName: \"kubernetes.io/projected/76c7c2ef-4b21-4e97-a931-9a1888d3dfaa-kube-api-access-m5lkq\") pod \"maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9\" (UID: \"76c7c2ef-4b21-4e97-a931-9a1888d3dfaa\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9"
Jul 17 11:21:38.427872 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:38.427824    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76c7c2ef-4b21-4e97-a931-9a1888d3dfaa-maas-api-tls\") pod \"maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9\" (UID: \"76c7c2ef-4b21-4e97-a931-9a1888d3dfaa\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9"
Jul 17 11:21:38.427957 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:21:38.427928    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-serving-cert: secret "maas-api-e2e-migrate-4d5573f1-serving-cert" not found
Jul 17 11:21:38.427998 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:21:38.427987    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76c7c2ef-4b21-4e97-a931-9a1888d3dfaa-maas-api-tls podName:76c7c2ef-4b21-4e97-a931-9a1888d3dfaa nodeName:}" failed. No retries permitted until 2026-07-17 11:21:38.927968369 +0000 UTC m=+1764.109001314 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/76c7c2ef-4b21-4e97-a931-9a1888d3dfaa-maas-api-tls") pod "maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9" (UID: "76c7c2ef-4b21-4e97-a931-9a1888d3dfaa") : secret "maas-api-e2e-migrate-4d5573f1-serving-cert" not found
Jul 17 11:21:38.428361 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:38.428344    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76c7c2ef-4b21-4e97-a931-9a1888d3dfaa-openshift-service-ca\") pod \"maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9\" (UID: \"76c7c2ef-4b21-4e97-a931-9a1888d3dfaa\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9"
Jul 17 11:21:38.438558 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:38.438538    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5lkq\" (UniqueName: \"kubernetes.io/projected/76c7c2ef-4b21-4e97-a931-9a1888d3dfaa-kube-api-access-m5lkq\") pod \"maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9\" (UID: \"76c7c2ef-4b21-4e97-a931-9a1888d3dfaa\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9"
Jul 17 11:21:38.933089 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:38.933056    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76c7c2ef-4b21-4e97-a931-9a1888d3dfaa-maas-api-tls\") pod \"maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9\" (UID: \"76c7c2ef-4b21-4e97-a931-9a1888d3dfaa\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9"
Jul 17 11:21:38.935473 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:38.935422    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76c7c2ef-4b21-4e97-a931-9a1888d3dfaa-maas-api-tls\") pod \"maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9\" (UID: \"76c7c2ef-4b21-4e97-a931-9a1888d3dfaa\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9"
Jul 17 11:21:39.166069 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:39.166032    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9"
Jul 17 11:21:39.320373 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:39.320352    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9"]
Jul 17 11:21:39.322466 ip-10-0-143-12 kubenswrapper[2563]: W0717 11:21:39.322421    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76c7c2ef_4b21_4e97_a931_9a1888d3dfaa.slice/crio-cb5e15ea8ff379263450cae5f4dd4c41d80dbf0e2a04a684425a3786a33f5eed WatchSource:0}: Error finding container cb5e15ea8ff379263450cae5f4dd4c41d80dbf0e2a04a684425a3786a33f5eed: Status 404 returned error can't find the container with id cb5e15ea8ff379263450cae5f4dd4c41d80dbf0e2a04a684425a3786a33f5eed
Jul 17 11:21:39.694311 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:39.694280    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9" event={"ID":"76c7c2ef-4b21-4e97-a931-9a1888d3dfaa","Type":"ContainerStarted","Data":"30da0bce9d50bf2fd3a6278729f5910bdd5f48d42e18958bdf36e54c2638ec06"}
Jul 17 11:21:39.694441 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:39.694326    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9" event={"ID":"76c7c2ef-4b21-4e97-a931-9a1888d3dfaa","Type":"ContainerStarted","Data":"cb5e15ea8ff379263450cae5f4dd4c41d80dbf0e2a04a684425a3786a33f5eed"}
Jul 17 11:21:39.694496 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:39.694447    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9"
Jul 17 11:21:39.712143 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:39.712094    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9" podStartSLOduration=1.424096783 podStartE2EDuration="1.712081484s" totalImagesPullingTime="287.984701ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:21:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:21:39.711106587 +0000 UTC m=+1764.892139550" watchObservedRunningTime="2026-07-17 11:21:39.712081484 +0000 UTC m=+1764.893114461"
Jul 17 11:21:40.699810 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:40.699777    2563 generic.go:356] "Generic (PLEG): container finished" podID="76c7c2ef-4b21-4e97-a931-9a1888d3dfaa" containerID="30da0bce9d50bf2fd3a6278729f5910bdd5f48d42e18958bdf36e54c2638ec06" exitCode=1
Jul 17 11:21:40.700163 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:40.699847    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9" event={"ID":"76c7c2ef-4b21-4e97-a931-9a1888d3dfaa","Type":"ContainerDied","Data":"30da0bce9d50bf2fd3a6278729f5910bdd5f48d42e18958bdf36e54c2638ec06"}
Jul 17 11:21:40.700163 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:40.700071    2563 scope.go:117] "RemoveContainer" containerID="30da0bce9d50bf2fd3a6278729f5910bdd5f48d42e18958bdf36e54c2638ec06"
Jul 17 11:21:41.705893 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:41.705862    2563 generic.go:356] "Generic (PLEG): container finished" podID="76c7c2ef-4b21-4e97-a931-9a1888d3dfaa" containerID="6da1823fed47c48e0dbdadda3b5d277635ce21be955f6538a234d29fc9e33098" exitCode=1
Jul 17 11:21:41.706277 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:41.705931    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9" event={"ID":"76c7c2ef-4b21-4e97-a931-9a1888d3dfaa","Type":"ContainerDied","Data":"6da1823fed47c48e0dbdadda3b5d277635ce21be955f6538a234d29fc9e33098"}
Jul 17 11:21:41.706277 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:41.705970    2563 scope.go:117] "RemoveContainer" containerID="30da0bce9d50bf2fd3a6278729f5910bdd5f48d42e18958bdf36e54c2638ec06"
Jul 17 11:21:41.706277 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:41.706232    2563 scope.go:117] "RemoveContainer" containerID="6da1823fed47c48e0dbdadda3b5d277635ce21be955f6538a234d29fc9e33098"
Jul 17 11:21:41.706502 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:21:41.706482    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9_odh-ai-gateway-infra(76c7c2ef-4b21-4e97-a931-9a1888d3dfaa)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9" podUID="76c7c2ef-4b21-4e97-a931-9a1888d3dfaa"
Jul 17 11:21:42.712723 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:42.712699    2563 scope.go:117] "RemoveContainer" containerID="6da1823fed47c48e0dbdadda3b5d277635ce21be955f6538a234d29fc9e33098"
Jul 17 11:21:42.713078 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:21:42.712849    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9_odh-ai-gateway-infra(76c7c2ef-4b21-4e97-a931-9a1888d3dfaa)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9" podUID="76c7c2ef-4b21-4e97-a931-9a1888d3dfaa"
Jul 17 11:21:44.695446 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:44.695410    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9"
Jul 17 11:21:44.695816 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:44.695774    2563 scope.go:117] "RemoveContainer" containerID="6da1823fed47c48e0dbdadda3b5d277635ce21be955f6538a234d29fc9e33098"
Jul 17 11:21:44.695932 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:21:44.695914    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9_odh-ai-gateway-infra(76c7c2ef-4b21-4e97-a931-9a1888d3dfaa)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9" podUID="76c7c2ef-4b21-4e97-a931-9a1888d3dfaa"
Jul 17 11:21:49.167074 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:49.167045    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9"
Jul 17 11:21:49.167520 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:21:49.167392    2563 scope.go:117] "RemoveContainer" containerID="6da1823fed47c48e0dbdadda3b5d277635ce21be955f6538a234d29fc9e33098"
Jul 17 11:21:49.167597 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:21:49.167566    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9_odh-ai-gateway-infra(76c7c2ef-4b21-4e97-a931-9a1888d3dfaa)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9" podUID="76c7c2ef-4b21-4e97-a931-9a1888d3dfaa"
Jul 17 11:22:01.259876 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:01.259848    2563 scope.go:117] "RemoveContainer" containerID="6da1823fed47c48e0dbdadda3b5d277635ce21be955f6538a234d29fc9e33098"
Jul 17 11:22:01.800796 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:01.800742    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9" event={"ID":"76c7c2ef-4b21-4e97-a931-9a1888d3dfaa","Type":"ContainerStarted","Data":"9a5bab24e12de2cc1a98ebd96b28e08562f0beacaa610ce9f223ec855de1efe8"}
Jul 17 11:22:01.801007 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:01.800985    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9"
Jul 17 11:22:02.807076 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:02.807045    2563 generic.go:356] "Generic (PLEG): container finished" podID="76c7c2ef-4b21-4e97-a931-9a1888d3dfaa" containerID="9a5bab24e12de2cc1a98ebd96b28e08562f0beacaa610ce9f223ec855de1efe8" exitCode=1
Jul 17 11:22:02.807421 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:02.807109    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9" event={"ID":"76c7c2ef-4b21-4e97-a931-9a1888d3dfaa","Type":"ContainerDied","Data":"9a5bab24e12de2cc1a98ebd96b28e08562f0beacaa610ce9f223ec855de1efe8"}
Jul 17 11:22:02.807421 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:02.807146    2563 scope.go:117] "RemoveContainer" containerID="6da1823fed47c48e0dbdadda3b5d277635ce21be955f6538a234d29fc9e33098"
Jul 17 11:22:02.807421 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:02.807304    2563 scope.go:117] "RemoveContainer" containerID="9a5bab24e12de2cc1a98ebd96b28e08562f0beacaa610ce9f223ec855de1efe8"
Jul 17 11:22:02.807576 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:22:02.807498    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9_odh-ai-gateway-infra(76c7c2ef-4b21-4e97-a931-9a1888d3dfaa)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9" podUID="76c7c2ef-4b21-4e97-a931-9a1888d3dfaa"
Jul 17 11:22:03.813420 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:03.813395    2563 scope.go:117] "RemoveContainer" containerID="9a5bab24e12de2cc1a98ebd96b28e08562f0beacaa610ce9f223ec855de1efe8"
Jul 17 11:22:03.813768 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:22:03.813573    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9_odh-ai-gateway-infra(76c7c2ef-4b21-4e97-a931-9a1888d3dfaa)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9" podUID="76c7c2ef-4b21-4e97-a931-9a1888d3dfaa"
Jul 17 11:22:09.167034 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:09.166966    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9"
Jul 17 11:22:09.167481 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:09.167276    2563 scope.go:117] "RemoveContainer" containerID="9a5bab24e12de2cc1a98ebd96b28e08562f0beacaa610ce9f223ec855de1efe8"
Jul 17 11:22:09.167481 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:22:09.167415    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9_odh-ai-gateway-infra(76c7c2ef-4b21-4e97-a931-9a1888d3dfaa)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9" podUID="76c7c2ef-4b21-4e97-a931-9a1888d3dfaa"
Jul 17 11:22:15.329539 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:15.329510    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xdrhl_48cc1998-ebc5-4702-8b08-027479580e57/ovn-acl-logging/0.log"
Jul 17 11:22:15.333448 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:15.333411    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xdrhl_48cc1998-ebc5-4702-8b08-027479580e57/ovn-acl-logging/0.log"
Jul 17 11:22:20.260112 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:20.260081    2563 scope.go:117] "RemoveContainer" containerID="9a5bab24e12de2cc1a98ebd96b28e08562f0beacaa610ce9f223ec855de1efe8"
Jul 17 11:22:20.260495 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:22:20.260228    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9_odh-ai-gateway-infra(76c7c2ef-4b21-4e97-a931-9a1888d3dfaa)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9" podUID="76c7c2ef-4b21-4e97-a931-9a1888d3dfaa"
Jul 17 11:22:33.259164 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:33.259132    2563 scope.go:117] "RemoveContainer" containerID="9a5bab24e12de2cc1a98ebd96b28e08562f0beacaa610ce9f223ec855de1efe8"
Jul 17 11:22:33.944505 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:33.944473    2563 generic.go:356] "Generic (PLEG): container finished" podID="76c7c2ef-4b21-4e97-a931-9a1888d3dfaa" containerID="a98c83085c0ddad86dcf237dfa3e9f144880f26752f7b05af27c0f5aa33932bc" exitCode=1
Jul 17 11:22:33.944603 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:33.944548    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9" event={"ID":"76c7c2ef-4b21-4e97-a931-9a1888d3dfaa","Type":"ContainerDied","Data":"a98c83085c0ddad86dcf237dfa3e9f144880f26752f7b05af27c0f5aa33932bc"}
Jul 17 11:22:33.944647 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:33.944605    2563 scope.go:117] "RemoveContainer" containerID="9a5bab24e12de2cc1a98ebd96b28e08562f0beacaa610ce9f223ec855de1efe8"
Jul 17 11:22:33.944967 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:33.944941    2563 scope.go:117] "RemoveContainer" containerID="a98c83085c0ddad86dcf237dfa3e9f144880f26752f7b05af27c0f5aa33932bc"
Jul 17 11:22:33.945153 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:22:33.945134    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9_odh-ai-gateway-infra(76c7c2ef-4b21-4e97-a931-9a1888d3dfaa)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9" podUID="76c7c2ef-4b21-4e97-a931-9a1888d3dfaa"
Jul 17 11:22:36.801924 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:36.801895    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9"
Jul 17 11:22:36.802295 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:36.802209    2563 scope.go:117] "RemoveContainer" containerID="a98c83085c0ddad86dcf237dfa3e9f144880f26752f7b05af27c0f5aa33932bc"
Jul 17 11:22:36.802391 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:22:36.802365    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9_odh-ai-gateway-infra(76c7c2ef-4b21-4e97-a931-9a1888d3dfaa)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9" podUID="76c7c2ef-4b21-4e97-a931-9a1888d3dfaa"
Jul 17 11:22:39.167036 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:39.166993    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9"
Jul 17 11:22:39.167499 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:39.167328    2563 scope.go:117] "RemoveContainer" containerID="a98c83085c0ddad86dcf237dfa3e9f144880f26752f7b05af27c0f5aa33932bc"
Jul 17 11:22:39.167570 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:22:39.167503    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9_odh-ai-gateway-infra(76c7c2ef-4b21-4e97-a931-9a1888d3dfaa)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9" podUID="76c7c2ef-4b21-4e97-a931-9a1888d3dfaa"
Jul 17 11:22:43.312547 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:43.312521    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-76b5fcbfd-bt5lk_a2d69d0a-6d06-44c3-995b-b75a48582b92/manager/0.log"
Jul 17 11:22:48.979478 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:48.978704    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9"]
Jul 17 11:22:49.110371 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:49.110339    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9"
Jul 17 11:22:49.248792 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:49.248759    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76c7c2ef-4b21-4e97-a931-9a1888d3dfaa-maas-api-tls\") pod \"76c7c2ef-4b21-4e97-a931-9a1888d3dfaa\" (UID: \"76c7c2ef-4b21-4e97-a931-9a1888d3dfaa\") "
Jul 17 11:22:49.248908 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:49.248852    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5lkq\" (UniqueName: \"kubernetes.io/projected/76c7c2ef-4b21-4e97-a931-9a1888d3dfaa-kube-api-access-m5lkq\") pod \"76c7c2ef-4b21-4e97-a931-9a1888d3dfaa\" (UID: \"76c7c2ef-4b21-4e97-a931-9a1888d3dfaa\") "
Jul 17 11:22:49.248908 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:49.248900    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76c7c2ef-4b21-4e97-a931-9a1888d3dfaa-openshift-service-ca\") pod \"76c7c2ef-4b21-4e97-a931-9a1888d3dfaa\" (UID: \"76c7c2ef-4b21-4e97-a931-9a1888d3dfaa\") "
Jul 17 11:22:49.249264 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:49.249231    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76c7c2ef-4b21-4e97-a931-9a1888d3dfaa-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "76c7c2ef-4b21-4e97-a931-9a1888d3dfaa" (UID: "76c7c2ef-4b21-4e97-a931-9a1888d3dfaa"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:22:49.250833 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:49.250809    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76c7c2ef-4b21-4e97-a931-9a1888d3dfaa-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "76c7c2ef-4b21-4e97-a931-9a1888d3dfaa" (UID: "76c7c2ef-4b21-4e97-a931-9a1888d3dfaa"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:22:49.250946 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:49.250861    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76c7c2ef-4b21-4e97-a931-9a1888d3dfaa-kube-api-access-m5lkq" (OuterVolumeSpecName: "kube-api-access-m5lkq") pod "76c7c2ef-4b21-4e97-a931-9a1888d3dfaa" (UID: "76c7c2ef-4b21-4e97-a931-9a1888d3dfaa"). InnerVolumeSpecName "kube-api-access-m5lkq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:22:49.350220 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:49.350172    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5lkq\" (UniqueName: \"kubernetes.io/projected/76c7c2ef-4b21-4e97-a931-9a1888d3dfaa-kube-api-access-m5lkq\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:22:49.350220 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:49.350196    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76c7c2ef-4b21-4e97-a931-9a1888d3dfaa-openshift-service-ca\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:22:49.350220 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:49.350205    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76c7c2ef-4b21-4e97-a931-9a1888d3dfaa-maas-api-tls\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:22:50.019042 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:50.019012    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9" event={"ID":"76c7c2ef-4b21-4e97-a931-9a1888d3dfaa","Type":"ContainerDied","Data":"cb5e15ea8ff379263450cae5f4dd4c41d80dbf0e2a04a684425a3786a33f5eed"}
Jul 17 11:22:50.019454 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:50.019073    2563 scope.go:117] "RemoveContainer" containerID="a98c83085c0ddad86dcf237dfa3e9f144880f26752f7b05af27c0f5aa33932bc"
Jul 17 11:22:50.019454 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:50.019020    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9"
Jul 17 11:22:50.038794 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:50.038764    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9"]
Jul 17 11:22:50.043761 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:50.043738    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-4d5573f1-79b6bc774b-qr7f9"]
Jul 17 11:22:51.265049 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:51.265009    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76c7c2ef-4b21-4e97-a931-9a1888d3dfaa" path="/var/lib/kubelet/pods/76c7c2ef-4b21-4e97-a931-9a1888d3dfaa/volumes"
Jul 17 11:22:57.229355 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:57.229317    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf"]
Jul 17 11:22:57.229752 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:57.229697    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76c7c2ef-4b21-4e97-a931-9a1888d3dfaa" containerName="maas-api"
Jul 17 11:22:57.229752 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:57.229722    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="76c7c2ef-4b21-4e97-a931-9a1888d3dfaa" containerName="maas-api"
Jul 17 11:22:57.229752 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:57.229733    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76c7c2ef-4b21-4e97-a931-9a1888d3dfaa" containerName="maas-api"
Jul 17 11:22:57.229752 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:57.229739    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="76c7c2ef-4b21-4e97-a931-9a1888d3dfaa" containerName="maas-api"
Jul 17 11:22:57.229752 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:57.229755    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76c7c2ef-4b21-4e97-a931-9a1888d3dfaa" containerName="maas-api"
Jul 17 11:22:57.229920 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:57.229760    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="76c7c2ef-4b21-4e97-a931-9a1888d3dfaa" containerName="maas-api"
Jul 17 11:22:57.229920 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:57.229809    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="76c7c2ef-4b21-4e97-a931-9a1888d3dfaa" containerName="maas-api"
Jul 17 11:22:57.229920 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:57.229818    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4af8948d-3ab8-483a-85df-1399e3a79fb0" containerName="maas-api"
Jul 17 11:22:57.229920 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:57.229825    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4af8948d-3ab8-483a-85df-1399e3a79fb0" containerName="maas-api"
Jul 17 11:22:57.229920 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:57.229831    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="76c7c2ef-4b21-4e97-a931-9a1888d3dfaa" containerName="maas-api"
Jul 17 11:22:57.234395 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:57.234372    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf"
Jul 17 11:22:57.237010 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:57.236993    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-eac6ba90-serving-cert\""
Jul 17 11:22:57.244375 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:57.244356    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf"]
Jul 17 11:22:57.308521 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:57.308493    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcl9j\" (UniqueName: \"kubernetes.io/projected/bdbaaffc-1a93-41df-9934-8015c863cadf-kube-api-access-wcl9j\") pod \"maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf\" (UID: \"bdbaaffc-1a93-41df-9934-8015c863cadf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf"
Jul 17 11:22:57.308649 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:57.308609    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdbaaffc-1a93-41df-9934-8015c863cadf-maas-api-tls\") pod \"maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf\" (UID: \"bdbaaffc-1a93-41df-9934-8015c863cadf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf"
Jul 17 11:22:57.308738 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:57.308723    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdbaaffc-1a93-41df-9934-8015c863cadf-openshift-service-ca\") pod \"maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf\" (UID: \"bdbaaffc-1a93-41df-9934-8015c863cadf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf"
Jul 17 11:22:57.409215 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:57.409193    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdbaaffc-1a93-41df-9934-8015c863cadf-openshift-service-ca\") pod \"maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf\" (UID: \"bdbaaffc-1a93-41df-9934-8015c863cadf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf"
Jul 17 11:22:57.409318 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:57.409229    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcl9j\" (UniqueName: \"kubernetes.io/projected/bdbaaffc-1a93-41df-9934-8015c863cadf-kube-api-access-wcl9j\") pod \"maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf\" (UID: \"bdbaaffc-1a93-41df-9934-8015c863cadf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf"
Jul 17 11:22:57.409318 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:57.409255    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdbaaffc-1a93-41df-9934-8015c863cadf-maas-api-tls\") pod \"maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf\" (UID: \"bdbaaffc-1a93-41df-9934-8015c863cadf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf"
Jul 17 11:22:57.409909 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:57.409888    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdbaaffc-1a93-41df-9934-8015c863cadf-openshift-service-ca\") pod \"maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf\" (UID: \"bdbaaffc-1a93-41df-9934-8015c863cadf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf"
Jul 17 11:22:57.411587 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:57.411566    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdbaaffc-1a93-41df-9934-8015c863cadf-maas-api-tls\") pod \"maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf\" (UID: \"bdbaaffc-1a93-41df-9934-8015c863cadf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf"
Jul 17 11:22:57.434834 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:57.434813    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcl9j\" (UniqueName: \"kubernetes.io/projected/bdbaaffc-1a93-41df-9934-8015c863cadf-kube-api-access-wcl9j\") pod \"maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf\" (UID: \"bdbaaffc-1a93-41df-9934-8015c863cadf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf"
Jul 17 11:22:57.545255 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:57.545202    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf"
Jul 17 11:22:57.701866 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:57.701843    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf"]
Jul 17 11:22:57.704181 ip-10-0-143-12 kubenswrapper[2563]: W0717 11:22:57.704153    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdbaaffc_1a93_41df_9934_8015c863cadf.slice/crio-936fdb884e21798445596016e88b58dee3f03a89e7983e55fd4305b461e25790 WatchSource:0}: Error finding container 936fdb884e21798445596016e88b58dee3f03a89e7983e55fd4305b461e25790: Status 404 returned error can't find the container with id 936fdb884e21798445596016e88b58dee3f03a89e7983e55fd4305b461e25790
Jul 17 11:22:58.059189 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:58.059163    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" event={"ID":"bdbaaffc-1a93-41df-9934-8015c863cadf","Type":"ContainerStarted","Data":"936fdb884e21798445596016e88b58dee3f03a89e7983e55fd4305b461e25790"}
Jul 17 11:22:59.064996 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:59.064956    2563 generic.go:356] "Generic (PLEG): container finished" podID="bdbaaffc-1a93-41df-9934-8015c863cadf" containerID="730b051935957a842c77839f078a4583699a1cf14e1d9e87a07925041e2393a5" exitCode=1
Jul 17 11:22:59.065382 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:59.065044    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" event={"ID":"bdbaaffc-1a93-41df-9934-8015c863cadf","Type":"ContainerDied","Data":"730b051935957a842c77839f078a4583699a1cf14e1d9e87a07925041e2393a5"}
Jul 17 11:22:59.065382 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:22:59.065253    2563 scope.go:117] "RemoveContainer" containerID="730b051935957a842c77839f078a4583699a1cf14e1d9e87a07925041e2393a5"
Jul 17 11:23:00.071314 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:23:00.071282    2563 generic.go:356] "Generic (PLEG): container finished" podID="bdbaaffc-1a93-41df-9934-8015c863cadf" containerID="d3c7b950ff15fe07e31ef49bbf683bce0c1ae94a01681f4f1c1eb7bd7490ac22" exitCode=1
Jul 17 11:23:00.071656 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:23:00.071324    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" event={"ID":"bdbaaffc-1a93-41df-9934-8015c863cadf","Type":"ContainerDied","Data":"d3c7b950ff15fe07e31ef49bbf683bce0c1ae94a01681f4f1c1eb7bd7490ac22"}
Jul 17 11:23:00.071656 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:23:00.071390    2563 scope.go:117] "RemoveContainer" containerID="730b051935957a842c77839f078a4583699a1cf14e1d9e87a07925041e2393a5"
Jul 17 11:23:00.071656 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:23:00.071545    2563 scope.go:117] "RemoveContainer" containerID="d3c7b950ff15fe07e31ef49bbf683bce0c1ae94a01681f4f1c1eb7bd7490ac22"
Jul 17 11:23:00.071812 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:23:00.071721    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf_odh-ai-gateway-infra(bdbaaffc-1a93-41df-9934-8015c863cadf)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf"
Jul 17 11:23:01.077310 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:23:01.077281    2563 scope.go:117] "RemoveContainer" containerID="d3c7b950ff15fe07e31ef49bbf683bce0c1ae94a01681f4f1c1eb7bd7490ac22"
Jul 17 11:23:01.077687 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:23:01.077484    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf_odh-ai-gateway-infra(bdbaaffc-1a93-41df-9934-8015c863cadf)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf"
Jul 17 11:23:02.545981 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:23:02.545939    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf"
Jul 17 11:23:02.546465 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:23:02.546310    2563 scope.go:117] "RemoveContainer" containerID="d3c7b950ff15fe07e31ef49bbf683bce0c1ae94a01681f4f1c1eb7bd7490ac22"
Jul 17 11:23:02.546549 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:23:02.546517    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf_odh-ai-gateway-infra(bdbaaffc-1a93-41df-9934-8015c863cadf)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf"
Jul 17 11:23:07.545592 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:23:07.545548    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf"
Jul 17 11:23:07.545949 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:23:07.545880    2563 scope.go:117] "RemoveContainer" containerID="d3c7b950ff15fe07e31ef49bbf683bce0c1ae94a01681f4f1c1eb7bd7490ac22"
Jul 17 11:23:07.546055 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:23:07.546034    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf_odh-ai-gateway-infra(bdbaaffc-1a93-41df-9934-8015c863cadf)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf"
Jul 17 11:23:20.259877 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:23:20.259849    2563 scope.go:117] "RemoveContainer" containerID="d3c7b950ff15fe07e31ef49bbf683bce0c1ae94a01681f4f1c1eb7bd7490ac22"
Jul 17 11:23:20.260263 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:23:20.260125    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 11:23:21.169317 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:23:21.169283    2563 generic.go:356] "Generic (PLEG): container finished" podID="bdbaaffc-1a93-41df-9934-8015c863cadf" containerID="55c08e3a1caa6a2f78bbf21ff507230e085dc41df381f3974a9708132a658f06" exitCode=1
Jul 17 11:23:21.169443 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:23:21.169355    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" event={"ID":"bdbaaffc-1a93-41df-9934-8015c863cadf","Type":"ContainerDied","Data":"55c08e3a1caa6a2f78bbf21ff507230e085dc41df381f3974a9708132a658f06"}
Jul 17 11:23:21.169443 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:23:21.169413    2563 scope.go:117] "RemoveContainer" containerID="d3c7b950ff15fe07e31ef49bbf683bce0c1ae94a01681f4f1c1eb7bd7490ac22"
Jul 17 11:23:21.169756 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:23:21.169738    2563 scope.go:117] "RemoveContainer" containerID="55c08e3a1caa6a2f78bbf21ff507230e085dc41df381f3974a9708132a658f06"
Jul 17 11:23:21.169935 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:23:21.169915    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf_odh-ai-gateway-infra(bdbaaffc-1a93-41df-9934-8015c863cadf)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf"
Jul 17 11:23:22.545335 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:23:22.545302    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf"
Jul 17 11:23:22.545758 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:23:22.545587    2563 scope.go:117] "RemoveContainer" containerID="55c08e3a1caa6a2f78bbf21ff507230e085dc41df381f3974a9708132a658f06"
Jul 17 11:23:22.545758 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:23:22.545726    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf_odh-ai-gateway-infra(bdbaaffc-1a93-41df-9934-8015c863cadf)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf"
Jul 17 11:23:27.545592 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:23:27.545553    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf"
Jul 17 11:23:27.545952 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:23:27.545871    2563 scope.go:117] "RemoveContainer" containerID="55c08e3a1caa6a2f78bbf21ff507230e085dc41df381f3974a9708132a658f06"
Jul 17 11:23:27.546032 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:23:27.546013    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf_odh-ai-gateway-infra(bdbaaffc-1a93-41df-9934-8015c863cadf)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf"
Jul 17 11:23:39.259455 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:23:39.259359    2563 scope.go:117] "RemoveContainer" containerID="55c08e3a1caa6a2f78bbf21ff507230e085dc41df381f3974a9708132a658f06"
Jul 17 11:23:39.259828 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:23:39.259560    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf_odh-ai-gateway-infra(bdbaaffc-1a93-41df-9934-8015c863cadf)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf"
Jul 17 11:23:50.259275 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:23:50.259251    2563 scope.go:117] "RemoveContainer" containerID="55c08e3a1caa6a2f78bbf21ff507230e085dc41df381f3974a9708132a658f06"
Jul 17 11:23:51.303613 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:23:51.303556    2563 generic.go:356] "Generic (PLEG): container finished" podID="bdbaaffc-1a93-41df-9934-8015c863cadf" containerID="f76090c2fda0efaeec25e0ca0f265eb2bcac09044f08207277eefe56daa1780d" exitCode=1
Jul 17 11:23:51.303914 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:23:51.303628    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" event={"ID":"bdbaaffc-1a93-41df-9934-8015c863cadf","Type":"ContainerDied","Data":"f76090c2fda0efaeec25e0ca0f265eb2bcac09044f08207277eefe56daa1780d"}
Jul 17 11:23:51.303914 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:23:51.303685    2563 scope.go:117] "RemoveContainer" containerID="55c08e3a1caa6a2f78bbf21ff507230e085dc41df381f3974a9708132a658f06"
Jul 17 11:23:51.303914 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:23:51.303901    2563 scope.go:117] "RemoveContainer" containerID="f76090c2fda0efaeec25e0ca0f265eb2bcac09044f08207277eefe56daa1780d"
Jul 17 11:23:51.304096 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:23:51.304076    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf_odh-ai-gateway-infra(bdbaaffc-1a93-41df-9934-8015c863cadf)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf"
Jul 17 11:23:52.546337 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:23:52.546308    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf"
Jul 17 11:23:52.546721 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:23:52.546645    2563 scope.go:117] "RemoveContainer" containerID="f76090c2fda0efaeec25e0ca0f265eb2bcac09044f08207277eefe56daa1780d"
Jul 17 11:23:52.546851 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:23:52.546830    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf_odh-ai-gateway-infra(bdbaaffc-1a93-41df-9934-8015c863cadf)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf"
Jul 17 11:23:57.545568 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:23:57.545539    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf"
Jul 17 11:23:57.546024 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:23:57.545968    2563 scope.go:117] "RemoveContainer" containerID="f76090c2fda0efaeec25e0ca0f265eb2bcac09044f08207277eefe56daa1780d"
Jul 17 11:23:57.546169 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:23:57.546147    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf_odh-ai-gateway-infra(bdbaaffc-1a93-41df-9934-8015c863cadf)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf"
Jul 17 11:24:12.259840 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:24:12.259813    2563 scope.go:117] "RemoveContainer" containerID="f76090c2fda0efaeec25e0ca0f265eb2bcac09044f08207277eefe56daa1780d"
Jul 17 11:24:12.260209 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:24:12.259970    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf_odh-ai-gateway-infra(bdbaaffc-1a93-41df-9934-8015c863cadf)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf"
Jul 17 11:24:24.259491 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:24:24.259466    2563 scope.go:117] "RemoveContainer" containerID="f76090c2fda0efaeec25e0ca0f265eb2bcac09044f08207277eefe56daa1780d"
Jul 17 11:24:24.259938 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:24:24.259628    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf_odh-ai-gateway-infra(bdbaaffc-1a93-41df-9934-8015c863cadf)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf"
Jul 17 11:24:39.259365 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:24:39.259336    2563 scope.go:117] "RemoveContainer" containerID="f76090c2fda0efaeec25e0ca0f265eb2bcac09044f08207277eefe56daa1780d"
Jul 17 11:24:40.511763 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:24:40.511729    2563 generic.go:356] "Generic (PLEG): container finished" podID="bdbaaffc-1a93-41df-9934-8015c863cadf" containerID="d50adf48205ec7825abff3a9d75396cb63fe386d5c504cd3e11d180dc79caa61" exitCode=1
Jul 17 11:24:40.512099 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:24:40.511802    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" event={"ID":"bdbaaffc-1a93-41df-9934-8015c863cadf","Type":"ContainerDied","Data":"d50adf48205ec7825abff3a9d75396cb63fe386d5c504cd3e11d180dc79caa61"}
Jul 17 11:24:40.512099 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:24:40.511858    2563 scope.go:117] "RemoveContainer" containerID="f76090c2fda0efaeec25e0ca0f265eb2bcac09044f08207277eefe56daa1780d"
Jul 17 11:24:40.512207 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:24:40.512138    2563 scope.go:117] "RemoveContainer" containerID="d50adf48205ec7825abff3a9d75396cb63fe386d5c504cd3e11d180dc79caa61"
Jul 17 11:24:40.512328 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:24:40.512309    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf_odh-ai-gateway-infra(bdbaaffc-1a93-41df-9934-8015c863cadf)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf"
Jul 17 11:24:42.545588 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:24:42.545561    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf"
Jul 17 11:24:42.545982 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:24:42.545844    2563 scope.go:117] "RemoveContainer" containerID="d50adf48205ec7825abff3a9d75396cb63fe386d5c504cd3e11d180dc79caa61"
Jul 17 11:24:42.546048 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:24:42.545994    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf_odh-ai-gateway-infra(bdbaaffc-1a93-41df-9934-8015c863cadf)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf"
Jul 17 11:24:47.545459 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:24:47.545413    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf"
Jul 17 11:24:47.545919 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:24:47.545880    2563 scope.go:117] "RemoveContainer" containerID="d50adf48205ec7825abff3a9d75396cb63fe386d5c504cd3e11d180dc79caa61"
Jul 17 11:24:47.546092 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:24:47.546067    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf_odh-ai-gateway-infra(bdbaaffc-1a93-41df-9934-8015c863cadf)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf"
Jul 17 11:25:00.259562 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:25:00.259536    2563 scope.go:117] "RemoveContainer" containerID="d50adf48205ec7825abff3a9d75396cb63fe386d5c504cd3e11d180dc79caa61"
Jul 17 11:25:00.259995 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:25:00.259707    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf_odh-ai-gateway-infra(bdbaaffc-1a93-41df-9934-8015c863cadf)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf"
Jul 17 11:25:12.259964 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:25:12.259893    2563 scope.go:117] "RemoveContainer" containerID="d50adf48205ec7825abff3a9d75396cb63fe386d5c504cd3e11d180dc79caa61"
Jul 17 11:25:12.260305 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:25:12.260101    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf_odh-ai-gateway-infra(bdbaaffc-1a93-41df-9934-8015c863cadf)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf"
Jul 17 11:25:25.262707 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:25:25.262672    2563 scope.go:117] "RemoveContainer" containerID="d50adf48205ec7825abff3a9d75396cb63fe386d5c504cd3e11d180dc79caa61"
Jul 17 11:25:25.263133 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:25:25.262874    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf_odh-ai-gateway-infra(bdbaaffc-1a93-41df-9934-8015c863cadf)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf"
Jul 17 11:25:36.259740 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:25:36.259713    2563 scope.go:117] "RemoveContainer" containerID="d50adf48205ec7825abff3a9d75396cb63fe386d5c504cd3e11d180dc79caa61"
Jul 17 11:25:36.260184 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:25:36.259860    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf_odh-ai-gateway-infra(bdbaaffc-1a93-41df-9934-8015c863cadf)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf"
Jul 17 11:25:50.259556 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:25:50.259512    2563 scope.go:117] "RemoveContainer" containerID="d50adf48205ec7825abff3a9d75396cb63fe386d5c504cd3e11d180dc79caa61"
Jul 17 11:25:50.259976 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:25:50.259735    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf_odh-ai-gateway-infra(bdbaaffc-1a93-41df-9934-8015c863cadf)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf"
Jul 17 11:26:02.259890 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:26:02.259861    2563 scope.go:117] "RemoveContainer" containerID="d50adf48205ec7825abff3a9d75396cb63fe386d5c504cd3e11d180dc79caa61"
Jul 17 11:26:02.860617 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:26:02.860586    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" event={"ID":"bdbaaffc-1a93-41df-9934-8015c863cadf","Type":"ContainerStarted","Data":"7790b4a98337de137bee306e7108840c36643c541a3949ec66a431eb69f8b669"}
Jul 17 11:26:02.860815 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:26:02.860796    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf"
Jul 17 11:26:02.879932 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:26:02.879887    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" podStartSLOduration=183.243568068 podStartE2EDuration="3m5.879869877s" totalImagesPullingTime="2.636301809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:22:57 +0000 UTC" imagePullSessionsCount=6 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:26:02.878882058 +0000 UTC m=+2028.059915037" watchObservedRunningTime="2026-07-17 11:26:02.879869877 +0000 UTC m=+2028.060902840"
Jul 17 11:26:03.012514 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:26:03.012481    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-76b5fcbfd-bt5lk_a2d69d0a-6d06-44c3-995b-b75a48582b92/manager/0.log"
Jul 17 11:26:03.866502 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:26:03.866474    2563 generic.go:356] "Generic (PLEG): container finished" podID="bdbaaffc-1a93-41df-9934-8015c863cadf" containerID="7790b4a98337de137bee306e7108840c36643c541a3949ec66a431eb69f8b669" exitCode=1
Jul 17 11:26:03.866857 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:26:03.866553    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" event={"ID":"bdbaaffc-1a93-41df-9934-8015c863cadf","Type":"ContainerDied","Data":"7790b4a98337de137bee306e7108840c36643c541a3949ec66a431eb69f8b669"}
Jul 17 11:26:03.866857 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:26:03.866616    2563 scope.go:117] "RemoveContainer" containerID="d50adf48205ec7825abff3a9d75396cb63fe386d5c504cd3e11d180dc79caa61"
Jul 17 11:26:03.866857 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:26:03.866714    2563 scope.go:117] "RemoveContainer" containerID="7790b4a98337de137bee306e7108840c36643c541a3949ec66a431eb69f8b669"
Jul 17 11:26:03.866975 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:26:03.866903    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf_odh-ai-gateway-infra(bdbaaffc-1a93-41df-9934-8015c863cadf)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf"
Jul 17 11:26:04.872618 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:26:04.872592    2563 scope.go:117] "RemoveContainer" containerID="7790b4a98337de137bee306e7108840c36643c541a3949ec66a431eb69f8b669"
Jul 17 11:26:04.872933 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:26:04.872753    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf_odh-ai-gateway-infra(bdbaaffc-1a93-41df-9934-8015c863cadf)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf"
Jul 17 11:26:07.546143 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:26:07.546116    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf"
Jul 17 11:26:07.546613 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:26:07.546401    2563 scope.go:117] "RemoveContainer" containerID="7790b4a98337de137bee306e7108840c36643c541a3949ec66a431eb69f8b669"
Jul 17 11:26:07.546613 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:26:07.546564    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf_odh-ai-gateway-infra(bdbaaffc-1a93-41df-9934-8015c863cadf)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf"
Jul 17 11:26:18.259669 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:26:18.259638    2563 scope.go:117] "RemoveContainer" containerID="7790b4a98337de137bee306e7108840c36643c541a3949ec66a431eb69f8b669"
Jul 17 11:26:18.260018 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:26:18.259793    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf_odh-ai-gateway-infra(bdbaaffc-1a93-41df-9934-8015c863cadf)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf"
Jul 17 11:26:33.259466 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:26:33.259420    2563 scope.go:117] "RemoveContainer" containerID="7790b4a98337de137bee306e7108840c36643c541a3949ec66a431eb69f8b669"
Jul 17 11:26:33.259889 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:26:33.259634    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf_odh-ai-gateway-infra(bdbaaffc-1a93-41df-9934-8015c863cadf)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf"
Jul 17 11:26:48.260169 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:26:48.260088    2563 scope.go:117] "RemoveContainer" containerID="7790b4a98337de137bee306e7108840c36643c541a3949ec66a431eb69f8b669"
Jul 17 11:26:48.260630 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:26:48.260245    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf_odh-ai-gateway-infra(bdbaaffc-1a93-41df-9934-8015c863cadf)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf"
Jul 17 11:26:59.259654 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:26:59.259621    2563 scope.go:117] "RemoveContainer" containerID="7790b4a98337de137bee306e7108840c36643c541a3949ec66a431eb69f8b669"
Jul 17 11:26:59.260012 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:26:59.259816    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf_odh-ai-gateway-infra(bdbaaffc-1a93-41df-9934-8015c863cadf)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf"
Jul 17 11:27:10.259658 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:27:10.259630    2563 scope.go:117] "RemoveContainer" containerID="7790b4a98337de137bee306e7108840c36643c541a3949ec66a431eb69f8b669"
Jul 17 11:27:10.260001 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:27:10.259778    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf_odh-ai-gateway-infra(bdbaaffc-1a93-41df-9934-8015c863cadf)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf"
Jul 17 11:27:15.355110 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:27:15.355080    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xdrhl_48cc1998-ebc5-4702-8b08-027479580e57/ovn-acl-logging/0.log"
Jul 17 11:27:15.361331 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:27:15.361311    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xdrhl_48cc1998-ebc5-4702-8b08-027479580e57/ovn-acl-logging/0.log"
Jul 17 11:27:22.259829 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:27:22.259799    2563 scope.go:117] "RemoveContainer" containerID="7790b4a98337de137bee306e7108840c36643c541a3949ec66a431eb69f8b669"
Jul 17 11:27:22.260272 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:27:22.259961    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf_odh-ai-gateway-infra(bdbaaffc-1a93-41df-9934-8015c863cadf)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf"
Jul 17 11:27:33.259695 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:27:33.259667    2563 scope.go:117] "RemoveContainer" containerID="7790b4a98337de137bee306e7108840c36643c541a3949ec66a431eb69f8b669"
Jul 17 11:27:33.260053 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:27:33.259837    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf_odh-ai-gateway-infra(bdbaaffc-1a93-41df-9934-8015c863cadf)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf"
Jul 17 11:27:48.259265 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:27:48.259235    2563 scope.go:117] "RemoveContainer" containerID="7790b4a98337de137bee306e7108840c36643c541a3949ec66a431eb69f8b669"
Jul 17 11:27:48.259671 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:27:48.259413    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf_odh-ai-gateway-infra(bdbaaffc-1a93-41df-9934-8015c863cadf)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf"
Jul 17 11:28:00.259745 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:28:00.259712    2563 scope.go:117] "RemoveContainer" containerID="7790b4a98337de137bee306e7108840c36643c541a3949ec66a431eb69f8b669"
Jul 17 11:28:00.260275 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:28:00.259888    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf_odh-ai-gateway-infra(bdbaaffc-1a93-41df-9934-8015c863cadf)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf"
Jul 17 11:28:15.261073 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:28:15.261002    2563 scope.go:117] "RemoveContainer" containerID="7790b4a98337de137bee306e7108840c36643c541a3949ec66a431eb69f8b669"
Jul 17 11:28:15.261538 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:28:15.261202    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf_odh-ai-gateway-infra(bdbaaffc-1a93-41df-9934-8015c863cadf)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf"
Jul 17 11:28:26.259189 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:28:26.259156    2563 scope.go:117] "RemoveContainer" containerID="7790b4a98337de137bee306e7108840c36643c541a3949ec66a431eb69f8b669"
Jul 17 11:28:26.259635 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:28:26.259363    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf_odh-ai-gateway-infra(bdbaaffc-1a93-41df-9934-8015c863cadf)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf"
Jul 17 11:28:39.259215 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:28:39.259177    2563 scope.go:117] "RemoveContainer" containerID="7790b4a98337de137bee306e7108840c36643c541a3949ec66a431eb69f8b669"
Jul 17 11:28:39.259671 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:28:39.259356    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf_odh-ai-gateway-infra(bdbaaffc-1a93-41df-9934-8015c863cadf)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf"
Jul 17 11:28:54.259701 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:28:54.259649    2563 scope.go:117] "RemoveContainer" containerID="7790b4a98337de137bee306e7108840c36643c541a3949ec66a431eb69f8b669"
Jul 17 11:28:54.260149 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:28:54.259944    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 11:28:55.614574 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:28:55.614539    2563 generic.go:356] "Generic (PLEG): container finished" podID="bdbaaffc-1a93-41df-9934-8015c863cadf" containerID="54545acc5fadb916e1e3d22167089ce81de11076f43b842b5000a2866d7d3f55" exitCode=1
Jul 17 11:28:55.615058 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:28:55.614604    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" event={"ID":"bdbaaffc-1a93-41df-9934-8015c863cadf","Type":"ContainerDied","Data":"54545acc5fadb916e1e3d22167089ce81de11076f43b842b5000a2866d7d3f55"}
Jul 17 11:28:55.615058 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:28:55.614665    2563 scope.go:117] "RemoveContainer" containerID="7790b4a98337de137bee306e7108840c36643c541a3949ec66a431eb69f8b669"
Jul 17 11:28:55.615058 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:28:55.614931    2563 scope.go:117] "RemoveContainer" containerID="54545acc5fadb916e1e3d22167089ce81de11076f43b842b5000a2866d7d3f55"
Jul 17 11:28:55.615196 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:28:55.615157    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf_odh-ai-gateway-infra(bdbaaffc-1a93-41df-9934-8015c863cadf)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf"
Jul 17 11:28:57.545618 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:28:57.545570    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf"
Jul 17 11:28:57.546025 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:28:57.545930    2563 scope.go:117] "RemoveContainer" containerID="54545acc5fadb916e1e3d22167089ce81de11076f43b842b5000a2866d7d3f55"
Jul 17 11:28:57.546143 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:28:57.546122    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf_odh-ai-gateway-infra(bdbaaffc-1a93-41df-9934-8015c863cadf)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf"
Jul 17 11:28:57.861732 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:28:57.861649    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf"
Jul 17 11:28:57.862044 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:28:57.862028    2563 scope.go:117] "RemoveContainer" containerID="54545acc5fadb916e1e3d22167089ce81de11076f43b842b5000a2866d7d3f55"
Jul 17 11:28:57.862235 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:28:57.862211    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf_odh-ai-gateway-infra(bdbaaffc-1a93-41df-9934-8015c863cadf)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf"
Jul 17 11:29:04.074657 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:04.074626    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-76b5fcbfd-bt5lk_a2d69d0a-6d06-44c3-995b-b75a48582b92/manager/0.log"
Jul 17 11:29:09.259227 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:09.259199    2563 scope.go:117] "RemoveContainer" containerID="54545acc5fadb916e1e3d22167089ce81de11076f43b842b5000a2866d7d3f55"
Jul 17 11:29:09.259694 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:29:09.259406    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf_odh-ai-gateway-infra(bdbaaffc-1a93-41df-9934-8015c863cadf)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf"
Jul 17 11:29:09.778841 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:09.778806    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf"]
Jul 17 11:29:09.916601 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:09.916578    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf"
Jul 17 11:29:10.065060 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:10.065027    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdbaaffc-1a93-41df-9934-8015c863cadf-openshift-service-ca\") pod \"bdbaaffc-1a93-41df-9934-8015c863cadf\" (UID: \"bdbaaffc-1a93-41df-9934-8015c863cadf\") "
Jul 17 11:29:10.065213 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:10.065093    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdbaaffc-1a93-41df-9934-8015c863cadf-maas-api-tls\") pod \"bdbaaffc-1a93-41df-9934-8015c863cadf\" (UID: \"bdbaaffc-1a93-41df-9934-8015c863cadf\") "
Jul 17 11:29:10.065280 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:10.065259    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wcl9j\" (UniqueName: \"kubernetes.io/projected/bdbaaffc-1a93-41df-9934-8015c863cadf-kube-api-access-wcl9j\") pod \"bdbaaffc-1a93-41df-9934-8015c863cadf\" (UID: \"bdbaaffc-1a93-41df-9934-8015c863cadf\") "
Jul 17 11:29:10.065381 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:10.065358    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdbaaffc-1a93-41df-9934-8015c863cadf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bdbaaffc-1a93-41df-9934-8015c863cadf" (UID: "bdbaaffc-1a93-41df-9934-8015c863cadf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:29:10.065588 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:10.065569    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdbaaffc-1a93-41df-9934-8015c863cadf-openshift-service-ca\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:29:10.067183 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:10.067159    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdbaaffc-1a93-41df-9934-8015c863cadf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bdbaaffc-1a93-41df-9934-8015c863cadf" (UID: "bdbaaffc-1a93-41df-9934-8015c863cadf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:29:10.067296 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:10.067222    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdbaaffc-1a93-41df-9934-8015c863cadf-kube-api-access-wcl9j" (OuterVolumeSpecName: "kube-api-access-wcl9j") pod "bdbaaffc-1a93-41df-9934-8015c863cadf" (UID: "bdbaaffc-1a93-41df-9934-8015c863cadf"). InnerVolumeSpecName "kube-api-access-wcl9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:29:10.166308 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:10.166289    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcl9j\" (UniqueName: \"kubernetes.io/projected/bdbaaffc-1a93-41df-9934-8015c863cadf-kube-api-access-wcl9j\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:29:10.166308 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:10.166308    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdbaaffc-1a93-41df-9934-8015c863cadf-maas-api-tls\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:29:10.685007 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:10.684976    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf" event={"ID":"bdbaaffc-1a93-41df-9934-8015c863cadf","Type":"ContainerDied","Data":"936fdb884e21798445596016e88b58dee3f03a89e7983e55fd4305b461e25790"}
Jul 17 11:29:10.685007 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:10.685008    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf"
Jul 17 11:29:10.685489 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:10.685044    2563 scope.go:117] "RemoveContainer" containerID="54545acc5fadb916e1e3d22167089ce81de11076f43b842b5000a2866d7d3f55"
Jul 17 11:29:10.708679 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:10.708657    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf"]
Jul 17 11:29:10.712044 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:10.712024    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-eac6ba90-fcf8585c9-nhgnf"]
Jul 17 11:29:11.264775 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:11.264734    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf" path="/var/lib/kubelet/pods/bdbaaffc-1a93-41df-9934-8015c863cadf/volumes"
Jul 17 11:29:18.052685 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:18.052650    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2"]
Jul 17 11:29:18.053190 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:18.053163    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf" containerName="maas-api"
Jul 17 11:29:18.053190 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:18.053188    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf" containerName="maas-api"
Jul 17 11:29:18.053421 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:18.053211    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf" containerName="maas-api"
Jul 17 11:29:18.053421 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:18.053220    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf" containerName="maas-api"
Jul 17 11:29:18.053421 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:18.053230    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76c7c2ef-4b21-4e97-a931-9a1888d3dfaa" containerName="maas-api"
Jul 17 11:29:18.053421 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:18.053235    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="76c7c2ef-4b21-4e97-a931-9a1888d3dfaa" containerName="maas-api"
Jul 17 11:29:18.053421 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:18.053241    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf" containerName="maas-api"
Jul 17 11:29:18.053421 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:18.053246    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf" containerName="maas-api"
Jul 17 11:29:18.053421 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:18.053253    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf" containerName="maas-api"
Jul 17 11:29:18.053421 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:18.053257    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf" containerName="maas-api"
Jul 17 11:29:18.053421 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:18.053276    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf" containerName="maas-api"
Jul 17 11:29:18.053421 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:18.053280    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf" containerName="maas-api"
Jul 17 11:29:18.053421 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:18.053291    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf" containerName="maas-api"
Jul 17 11:29:18.053421 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:18.053296    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf" containerName="maas-api"
Jul 17 11:29:18.053421 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:18.053362    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf" containerName="maas-api"
Jul 17 11:29:18.053421 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:18.053372    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf" containerName="maas-api"
Jul 17 11:29:18.053421 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:18.053383    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="76c7c2ef-4b21-4e97-a931-9a1888d3dfaa" containerName="maas-api"
Jul 17 11:29:18.053421 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:18.053391    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf" containerName="maas-api"
Jul 17 11:29:18.053421 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:18.053403    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf" containerName="maas-api"
Jul 17 11:29:18.053421 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:18.053415    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf" containerName="maas-api"
Jul 17 11:29:18.057960 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:18.057941    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2"
Jul 17 11:29:18.061497 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:18.061479    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-71832244-serving-cert\""
Jul 17 11:29:18.093238 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:18.093215    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2"]
Jul 17 11:29:18.122466 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:18.122420    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c755c0ef-4ffa-4146-8fb4-02e471a7ce52-maas-api-tls\") pod \"maas-api-e2e-derive-71832244-57bf697f64-ct9t2\" (UID: \"c755c0ef-4ffa-4146-8fb4-02e471a7ce52\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2"
Jul 17 11:29:18.122595 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:18.122482    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g48j9\" (UniqueName: \"kubernetes.io/projected/c755c0ef-4ffa-4146-8fb4-02e471a7ce52-kube-api-access-g48j9\") pod \"maas-api-e2e-derive-71832244-57bf697f64-ct9t2\" (UID: \"c755c0ef-4ffa-4146-8fb4-02e471a7ce52\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2"
Jul 17 11:29:18.122662 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:18.122623    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c755c0ef-4ffa-4146-8fb4-02e471a7ce52-openshift-service-ca\") pod \"maas-api-e2e-derive-71832244-57bf697f64-ct9t2\" (UID: \"c755c0ef-4ffa-4146-8fb4-02e471a7ce52\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2"
Jul 17 11:29:18.223389 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:18.223357    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c755c0ef-4ffa-4146-8fb4-02e471a7ce52-openshift-service-ca\") pod \"maas-api-e2e-derive-71832244-57bf697f64-ct9t2\" (UID: \"c755c0ef-4ffa-4146-8fb4-02e471a7ce52\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2"
Jul 17 11:29:18.223508 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:18.223465    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c755c0ef-4ffa-4146-8fb4-02e471a7ce52-maas-api-tls\") pod \"maas-api-e2e-derive-71832244-57bf697f64-ct9t2\" (UID: \"c755c0ef-4ffa-4146-8fb4-02e471a7ce52\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2"
Jul 17 11:29:18.223508 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:18.223488    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g48j9\" (UniqueName: \"kubernetes.io/projected/c755c0ef-4ffa-4146-8fb4-02e471a7ce52-kube-api-access-g48j9\") pod \"maas-api-e2e-derive-71832244-57bf697f64-ct9t2\" (UID: \"c755c0ef-4ffa-4146-8fb4-02e471a7ce52\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2"
Jul 17 11:29:18.223656 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:29:18.223634    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-71832244-serving-cert: secret "maas-api-e2e-derive-71832244-serving-cert" not found
Jul 17 11:29:18.223719 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:29:18.223708    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c755c0ef-4ffa-4146-8fb4-02e471a7ce52-maas-api-tls podName:c755c0ef-4ffa-4146-8fb4-02e471a7ce52 nodeName:}" failed. No retries permitted until 2026-07-17 11:29:18.723687925 +0000 UTC m=+2223.904720871 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c755c0ef-4ffa-4146-8fb4-02e471a7ce52-maas-api-tls") pod "maas-api-e2e-derive-71832244-57bf697f64-ct9t2" (UID: "c755c0ef-4ffa-4146-8fb4-02e471a7ce52") : secret "maas-api-e2e-derive-71832244-serving-cert" not found
Jul 17 11:29:18.223997 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:18.223980    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c755c0ef-4ffa-4146-8fb4-02e471a7ce52-openshift-service-ca\") pod \"maas-api-e2e-derive-71832244-57bf697f64-ct9t2\" (UID: \"c755c0ef-4ffa-4146-8fb4-02e471a7ce52\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2"
Jul 17 11:29:18.236839 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:18.236813    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g48j9\" (UniqueName: \"kubernetes.io/projected/c755c0ef-4ffa-4146-8fb4-02e471a7ce52-kube-api-access-g48j9\") pod \"maas-api-e2e-derive-71832244-57bf697f64-ct9t2\" (UID: \"c755c0ef-4ffa-4146-8fb4-02e471a7ce52\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2"
Jul 17 11:29:18.727949 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:18.727914    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c755c0ef-4ffa-4146-8fb4-02e471a7ce52-maas-api-tls\") pod \"maas-api-e2e-derive-71832244-57bf697f64-ct9t2\" (UID: \"c755c0ef-4ffa-4146-8fb4-02e471a7ce52\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2"
Jul 17 11:29:18.730203 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:18.730180    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c755c0ef-4ffa-4146-8fb4-02e471a7ce52-maas-api-tls\") pod \"maas-api-e2e-derive-71832244-57bf697f64-ct9t2\" (UID: \"c755c0ef-4ffa-4146-8fb4-02e471a7ce52\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2"
Jul 17 11:29:18.968869 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:18.968837    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2"
Jul 17 11:29:19.103717 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:19.103695    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2"]
Jul 17 11:29:19.106262 ip-10-0-143-12 kubenswrapper[2563]: W0717 11:29:19.106229    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc755c0ef_4ffa_4146_8fb4_02e471a7ce52.slice/crio-7e77fafa03d3e8e87ff4cf3712ae4df39e0b7834c52bcfee12f3b6d8753353b6 WatchSource:0}: Error finding container 7e77fafa03d3e8e87ff4cf3712ae4df39e0b7834c52bcfee12f3b6d8753353b6: Status 404 returned error can't find the container with id 7e77fafa03d3e8e87ff4cf3712ae4df39e0b7834c52bcfee12f3b6d8753353b6
Jul 17 11:29:19.728052 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:19.728019    2563 generic.go:356] "Generic (PLEG): container finished" podID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52" containerID="d5c1a1e25ecc91e80aafce2069204075ec950bb287edd9e32aee8c39b922b92a" exitCode=1
Jul 17 11:29:19.728167 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:19.728093    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2" event={"ID":"c755c0ef-4ffa-4146-8fb4-02e471a7ce52","Type":"ContainerDied","Data":"d5c1a1e25ecc91e80aafce2069204075ec950bb287edd9e32aee8c39b922b92a"}
Jul 17 11:29:19.728167 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:19.728145    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2" event={"ID":"c755c0ef-4ffa-4146-8fb4-02e471a7ce52","Type":"ContainerStarted","Data":"7e77fafa03d3e8e87ff4cf3712ae4df39e0b7834c52bcfee12f3b6d8753353b6"}
Jul 17 11:29:19.728357 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:19.728345    2563 scope.go:117] "RemoveContainer" containerID="d5c1a1e25ecc91e80aafce2069204075ec950bb287edd9e32aee8c39b922b92a"
Jul 17 11:29:20.733925 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:20.733889    2563 generic.go:356] "Generic (PLEG): container finished" podID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52" containerID="87fe40f866dd653ce17c956c03611b74ecc31657a03d444b5b7e284f4a70650f" exitCode=1
Jul 17 11:29:20.734352 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:20.733969    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2" event={"ID":"c755c0ef-4ffa-4146-8fb4-02e471a7ce52","Type":"ContainerDied","Data":"87fe40f866dd653ce17c956c03611b74ecc31657a03d444b5b7e284f4a70650f"}
Jul 17 11:29:20.734352 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:20.734031    2563 scope.go:117] "RemoveContainer" containerID="d5c1a1e25ecc91e80aafce2069204075ec950bb287edd9e32aee8c39b922b92a"
Jul 17 11:29:20.734352 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:20.734284    2563 scope.go:117] "RemoveContainer" containerID="87fe40f866dd653ce17c956c03611b74ecc31657a03d444b5b7e284f4a70650f"
Jul 17 11:29:20.734555 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:29:20.734536    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-derive-71832244-57bf697f64-ct9t2_odh-ai-gateway-infra(c755c0ef-4ffa-4146-8fb4-02e471a7ce52)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52"
Jul 17 11:29:21.740723 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:21.740687    2563 scope.go:117] "RemoveContainer" containerID="87fe40f866dd653ce17c956c03611b74ecc31657a03d444b5b7e284f4a70650f"
Jul 17 11:29:21.741108 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:29:21.740851    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-derive-71832244-57bf697f64-ct9t2_odh-ai-gateway-infra(c755c0ef-4ffa-4146-8fb4-02e471a7ce52)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52"
Jul 17 11:29:23.969670 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:23.969637    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2"
Jul 17 11:29:23.970119 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:23.970062    2563 scope.go:117] "RemoveContainer" containerID="87fe40f866dd653ce17c956c03611b74ecc31657a03d444b5b7e284f4a70650f"
Jul 17 11:29:23.970268 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:29:23.970245    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-derive-71832244-57bf697f64-ct9t2_odh-ai-gateway-infra(c755c0ef-4ffa-4146-8fb4-02e471a7ce52)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52"
Jul 17 11:29:28.969814 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:28.969783    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2"
Jul 17 11:29:28.970169 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:28.970138    2563 scope.go:117] "RemoveContainer" containerID="87fe40f866dd653ce17c956c03611b74ecc31657a03d444b5b7e284f4a70650f"
Jul 17 11:29:28.970313 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:29:28.970293    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-derive-71832244-57bf697f64-ct9t2_odh-ai-gateway-infra(c755c0ef-4ffa-4146-8fb4-02e471a7ce52)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52"
Jul 17 11:29:43.259645 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:43.259612    2563 scope.go:117] "RemoveContainer" containerID="87fe40f866dd653ce17c956c03611b74ecc31657a03d444b5b7e284f4a70650f"
Jul 17 11:29:43.839354 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:43.839268    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2" event={"ID":"c755c0ef-4ffa-4146-8fb4-02e471a7ce52","Type":"ContainerStarted","Data":"25a6f23938903175a2698707b328906ac383ced7ad4c7775dc0766fc04d37acc"}
Jul 17 11:29:43.839559 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:43.839487    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2"
Jul 17 11:29:43.860366 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:43.860321    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2" podStartSLOduration=24.70115812 podStartE2EDuration="25.860306608s" totalImagesPullingTime="1.159148488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:29:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:29:43.858904413 +0000 UTC m=+2249.039937378" watchObservedRunningTime="2026-07-17 11:29:43.860306608 +0000 UTC m=+2249.041339570"
Jul 17 11:29:44.845381 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:44.845345    2563 generic.go:356] "Generic (PLEG): container finished" podID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52" containerID="25a6f23938903175a2698707b328906ac383ced7ad4c7775dc0766fc04d37acc" exitCode=1
Jul 17 11:29:44.845818 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:44.845453    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2" event={"ID":"c755c0ef-4ffa-4146-8fb4-02e471a7ce52","Type":"ContainerDied","Data":"25a6f23938903175a2698707b328906ac383ced7ad4c7775dc0766fc04d37acc"}
Jul 17 11:29:44.845818 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:44.845511    2563 scope.go:117] "RemoveContainer" containerID="87fe40f866dd653ce17c956c03611b74ecc31657a03d444b5b7e284f4a70650f"
Jul 17 11:29:44.845818 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:44.845703    2563 scope.go:117] "RemoveContainer" containerID="25a6f23938903175a2698707b328906ac383ced7ad4c7775dc0766fc04d37acc"
Jul 17 11:29:44.845975 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:29:44.845931    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-derive-71832244-57bf697f64-ct9t2_odh-ai-gateway-infra(c755c0ef-4ffa-4146-8fb4-02e471a7ce52)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52"
Jul 17 11:29:45.854673 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:45.854629    2563 scope.go:117] "RemoveContainer" containerID="25a6f23938903175a2698707b328906ac383ced7ad4c7775dc0766fc04d37acc"
Jul 17 11:29:45.855053 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:29:45.854796    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-derive-71832244-57bf697f64-ct9t2_odh-ai-gateway-infra(c755c0ef-4ffa-4146-8fb4-02e471a7ce52)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52"
Jul 17 11:29:48.969090 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:48.969059    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2"
Jul 17 11:29:48.969512 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:29:48.969495    2563 scope.go:117] "RemoveContainer" containerID="25a6f23938903175a2698707b328906ac383ced7ad4c7775dc0766fc04d37acc"
Jul 17 11:29:48.969717 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:29:48.969694    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-derive-71832244-57bf697f64-ct9t2_odh-ai-gateway-infra(c755c0ef-4ffa-4146-8fb4-02e471a7ce52)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52"
Jul 17 11:30:03.259524 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:30:03.259497    2563 scope.go:117] "RemoveContainer" containerID="25a6f23938903175a2698707b328906ac383ced7ad4c7775dc0766fc04d37acc"
Jul 17 11:30:03.259896 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:30:03.259659    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-derive-71832244-57bf697f64-ct9t2_odh-ai-gateway-infra(c755c0ef-4ffa-4146-8fb4-02e471a7ce52)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52"
Jul 17 11:30:14.260000 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:30:14.259971    2563 scope.go:117] "RemoveContainer" containerID="25a6f23938903175a2698707b328906ac383ced7ad4c7775dc0766fc04d37acc"
Jul 17 11:30:14.984342 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:30:14.984306    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2" event={"ID":"c755c0ef-4ffa-4146-8fb4-02e471a7ce52","Type":"ContainerStarted","Data":"a68c9bdfd232e24a9232d060fb33472a959fbd7cc72cb2256eea4af107e58724"}
Jul 17 11:30:14.984704 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:30:14.984685    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2"
Jul 17 11:30:15.990371 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:30:15.990326    2563 generic.go:356] "Generic (PLEG): container finished" podID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52" containerID="a68c9bdfd232e24a9232d060fb33472a959fbd7cc72cb2256eea4af107e58724" exitCode=1
Jul 17 11:30:15.990812 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:30:15.990389    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2" event={"ID":"c755c0ef-4ffa-4146-8fb4-02e471a7ce52","Type":"ContainerDied","Data":"a68c9bdfd232e24a9232d060fb33472a959fbd7cc72cb2256eea4af107e58724"}
Jul 17 11:30:15.990812 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:30:15.990466    2563 scope.go:117] "RemoveContainer" containerID="25a6f23938903175a2698707b328906ac383ced7ad4c7775dc0766fc04d37acc"
Jul 17 11:30:15.990812 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:30:15.990671    2563 scope.go:117] "RemoveContainer" containerID="a68c9bdfd232e24a9232d060fb33472a959fbd7cc72cb2256eea4af107e58724"
Jul 17 11:30:15.990948 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:30:15.990898    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-derive-71832244-57bf697f64-ct9t2_odh-ai-gateway-infra(c755c0ef-4ffa-4146-8fb4-02e471a7ce52)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52"
Jul 17 11:30:16.997025 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:30:16.996997    2563 scope.go:117] "RemoveContainer" containerID="a68c9bdfd232e24a9232d060fb33472a959fbd7cc72cb2256eea4af107e58724"
Jul 17 11:30:16.997395 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:30:16.997161    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-derive-71832244-57bf697f64-ct9t2_odh-ai-gateway-infra(c755c0ef-4ffa-4146-8fb4-02e471a7ce52)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52"
Jul 17 11:30:18.969982 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:30:18.969944    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2"
Jul 17 11:30:18.970353 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:30:18.970310    2563 scope.go:117] "RemoveContainer" containerID="a68c9bdfd232e24a9232d060fb33472a959fbd7cc72cb2256eea4af107e58724"
Jul 17 11:30:18.970538 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:30:18.970518    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-derive-71832244-57bf697f64-ct9t2_odh-ai-gateway-infra(c755c0ef-4ffa-4146-8fb4-02e471a7ce52)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52"
Jul 17 11:30:31.259500 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:30:31.259468    2563 scope.go:117] "RemoveContainer" containerID="a68c9bdfd232e24a9232d060fb33472a959fbd7cc72cb2256eea4af107e58724"
Jul 17 11:30:31.259967 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:30:31.259642    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-derive-71832244-57bf697f64-ct9t2_odh-ai-gateway-infra(c755c0ef-4ffa-4146-8fb4-02e471a7ce52)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52"
Jul 17 11:30:46.259457 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:30:46.259398    2563 scope.go:117] "RemoveContainer" containerID="a68c9bdfd232e24a9232d060fb33472a959fbd7cc72cb2256eea4af107e58724"
Jul 17 11:30:46.260052 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:30:46.259674    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-derive-71832244-57bf697f64-ct9t2_odh-ai-gateway-infra(c755c0ef-4ffa-4146-8fb4-02e471a7ce52)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52"
Jul 17 11:30:58.259685 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:30:58.259656    2563 scope.go:117] "RemoveContainer" containerID="a68c9bdfd232e24a9232d060fb33472a959fbd7cc72cb2256eea4af107e58724"
Jul 17 11:30:59.184415 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:30:59.184340    2563 generic.go:356] "Generic (PLEG): container finished" podID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52" containerID="5c302c5efa1e92a937e05bfbac3388f32342484a82cd84953bd04e25e34cac0c" exitCode=1
Jul 17 11:30:59.184573 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:30:59.184413    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2" event={"ID":"c755c0ef-4ffa-4146-8fb4-02e471a7ce52","Type":"ContainerDied","Data":"5c302c5efa1e92a937e05bfbac3388f32342484a82cd84953bd04e25e34cac0c"}
Jul 17 11:30:59.184573 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:30:59.184499    2563 scope.go:117] "RemoveContainer" containerID="a68c9bdfd232e24a9232d060fb33472a959fbd7cc72cb2256eea4af107e58724"
Jul 17 11:30:59.184872 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:30:59.184854    2563 scope.go:117] "RemoveContainer" containerID="5c302c5efa1e92a937e05bfbac3388f32342484a82cd84953bd04e25e34cac0c"
Jul 17 11:30:59.185078 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:30:59.185049    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-71832244-57bf697f64-ct9t2_odh-ai-gateway-infra(c755c0ef-4ffa-4146-8fb4-02e471a7ce52)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52"
Jul 17 11:30:59.985204 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:30:59.985174    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2"
Jul 17 11:31:00.190615 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:31:00.190588    2563 scope.go:117] "RemoveContainer" containerID="5c302c5efa1e92a937e05bfbac3388f32342484a82cd84953bd04e25e34cac0c"
Jul 17 11:31:00.190776 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:31:00.190757    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-71832244-57bf697f64-ct9t2_odh-ai-gateway-infra(c755c0ef-4ffa-4146-8fb4-02e471a7ce52)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52"
Jul 17 11:31:08.969758 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:31:08.969669    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2"
Jul 17 11:31:08.970093 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:31:08.970016    2563 scope.go:117] "RemoveContainer" containerID="5c302c5efa1e92a937e05bfbac3388f32342484a82cd84953bd04e25e34cac0c"
Jul 17 11:31:08.970206 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:31:08.970185    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-71832244-57bf697f64-ct9t2_odh-ai-gateway-infra(c755c0ef-4ffa-4146-8fb4-02e471a7ce52)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52"
Jul 17 11:31:19.260098 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:31:19.260065    2563 scope.go:117] "RemoveContainer" containerID="5c302c5efa1e92a937e05bfbac3388f32342484a82cd84953bd04e25e34cac0c"
Jul 17 11:31:19.260589 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:31:19.260277    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-71832244-57bf697f64-ct9t2_odh-ai-gateway-infra(c755c0ef-4ffa-4146-8fb4-02e471a7ce52)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52"
Jul 17 11:31:32.259028 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:31:32.258996    2563 scope.go:117] "RemoveContainer" containerID="5c302c5efa1e92a937e05bfbac3388f32342484a82cd84953bd04e25e34cac0c"
Jul 17 11:31:32.259416 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:31:32.259157    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-71832244-57bf697f64-ct9t2_odh-ai-gateway-infra(c755c0ef-4ffa-4146-8fb4-02e471a7ce52)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52"
Jul 17 11:31:46.259696 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:31:46.259663    2563 scope.go:117] "RemoveContainer" containerID="5c302c5efa1e92a937e05bfbac3388f32342484a82cd84953bd04e25e34cac0c"
Jul 17 11:31:46.260047 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:31:46.259822    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-71832244-57bf697f64-ct9t2_odh-ai-gateway-infra(c755c0ef-4ffa-4146-8fb4-02e471a7ce52)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52"
Jul 17 11:31:57.259360 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:31:57.259321    2563 scope.go:117] "RemoveContainer" containerID="5c302c5efa1e92a937e05bfbac3388f32342484a82cd84953bd04e25e34cac0c"
Jul 17 11:31:57.259929 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:31:57.259541    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-71832244-57bf697f64-ct9t2_odh-ai-gateway-infra(c755c0ef-4ffa-4146-8fb4-02e471a7ce52)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52"
Jul 17 11:32:08.259749 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:32:08.259716    2563 scope.go:117] "RemoveContainer" containerID="5c302c5efa1e92a937e05bfbac3388f32342484a82cd84953bd04e25e34cac0c"
Jul 17 11:32:08.260122 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:32:08.259904    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-71832244-57bf697f64-ct9t2_odh-ai-gateway-infra(c755c0ef-4ffa-4146-8fb4-02e471a7ce52)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52"
Jul 17 11:32:15.381272 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:32:15.381243    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xdrhl_48cc1998-ebc5-4702-8b08-027479580e57/ovn-acl-logging/0.log"
Jul 17 11:32:15.388331 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:32:15.388310    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xdrhl_48cc1998-ebc5-4702-8b08-027479580e57/ovn-acl-logging/0.log"
Jul 17 11:32:22.259658 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:32:22.259628    2563 scope.go:117] "RemoveContainer" containerID="5c302c5efa1e92a937e05bfbac3388f32342484a82cd84953bd04e25e34cac0c"
Jul 17 11:32:23.147817 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:32:23.147783    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-76b5fcbfd-bt5lk_a2d69d0a-6d06-44c3-995b-b75a48582b92/manager/0.log"
Jul 17 11:32:23.558159 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:32:23.558063    2563 generic.go:356] "Generic (PLEG): container finished" podID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52" containerID="4b7092d99efd9898086187249076a4f9a4fc8f679f214fe5abfd7df32edecad4" exitCode=1
Jul 17 11:32:23.558159 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:32:23.558104    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2" event={"ID":"c755c0ef-4ffa-4146-8fb4-02e471a7ce52","Type":"ContainerDied","Data":"4b7092d99efd9898086187249076a4f9a4fc8f679f214fe5abfd7df32edecad4"}
Jul 17 11:32:23.558159 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:32:23.558153    2563 scope.go:117] "RemoveContainer" containerID="5c302c5efa1e92a937e05bfbac3388f32342484a82cd84953bd04e25e34cac0c"
Jul 17 11:32:23.558761 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:32:23.558546    2563 scope.go:117] "RemoveContainer" containerID="4b7092d99efd9898086187249076a4f9a4fc8f679f214fe5abfd7df32edecad4"
Jul 17 11:32:23.558761 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:32:23.558733    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-derive-71832244-57bf697f64-ct9t2_odh-ai-gateway-infra(c755c0ef-4ffa-4146-8fb4-02e471a7ce52)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52"
Jul 17 11:32:24.985599 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:32:24.985549    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2"
Jul 17 11:32:24.986013 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:32:24.985997    2563 scope.go:117] "RemoveContainer" containerID="4b7092d99efd9898086187249076a4f9a4fc8f679f214fe5abfd7df32edecad4"
Jul 17 11:32:24.986195 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:32:24.986176    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-derive-71832244-57bf697f64-ct9t2_odh-ai-gateway-infra(c755c0ef-4ffa-4146-8fb4-02e471a7ce52)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52"
Jul 17 11:32:28.969950 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:32:28.969916    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2"
Jul 17 11:32:28.970364 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:32:28.970284    2563 scope.go:117] "RemoveContainer" containerID="4b7092d99efd9898086187249076a4f9a4fc8f679f214fe5abfd7df32edecad4"
Jul 17 11:32:28.970495 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:32:28.970475    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-derive-71832244-57bf697f64-ct9t2_odh-ai-gateway-infra(c755c0ef-4ffa-4146-8fb4-02e471a7ce52)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52"
Jul 17 11:32:29.308574 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:32:29.308486    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2"]
Jul 17 11:32:29.720910 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:32:29.720883    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2"
Jul 17 11:32:29.765872 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:32:29.765838    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c755c0ef-4ffa-4146-8fb4-02e471a7ce52-maas-api-tls\") pod \"c755c0ef-4ffa-4146-8fb4-02e471a7ce52\" (UID: \"c755c0ef-4ffa-4146-8fb4-02e471a7ce52\") "
Jul 17 11:32:29.766026 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:32:29.765893    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g48j9\" (UniqueName: \"kubernetes.io/projected/c755c0ef-4ffa-4146-8fb4-02e471a7ce52-kube-api-access-g48j9\") pod \"c755c0ef-4ffa-4146-8fb4-02e471a7ce52\" (UID: \"c755c0ef-4ffa-4146-8fb4-02e471a7ce52\") "
Jul 17 11:32:29.766100 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:32:29.766066    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c755c0ef-4ffa-4146-8fb4-02e471a7ce52-openshift-service-ca\") pod \"c755c0ef-4ffa-4146-8fb4-02e471a7ce52\" (UID: \"c755c0ef-4ffa-4146-8fb4-02e471a7ce52\") "
Jul 17 11:32:29.766506 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:32:29.766463    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c755c0ef-4ffa-4146-8fb4-02e471a7ce52-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c755c0ef-4ffa-4146-8fb4-02e471a7ce52" (UID: "c755c0ef-4ffa-4146-8fb4-02e471a7ce52"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:32:29.767902 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:32:29.767879    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c755c0ef-4ffa-4146-8fb4-02e471a7ce52-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c755c0ef-4ffa-4146-8fb4-02e471a7ce52" (UID: "c755c0ef-4ffa-4146-8fb4-02e471a7ce52"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:32:29.767988 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:32:29.767876    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c755c0ef-4ffa-4146-8fb4-02e471a7ce52-kube-api-access-g48j9" (OuterVolumeSpecName: "kube-api-access-g48j9") pod "c755c0ef-4ffa-4146-8fb4-02e471a7ce52" (UID: "c755c0ef-4ffa-4146-8fb4-02e471a7ce52"). InnerVolumeSpecName "kube-api-access-g48j9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:32:29.867165 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:32:29.867102    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c755c0ef-4ffa-4146-8fb4-02e471a7ce52-openshift-service-ca\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:32:29.867165 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:32:29.867129    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c755c0ef-4ffa-4146-8fb4-02e471a7ce52-maas-api-tls\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:32:29.867165 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:32:29.867138    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g48j9\" (UniqueName: \"kubernetes.io/projected/c755c0ef-4ffa-4146-8fb4-02e471a7ce52-kube-api-access-g48j9\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:32:30.592444 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:32:30.592386    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2"
Jul 17 11:32:30.592819 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:32:30.592454    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2" event={"ID":"c755c0ef-4ffa-4146-8fb4-02e471a7ce52","Type":"ContainerDied","Data":"7e77fafa03d3e8e87ff4cf3712ae4df39e0b7834c52bcfee12f3b6d8753353b6"}
Jul 17 11:32:30.592819 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:32:30.592512    2563 scope.go:117] "RemoveContainer" containerID="4b7092d99efd9898086187249076a4f9a4fc8f679f214fe5abfd7df32edecad4"
Jul 17 11:32:30.614412 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:32:30.614385    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2"]
Jul 17 11:32:30.617962 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:32:30.617941    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-71832244-57bf697f64-ct9t2"]
Jul 17 11:32:31.265128 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:32:31.265092    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52" path="/var/lib/kubelet/pods/c755c0ef-4ffa-4146-8fb4-02e471a7ce52/volumes"
Jul 17 11:34:17.769046 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:17.768961    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ff1f9608-557f77dc95-b2xfz"]
Jul 17 11:34:17.769615 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:17.769488    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52" containerName="maas-api"
Jul 17 11:34:17.769615 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:17.769508    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52" containerName="maas-api"
Jul 17 11:34:17.769615 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:17.769523    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52" containerName="maas-api"
Jul 17 11:34:17.769615 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:17.769532    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52" containerName="maas-api"
Jul 17 11:34:17.769615 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:17.769545    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52" containerName="maas-api"
Jul 17 11:34:17.769615 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:17.769554    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52" containerName="maas-api"
Jul 17 11:34:17.769615 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:17.769570    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52" containerName="maas-api"
Jul 17 11:34:17.769615 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:17.769579    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52" containerName="maas-api"
Jul 17 11:34:17.769615 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:17.769616    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf" containerName="maas-api"
Jul 17 11:34:17.770061 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:17.769624    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf" containerName="maas-api"
Jul 17 11:34:17.770061 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:17.769698    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf" containerName="maas-api"
Jul 17 11:34:17.770061 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:17.769709    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52" containerName="maas-api"
Jul 17 11:34:17.770061 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:17.769720    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52" containerName="maas-api"
Jul 17 11:34:17.770061 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:17.769728    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52" containerName="maas-api"
Jul 17 11:34:17.770061 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:17.769738    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52" containerName="maas-api"
Jul 17 11:34:17.770061 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:17.769750    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="76c7c2ef-4b21-4e97-a931-9a1888d3dfaa" containerName="maas-api"
Jul 17 11:34:17.772996 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:17.772975    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff1f9608-557f77dc95-b2xfz"
Jul 17 11:34:17.775906 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:17.775882    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-ff1f9608-serving-cert\""
Jul 17 11:34:17.790901 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:17.790881    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ff1f9608-557f77dc95-b2xfz"]
Jul 17 11:34:17.875545 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:17.875510    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/956c52fe-df2a-4197-8bd6-3398c0eeba79-openshift-service-ca\") pod \"maas-api-e2e-mt-ff1f9608-557f77dc95-b2xfz\" (UID: \"956c52fe-df2a-4197-8bd6-3398c0eeba79\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff1f9608-557f77dc95-b2xfz"
Jul 17 11:34:17.875671 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:17.875566    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/956c52fe-df2a-4197-8bd6-3398c0eeba79-maas-api-tls\") pod \"maas-api-e2e-mt-ff1f9608-557f77dc95-b2xfz\" (UID: \"956c52fe-df2a-4197-8bd6-3398c0eeba79\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff1f9608-557f77dc95-b2xfz"
Jul 17 11:34:17.875671 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:17.875632    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzlbj\" (UniqueName: \"kubernetes.io/projected/956c52fe-df2a-4197-8bd6-3398c0eeba79-kube-api-access-zzlbj\") pod \"maas-api-e2e-mt-ff1f9608-557f77dc95-b2xfz\" (UID: \"956c52fe-df2a-4197-8bd6-3398c0eeba79\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff1f9608-557f77dc95-b2xfz"
Jul 17 11:34:17.976389 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:17.976318    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/956c52fe-df2a-4197-8bd6-3398c0eeba79-maas-api-tls\") pod \"maas-api-e2e-mt-ff1f9608-557f77dc95-b2xfz\" (UID: \"956c52fe-df2a-4197-8bd6-3398c0eeba79\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff1f9608-557f77dc95-b2xfz"
Jul 17 11:34:17.976703 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:17.976446    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzlbj\" (UniqueName: \"kubernetes.io/projected/956c52fe-df2a-4197-8bd6-3398c0eeba79-kube-api-access-zzlbj\") pod \"maas-api-e2e-mt-ff1f9608-557f77dc95-b2xfz\" (UID: \"956c52fe-df2a-4197-8bd6-3398c0eeba79\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff1f9608-557f77dc95-b2xfz"
Jul 17 11:34:17.976703 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:17.976510    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/956c52fe-df2a-4197-8bd6-3398c0eeba79-openshift-service-ca\") pod \"maas-api-e2e-mt-ff1f9608-557f77dc95-b2xfz\" (UID: \"956c52fe-df2a-4197-8bd6-3398c0eeba79\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff1f9608-557f77dc95-b2xfz"
Jul 17 11:34:17.976703 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:34:17.976517    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-ff1f9608-serving-cert: secret "maas-api-e2e-mt-ff1f9608-serving-cert" not found
Jul 17 11:34:17.976703 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:34:17.976627    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/956c52fe-df2a-4197-8bd6-3398c0eeba79-maas-api-tls podName:956c52fe-df2a-4197-8bd6-3398c0eeba79 nodeName:}" failed. No retries permitted until 2026-07-17 11:34:18.4765884 +0000 UTC m=+2523.657621342 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/956c52fe-df2a-4197-8bd6-3398c0eeba79-maas-api-tls") pod "maas-api-e2e-mt-ff1f9608-557f77dc95-b2xfz" (UID: "956c52fe-df2a-4197-8bd6-3398c0eeba79") : secret "maas-api-e2e-mt-ff1f9608-serving-cert" not found
Jul 17 11:34:17.977308 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:17.977278    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/956c52fe-df2a-4197-8bd6-3398c0eeba79-openshift-service-ca\") pod \"maas-api-e2e-mt-ff1f9608-557f77dc95-b2xfz\" (UID: \"956c52fe-df2a-4197-8bd6-3398c0eeba79\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff1f9608-557f77dc95-b2xfz"
Jul 17 11:34:17.986056 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:17.986014    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzlbj\" (UniqueName: \"kubernetes.io/projected/956c52fe-df2a-4197-8bd6-3398c0eeba79-kube-api-access-zzlbj\") pod \"maas-api-e2e-mt-ff1f9608-557f77dc95-b2xfz\" (UID: \"956c52fe-df2a-4197-8bd6-3398c0eeba79\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff1f9608-557f77dc95-b2xfz"
Jul 17 11:34:18.482517 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:18.482469    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/956c52fe-df2a-4197-8bd6-3398c0eeba79-maas-api-tls\") pod \"maas-api-e2e-mt-ff1f9608-557f77dc95-b2xfz\" (UID: \"956c52fe-df2a-4197-8bd6-3398c0eeba79\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff1f9608-557f77dc95-b2xfz"
Jul 17 11:34:18.482737 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:34:18.482648    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-ff1f9608-serving-cert: secret "maas-api-e2e-mt-ff1f9608-serving-cert" not found
Jul 17 11:34:18.482805 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:34:18.482741    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/956c52fe-df2a-4197-8bd6-3398c0eeba79-maas-api-tls podName:956c52fe-df2a-4197-8bd6-3398c0eeba79 nodeName:}" failed. No retries permitted until 2026-07-17 11:34:19.482718868 +0000 UTC m=+2524.663751828 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/956c52fe-df2a-4197-8bd6-3398c0eeba79-maas-api-tls") pod "maas-api-e2e-mt-ff1f9608-557f77dc95-b2xfz" (UID: "956c52fe-df2a-4197-8bd6-3398c0eeba79") : secret "maas-api-e2e-mt-ff1f9608-serving-cert" not found
Jul 17 11:34:19.493640 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:19.493595    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/956c52fe-df2a-4197-8bd6-3398c0eeba79-maas-api-tls\") pod \"maas-api-e2e-mt-ff1f9608-557f77dc95-b2xfz\" (UID: \"956c52fe-df2a-4197-8bd6-3398c0eeba79\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff1f9608-557f77dc95-b2xfz"
Jul 17 11:34:19.496287 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:19.496258    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/956c52fe-df2a-4197-8bd6-3398c0eeba79-maas-api-tls\") pod \"maas-api-e2e-mt-ff1f9608-557f77dc95-b2xfz\" (UID: \"956c52fe-df2a-4197-8bd6-3398c0eeba79\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff1f9608-557f77dc95-b2xfz"
Jul 17 11:34:19.585984 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:19.585933    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff1f9608-557f77dc95-b2xfz"
Jul 17 11:34:19.764983 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:19.764937    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ff1f9608-557f77dc95-b2xfz"]
Jul 17 11:34:19.767301 ip-10-0-143-12 kubenswrapper[2563]: W0717 11:34:19.767264    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod956c52fe_df2a_4197_8bd6_3398c0eeba79.slice/crio-ebb22e2cb46ca6efa5d2ee84c136384615f40f9a10af83754301758c0f226446 WatchSource:0}: Error finding container ebb22e2cb46ca6efa5d2ee84c136384615f40f9a10af83754301758c0f226446: Status 404 returned error can't find the container with id ebb22e2cb46ca6efa5d2ee84c136384615f40f9a10af83754301758c0f226446
Jul 17 11:34:19.771696 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:19.771663    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 11:34:20.120670 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:20.120566    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff1f9608-557f77dc95-b2xfz" event={"ID":"956c52fe-df2a-4197-8bd6-3398c0eeba79","Type":"ContainerStarted","Data":"ebb22e2cb46ca6efa5d2ee84c136384615f40f9a10af83754301758c0f226446"}
Jul 17 11:34:21.128261 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:21.128213    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff1f9608-557f77dc95-b2xfz" event={"ID":"956c52fe-df2a-4197-8bd6-3398c0eeba79","Type":"ContainerStarted","Data":"12281590b8377749eb7c67dea43a3b0e89183bf73ff90090eda2f9664a092547"}
Jul 17 11:34:21.128754 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:21.128357    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff1f9608-557f77dc95-b2xfz"
Jul 17 11:34:21.147292 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:21.147228    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff1f9608-557f77dc95-b2xfz" podStartSLOduration=3.71692487 podStartE2EDuration="4.14720674s" totalImagesPullingTime="430.28187ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:34:21.145394552 +0000 UTC m=+2526.326427515" watchObservedRunningTime="2026-07-17 11:34:21.14720674 +0000 UTC m=+2526.328239703"
Jul 17 11:34:27.140321 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:27.140283    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff1f9608-557f77dc95-b2xfz"
Jul 17 11:34:40.461249 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:40.461206    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ff1f9608-557f77dc95-b2xfz"]
Jul 17 11:34:40.461728 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:40.461531    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff1f9608-557f77dc95-b2xfz" podUID="956c52fe-df2a-4197-8bd6-3398c0eeba79" containerName="maas-api" containerID="cri-o://12281590b8377749eb7c67dea43a3b0e89183bf73ff90090eda2f9664a092547" gracePeriod=30
Jul 17 11:34:40.722485 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:40.722376    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff1f9608-557f77dc95-b2xfz"
Jul 17 11:34:40.785285 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:40.785243    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/956c52fe-df2a-4197-8bd6-3398c0eeba79-maas-api-tls\") pod \"956c52fe-df2a-4197-8bd6-3398c0eeba79\" (UID: \"956c52fe-df2a-4197-8bd6-3398c0eeba79\") "
Jul 17 11:34:40.785510 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:40.785324    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzlbj\" (UniqueName: \"kubernetes.io/projected/956c52fe-df2a-4197-8bd6-3398c0eeba79-kube-api-access-zzlbj\") pod \"956c52fe-df2a-4197-8bd6-3398c0eeba79\" (UID: \"956c52fe-df2a-4197-8bd6-3398c0eeba79\") "
Jul 17 11:34:40.785510 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:40.785410    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/956c52fe-df2a-4197-8bd6-3398c0eeba79-openshift-service-ca\") pod \"956c52fe-df2a-4197-8bd6-3398c0eeba79\" (UID: \"956c52fe-df2a-4197-8bd6-3398c0eeba79\") "
Jul 17 11:34:40.785785 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:40.785745    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/956c52fe-df2a-4197-8bd6-3398c0eeba79-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "956c52fe-df2a-4197-8bd6-3398c0eeba79" (UID: "956c52fe-df2a-4197-8bd6-3398c0eeba79"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:34:40.787568 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:40.787526    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/956c52fe-df2a-4197-8bd6-3398c0eeba79-kube-api-access-zzlbj" (OuterVolumeSpecName: "kube-api-access-zzlbj") pod "956c52fe-df2a-4197-8bd6-3398c0eeba79" (UID: "956c52fe-df2a-4197-8bd6-3398c0eeba79"). InnerVolumeSpecName "kube-api-access-zzlbj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:34:40.787568 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:40.787540    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/956c52fe-df2a-4197-8bd6-3398c0eeba79-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "956c52fe-df2a-4197-8bd6-3398c0eeba79" (UID: "956c52fe-df2a-4197-8bd6-3398c0eeba79"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:34:40.886895 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:40.886853    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzlbj\" (UniqueName: \"kubernetes.io/projected/956c52fe-df2a-4197-8bd6-3398c0eeba79-kube-api-access-zzlbj\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:34:40.886895 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:40.886886    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/956c52fe-df2a-4197-8bd6-3398c0eeba79-openshift-service-ca\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:34:40.886895 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:40.886896    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/956c52fe-df2a-4197-8bd6-3398c0eeba79-maas-api-tls\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:34:41.226580 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:41.226541    2563 generic.go:356] "Generic (PLEG): container finished" podID="956c52fe-df2a-4197-8bd6-3398c0eeba79" containerID="12281590b8377749eb7c67dea43a3b0e89183bf73ff90090eda2f9664a092547" exitCode=0
Jul 17 11:34:41.226799 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:41.226593    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff1f9608-557f77dc95-b2xfz"
Jul 17 11:34:41.226799 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:41.226633    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff1f9608-557f77dc95-b2xfz" event={"ID":"956c52fe-df2a-4197-8bd6-3398c0eeba79","Type":"ContainerDied","Data":"12281590b8377749eb7c67dea43a3b0e89183bf73ff90090eda2f9664a092547"}
Jul 17 11:34:41.226799 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:41.226697    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff1f9608-557f77dc95-b2xfz" event={"ID":"956c52fe-df2a-4197-8bd6-3398c0eeba79","Type":"ContainerDied","Data":"ebb22e2cb46ca6efa5d2ee84c136384615f40f9a10af83754301758c0f226446"}
Jul 17 11:34:41.226799 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:41.226727    2563 scope.go:117] "RemoveContainer" containerID="12281590b8377749eb7c67dea43a3b0e89183bf73ff90090eda2f9664a092547"
Jul 17 11:34:41.235958 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:41.235938    2563 scope.go:117] "RemoveContainer" containerID="12281590b8377749eb7c67dea43a3b0e89183bf73ff90090eda2f9664a092547"
Jul 17 11:34:41.236269 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:34:41.236249    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12281590b8377749eb7c67dea43a3b0e89183bf73ff90090eda2f9664a092547\": container with ID starting with 12281590b8377749eb7c67dea43a3b0e89183bf73ff90090eda2f9664a092547 not found: ID does not exist" containerID="12281590b8377749eb7c67dea43a3b0e89183bf73ff90090eda2f9664a092547"
Jul 17 11:34:41.236315 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:41.236279    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12281590b8377749eb7c67dea43a3b0e89183bf73ff90090eda2f9664a092547"} err="failed to get container status \"12281590b8377749eb7c67dea43a3b0e89183bf73ff90090eda2f9664a092547\": rpc error: code = NotFound desc = could not find container \"12281590b8377749eb7c67dea43a3b0e89183bf73ff90090eda2f9664a092547\": container with ID starting with 12281590b8377749eb7c67dea43a3b0e89183bf73ff90090eda2f9664a092547 not found: ID does not exist"
Jul 17 11:34:41.249832 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:41.249792    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ff1f9608-557f77dc95-b2xfz"]
Jul 17 11:34:41.254114 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:41.254075    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ff1f9608-557f77dc95-b2xfz"]
Jul 17 11:34:41.265919 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:34:41.265887    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="956c52fe-df2a-4197-8bd6-3398c0eeba79" path="/var/lib/kubelet/pods/956c52fe-df2a-4197-8bd6-3398c0eeba79/volumes"
Jul 17 11:35:18.813734 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:18.813698    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-caf75d03-7656f6d6f6-t6qf6"]
Jul 17 11:35:18.814252 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:18.814232    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="956c52fe-df2a-4197-8bd6-3398c0eeba79" containerName="maas-api"
Jul 17 11:35:18.814306 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:18.814256    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="956c52fe-df2a-4197-8bd6-3398c0eeba79" containerName="maas-api"
Jul 17 11:35:18.814306 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:18.814293    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52" containerName="maas-api"
Jul 17 11:35:18.814306 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:18.814303    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52" containerName="maas-api"
Jul 17 11:35:18.814422 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:18.814408    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdbaaffc-1a93-41df-9934-8015c863cadf" containerName="maas-api"
Jul 17 11:35:18.814476 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:18.814443    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="956c52fe-df2a-4197-8bd6-3398c0eeba79" containerName="maas-api"
Jul 17 11:35:18.814476 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:18.814455    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52" containerName="maas-api"
Jul 17 11:35:18.814476 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:18.814464    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52" containerName="maas-api"
Jul 17 11:35:18.818112 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:18.818093    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-caf75d03-7656f6d6f6-t6qf6"
Jul 17 11:35:18.821647 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:18.821625    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-caf75d03-serving-cert\""
Jul 17 11:35:18.830415 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:18.830393    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-caf75d03-7656f6d6f6-t6qf6"]
Jul 17 11:35:19.011972 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:19.011935    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b68ad6b-d855-4871-ab17-e9845fdd9e42-maas-api-tls\") pod \"maas-api-e2e-mt-caf75d03-7656f6d6f6-t6qf6\" (UID: \"5b68ad6b-d855-4871-ab17-e9845fdd9e42\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-caf75d03-7656f6d6f6-t6qf6"
Jul 17 11:35:19.012136 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:19.012007    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b795\" (UniqueName: \"kubernetes.io/projected/5b68ad6b-d855-4871-ab17-e9845fdd9e42-kube-api-access-5b795\") pod \"maas-api-e2e-mt-caf75d03-7656f6d6f6-t6qf6\" (UID: \"5b68ad6b-d855-4871-ab17-e9845fdd9e42\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-caf75d03-7656f6d6f6-t6qf6"
Jul 17 11:35:19.012136 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:19.012061    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b68ad6b-d855-4871-ab17-e9845fdd9e42-openshift-service-ca\") pod \"maas-api-e2e-mt-caf75d03-7656f6d6f6-t6qf6\" (UID: \"5b68ad6b-d855-4871-ab17-e9845fdd9e42\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-caf75d03-7656f6d6f6-t6qf6"
Jul 17 11:35:19.112935 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:19.112858    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b68ad6b-d855-4871-ab17-e9845fdd9e42-maas-api-tls\") pod \"maas-api-e2e-mt-caf75d03-7656f6d6f6-t6qf6\" (UID: \"5b68ad6b-d855-4871-ab17-e9845fdd9e42\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-caf75d03-7656f6d6f6-t6qf6"
Jul 17 11:35:19.112935 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:19.112918    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b795\" (UniqueName: \"kubernetes.io/projected/5b68ad6b-d855-4871-ab17-e9845fdd9e42-kube-api-access-5b795\") pod \"maas-api-e2e-mt-caf75d03-7656f6d6f6-t6qf6\" (UID: \"5b68ad6b-d855-4871-ab17-e9845fdd9e42\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-caf75d03-7656f6d6f6-t6qf6"
Jul 17 11:35:19.113140 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:19.112945    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b68ad6b-d855-4871-ab17-e9845fdd9e42-openshift-service-ca\") pod \"maas-api-e2e-mt-caf75d03-7656f6d6f6-t6qf6\" (UID: \"5b68ad6b-d855-4871-ab17-e9845fdd9e42\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-caf75d03-7656f6d6f6-t6qf6"
Jul 17 11:35:19.113588 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:19.113564    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b68ad6b-d855-4871-ab17-e9845fdd9e42-openshift-service-ca\") pod \"maas-api-e2e-mt-caf75d03-7656f6d6f6-t6qf6\" (UID: \"5b68ad6b-d855-4871-ab17-e9845fdd9e42\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-caf75d03-7656f6d6f6-t6qf6"
Jul 17 11:35:19.115366 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:19.115343    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b68ad6b-d855-4871-ab17-e9845fdd9e42-maas-api-tls\") pod \"maas-api-e2e-mt-caf75d03-7656f6d6f6-t6qf6\" (UID: \"5b68ad6b-d855-4871-ab17-e9845fdd9e42\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-caf75d03-7656f6d6f6-t6qf6"
Jul 17 11:35:19.121159 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:19.121136    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b795\" (UniqueName: \"kubernetes.io/projected/5b68ad6b-d855-4871-ab17-e9845fdd9e42-kube-api-access-5b795\") pod \"maas-api-e2e-mt-caf75d03-7656f6d6f6-t6qf6\" (UID: \"5b68ad6b-d855-4871-ab17-e9845fdd9e42\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-caf75d03-7656f6d6f6-t6qf6"
Jul 17 11:35:19.129021 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:19.129001    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-caf75d03-7656f6d6f6-t6qf6"
Jul 17 11:35:19.265551 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:19.265525    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-caf75d03-7656f6d6f6-t6qf6"]
Jul 17 11:35:19.266552 ip-10-0-143-12 kubenswrapper[2563]: W0717 11:35:19.266527    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b68ad6b_d855_4871_ab17_e9845fdd9e42.slice/crio-644d0ca6bc9638bace3e7268e8e9c4001e8200cd0477342a57fb936b09bfd759 WatchSource:0}: Error finding container 644d0ca6bc9638bace3e7268e8e9c4001e8200cd0477342a57fb936b09bfd759: Status 404 returned error can't find the container with id 644d0ca6bc9638bace3e7268e8e9c4001e8200cd0477342a57fb936b09bfd759
Jul 17 11:35:19.397963 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:19.397936    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-caf75d03-7656f6d6f6-t6qf6" event={"ID":"5b68ad6b-d855-4871-ab17-e9845fdd9e42","Type":"ContainerStarted","Data":"644d0ca6bc9638bace3e7268e8e9c4001e8200cd0477342a57fb936b09bfd759"}
Jul 17 11:35:20.405192 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:20.405156    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-caf75d03-7656f6d6f6-t6qf6" event={"ID":"5b68ad6b-d855-4871-ab17-e9845fdd9e42","Type":"ContainerStarted","Data":"0e0889871c9ce7b44e7eceb70595e3d347e89167eb5985990d3dd7cf689e6b49"}
Jul 17 11:35:20.405627 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:20.405254    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-caf75d03-7656f6d6f6-t6qf6"
Jul 17 11:35:20.427978 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:20.427932    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-caf75d03-7656f6d6f6-t6qf6" podStartSLOduration=2.045851106 podStartE2EDuration="2.427918053s" totalImagesPullingTime="382.066947ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:35:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:35:20.426856852 +0000 UTC m=+2585.607889817" watchObservedRunningTime="2026-07-17 11:35:20.427918053 +0000 UTC m=+2585.608951035"
Jul 17 11:35:26.416526 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:26.416497    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-caf75d03-7656f6d6f6-t6qf6"
Jul 17 11:35:56.598656 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:56.598559    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-caf75d03-7656f6d6f6-t6qf6"]
Jul 17 11:35:56.599240 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:56.598871    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-caf75d03-7656f6d6f6-t6qf6" podUID="5b68ad6b-d855-4871-ab17-e9845fdd9e42" containerName="maas-api" containerID="cri-o://0e0889871c9ce7b44e7eceb70595e3d347e89167eb5985990d3dd7cf689e6b49" gracePeriod=30
Jul 17 11:35:56.843629 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:56.843602    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-caf75d03-7656f6d6f6-t6qf6"
Jul 17 11:35:56.943018 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:56.942980    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b68ad6b-d855-4871-ab17-e9845fdd9e42-openshift-service-ca\") pod \"5b68ad6b-d855-4871-ab17-e9845fdd9e42\" (UID: \"5b68ad6b-d855-4871-ab17-e9845fdd9e42\") "
Jul 17 11:35:56.943192 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:56.943032    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b68ad6b-d855-4871-ab17-e9845fdd9e42-maas-api-tls\") pod \"5b68ad6b-d855-4871-ab17-e9845fdd9e42\" (UID: \"5b68ad6b-d855-4871-ab17-e9845fdd9e42\") "
Jul 17 11:35:56.943192 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:56.943105    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5b795\" (UniqueName: \"kubernetes.io/projected/5b68ad6b-d855-4871-ab17-e9845fdd9e42-kube-api-access-5b795\") pod \"5b68ad6b-d855-4871-ab17-e9845fdd9e42\" (UID: \"5b68ad6b-d855-4871-ab17-e9845fdd9e42\") "
Jul 17 11:35:56.943482 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:56.943417    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b68ad6b-d855-4871-ab17-e9845fdd9e42-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5b68ad6b-d855-4871-ab17-e9845fdd9e42" (UID: "5b68ad6b-d855-4871-ab17-e9845fdd9e42"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:35:56.945182 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:56.945156    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b68ad6b-d855-4871-ab17-e9845fdd9e42-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5b68ad6b-d855-4871-ab17-e9845fdd9e42" (UID: "5b68ad6b-d855-4871-ab17-e9845fdd9e42"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:35:56.945295 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:56.945195    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b68ad6b-d855-4871-ab17-e9845fdd9e42-kube-api-access-5b795" (OuterVolumeSpecName: "kube-api-access-5b795") pod "5b68ad6b-d855-4871-ab17-e9845fdd9e42" (UID: "5b68ad6b-d855-4871-ab17-e9845fdd9e42"). InnerVolumeSpecName "kube-api-access-5b795". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:35:57.043791 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:57.043752    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b68ad6b-d855-4871-ab17-e9845fdd9e42-openshift-service-ca\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:35:57.043791 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:57.043783    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b68ad6b-d855-4871-ab17-e9845fdd9e42-maas-api-tls\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:35:57.043791 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:57.043798    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5b795\" (UniqueName: \"kubernetes.io/projected/5b68ad6b-d855-4871-ab17-e9845fdd9e42-kube-api-access-5b795\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:35:57.579668 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:57.579559    2563 generic.go:356] "Generic (PLEG): container finished" podID="5b68ad6b-d855-4871-ab17-e9845fdd9e42" containerID="0e0889871c9ce7b44e7eceb70595e3d347e89167eb5985990d3dd7cf689e6b49" exitCode=0
Jul 17 11:35:57.579668 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:57.579638    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-caf75d03-7656f6d6f6-t6qf6"
Jul 17 11:35:57.579668 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:57.579640    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-caf75d03-7656f6d6f6-t6qf6" event={"ID":"5b68ad6b-d855-4871-ab17-e9845fdd9e42","Type":"ContainerDied","Data":"0e0889871c9ce7b44e7eceb70595e3d347e89167eb5985990d3dd7cf689e6b49"}
Jul 17 11:35:57.579917 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:57.579700    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-caf75d03-7656f6d6f6-t6qf6" event={"ID":"5b68ad6b-d855-4871-ab17-e9845fdd9e42","Type":"ContainerDied","Data":"644d0ca6bc9638bace3e7268e8e9c4001e8200cd0477342a57fb936b09bfd759"}
Jul 17 11:35:57.579917 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:57.579722    2563 scope.go:117] "RemoveContainer" containerID="0e0889871c9ce7b44e7eceb70595e3d347e89167eb5985990d3dd7cf689e6b49"
Jul 17 11:35:57.588471 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:57.588450    2563 scope.go:117] "RemoveContainer" containerID="0e0889871c9ce7b44e7eceb70595e3d347e89167eb5985990d3dd7cf689e6b49"
Jul 17 11:35:57.588733 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:35:57.588713    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e0889871c9ce7b44e7eceb70595e3d347e89167eb5985990d3dd7cf689e6b49\": container with ID starting with 0e0889871c9ce7b44e7eceb70595e3d347e89167eb5985990d3dd7cf689e6b49 not found: ID does not exist" containerID="0e0889871c9ce7b44e7eceb70595e3d347e89167eb5985990d3dd7cf689e6b49"
Jul 17 11:35:57.588796 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:57.588743    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e0889871c9ce7b44e7eceb70595e3d347e89167eb5985990d3dd7cf689e6b49"} err="failed to get container status \"0e0889871c9ce7b44e7eceb70595e3d347e89167eb5985990d3dd7cf689e6b49\": rpc error: code = NotFound desc = could not find container \"0e0889871c9ce7b44e7eceb70595e3d347e89167eb5985990d3dd7cf689e6b49\": container with ID starting with 0e0889871c9ce7b44e7eceb70595e3d347e89167eb5985990d3dd7cf689e6b49 not found: ID does not exist"
Jul 17 11:35:57.600409 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:57.600382    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-caf75d03-7656f6d6f6-t6qf6"]
Jul 17 11:35:57.603669 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:57.603644    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-caf75d03-7656f6d6f6-t6qf6"]
Jul 17 11:35:59.265020 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:35:59.264986    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b68ad6b-d855-4871-ab17-e9845fdd9e42" path="/var/lib/kubelet/pods/5b68ad6b-d855-4871-ab17-e9845fdd9e42/volumes"
Jul 17 11:37:15.409051 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:37:15.408910    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xdrhl_48cc1998-ebc5-4702-8b08-027479580e57/ovn-acl-logging/0.log"
Jul 17 11:37:15.416365 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:37:15.416340    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xdrhl_48cc1998-ebc5-4702-8b08-027479580e57/ovn-acl-logging/0.log"
Jul 17 11:37:52.240482 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:37:52.240445    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4da7d6-68d84b8f5f-9l6l8"]
Jul 17 11:37:52.241011 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:37:52.240995    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b68ad6b-d855-4871-ab17-e9845fdd9e42" containerName="maas-api"
Jul 17 11:37:52.241059 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:37:52.241016    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b68ad6b-d855-4871-ab17-e9845fdd9e42" containerName="maas-api"
Jul 17 11:37:52.241059 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:37:52.241052    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52" containerName="maas-api"
Jul 17 11:37:52.241124 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:37:52.241060    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c755c0ef-4ffa-4146-8fb4-02e471a7ce52" containerName="maas-api"
Jul 17 11:37:52.241155 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:37:52.241149    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b68ad6b-d855-4871-ab17-e9845fdd9e42" containerName="maas-api"
Jul 17 11:37:52.244529 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:37:52.244506    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4da7d6-68d84b8f5f-9l6l8"
Jul 17 11:37:52.247541 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:37:52.247518    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-4da7d6-serving-cert\""
Jul 17 11:37:52.254497 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:37:52.254472    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4da7d6-68d84b8f5f-9l6l8"]
Jul 17 11:37:52.299922 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:37:52.299879    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a5d4a3f-0702-41b3-9c13-ace072880b08-openshift-service-ca\") pod \"maas-api-e2e-inf-a-4da7d6-68d84b8f5f-9l6l8\" (UID: \"5a5d4a3f-0702-41b3-9c13-ace072880b08\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4da7d6-68d84b8f5f-9l6l8"
Jul 17 11:37:52.300099 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:37:52.299927    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qdct\" (UniqueName: \"kubernetes.io/projected/5a5d4a3f-0702-41b3-9c13-ace072880b08-kube-api-access-6qdct\") pod \"maas-api-e2e-inf-a-4da7d6-68d84b8f5f-9l6l8\" (UID: \"5a5d4a3f-0702-41b3-9c13-ace072880b08\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4da7d6-68d84b8f5f-9l6l8"
Jul 17 11:37:52.300099 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:37:52.299954    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a5d4a3f-0702-41b3-9c13-ace072880b08-maas-api-tls\") pod \"maas-api-e2e-inf-a-4da7d6-68d84b8f5f-9l6l8\" (UID: \"5a5d4a3f-0702-41b3-9c13-ace072880b08\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4da7d6-68d84b8f5f-9l6l8"
Jul 17 11:37:52.401337 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:37:52.401299    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a5d4a3f-0702-41b3-9c13-ace072880b08-openshift-service-ca\") pod \"maas-api-e2e-inf-a-4da7d6-68d84b8f5f-9l6l8\" (UID: \"5a5d4a3f-0702-41b3-9c13-ace072880b08\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4da7d6-68d84b8f5f-9l6l8"
Jul 17 11:37:52.401551 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:37:52.401346    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qdct\" (UniqueName: \"kubernetes.io/projected/5a5d4a3f-0702-41b3-9c13-ace072880b08-kube-api-access-6qdct\") pod \"maas-api-e2e-inf-a-4da7d6-68d84b8f5f-9l6l8\" (UID: \"5a5d4a3f-0702-41b3-9c13-ace072880b08\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4da7d6-68d84b8f5f-9l6l8"
Jul 17 11:37:52.401551 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:37:52.401373    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a5d4a3f-0702-41b3-9c13-ace072880b08-maas-api-tls\") pod \"maas-api-e2e-inf-a-4da7d6-68d84b8f5f-9l6l8\" (UID: \"5a5d4a3f-0702-41b3-9c13-ace072880b08\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4da7d6-68d84b8f5f-9l6l8"
Jul 17 11:37:52.401551 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:37:52.401527    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-4da7d6-serving-cert: secret "maas-api-e2e-inf-a-4da7d6-serving-cert" not found
Jul 17 11:37:52.401692 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:37:52.401604    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a5d4a3f-0702-41b3-9c13-ace072880b08-maas-api-tls podName:5a5d4a3f-0702-41b3-9c13-ace072880b08 nodeName:}" failed. No retries permitted until 2026-07-17 11:37:52.901581713 +0000 UTC m=+2738.082614668 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5a5d4a3f-0702-41b3-9c13-ace072880b08-maas-api-tls") pod "maas-api-e2e-inf-a-4da7d6-68d84b8f5f-9l6l8" (UID: "5a5d4a3f-0702-41b3-9c13-ace072880b08") : secret "maas-api-e2e-inf-a-4da7d6-serving-cert" not found
Jul 17 11:37:52.402056 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:37:52.402035    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a5d4a3f-0702-41b3-9c13-ace072880b08-openshift-service-ca\") pod \"maas-api-e2e-inf-a-4da7d6-68d84b8f5f-9l6l8\" (UID: \"5a5d4a3f-0702-41b3-9c13-ace072880b08\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4da7d6-68d84b8f5f-9l6l8"
Jul 17 11:37:52.437822 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:37:52.437789    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qdct\" (UniqueName: \"kubernetes.io/projected/5a5d4a3f-0702-41b3-9c13-ace072880b08-kube-api-access-6qdct\") pod \"maas-api-e2e-inf-a-4da7d6-68d84b8f5f-9l6l8\" (UID: \"5a5d4a3f-0702-41b3-9c13-ace072880b08\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4da7d6-68d84b8f5f-9l6l8"
Jul 17 11:37:52.907276 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:37:52.907238    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a5d4a3f-0702-41b3-9c13-ace072880b08-maas-api-tls\") pod \"maas-api-e2e-inf-a-4da7d6-68d84b8f5f-9l6l8\" (UID: \"5a5d4a3f-0702-41b3-9c13-ace072880b08\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4da7d6-68d84b8f5f-9l6l8"
Jul 17 11:37:52.909792 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:37:52.909760    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a5d4a3f-0702-41b3-9c13-ace072880b08-maas-api-tls\") pod \"maas-api-e2e-inf-a-4da7d6-68d84b8f5f-9l6l8\" (UID: \"5a5d4a3f-0702-41b3-9c13-ace072880b08\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4da7d6-68d84b8f5f-9l6l8"
Jul 17 11:37:53.159405 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:37:53.159302    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4da7d6-68d84b8f5f-9l6l8"
Jul 17 11:37:53.306627 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:37:53.306594    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4da7d6-68d84b8f5f-9l6l8"]
Jul 17 11:37:53.308982 ip-10-0-143-12 kubenswrapper[2563]: W0717 11:37:53.308953    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a5d4a3f_0702_41b3_9c13_ace072880b08.slice/crio-309f74578a0df39a2242886466b93d995a6fd3bb019e483ca55b097397fc9232 WatchSource:0}: Error finding container 309f74578a0df39a2242886466b93d995a6fd3bb019e483ca55b097397fc9232: Status 404 returned error can't find the container with id 309f74578a0df39a2242886466b93d995a6fd3bb019e483ca55b097397fc9232
Jul 17 11:37:54.125105 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:37:54.125016    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4da7d6-68d84b8f5f-9l6l8" event={"ID":"5a5d4a3f-0702-41b3-9c13-ace072880b08","Type":"ContainerStarted","Data":"bc496b662c527f99b6e7b86bf123b5f6b6ce877269fa8730a549c8544f6daf93"}
Jul 17 11:37:54.125105 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:37:54.125067    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4da7d6-68d84b8f5f-9l6l8" event={"ID":"5a5d4a3f-0702-41b3-9c13-ace072880b08","Type":"ContainerStarted","Data":"309f74578a0df39a2242886466b93d995a6fd3bb019e483ca55b097397fc9232"}
Jul 17 11:37:54.125297 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:37:54.125146    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4da7d6-68d84b8f5f-9l6l8"
Jul 17 11:37:54.152270 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:37:54.152207    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4da7d6-68d84b8f5f-9l6l8" podStartSLOduration=1.741541785 podStartE2EDuration="2.15219136s" totalImagesPullingTime="410.649575ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:37:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:37:54.149938035 +0000 UTC m=+2739.330970997" watchObservedRunningTime="2026-07-17 11:37:54.15219136 +0000 UTC m=+2739.333224347"
Jul 17 11:38:00.136237 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:38:00.136206    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4da7d6-68d84b8f5f-9l6l8"
Jul 17 11:38:00.761775 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:38:00.761732    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-b18220-56b6d9c74c-tmfzn"]
Jul 17 11:38:00.766031 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:38:00.766000    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b18220-56b6d9c74c-tmfzn"
Jul 17 11:38:00.774342 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:38:00.774315    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-b18220-serving-cert\""
Jul 17 11:38:00.782698 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:38:00.782670    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-b18220-56b6d9c74c-tmfzn"]
Jul 17 11:38:00.883854 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:38:00.883816    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsvgz\" (UniqueName: \"kubernetes.io/projected/8e543994-9461-4184-8aa4-f72b45972dfe-kube-api-access-nsvgz\") pod \"maas-api-e2e-inf-b-b18220-56b6d9c74c-tmfzn\" (UID: \"8e543994-9461-4184-8aa4-f72b45972dfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b18220-56b6d9c74c-tmfzn"
Jul 17 11:38:00.884037 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:38:00.883866    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e543994-9461-4184-8aa4-f72b45972dfe-maas-api-tls\") pod \"maas-api-e2e-inf-b-b18220-56b6d9c74c-tmfzn\" (UID: \"8e543994-9461-4184-8aa4-f72b45972dfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b18220-56b6d9c74c-tmfzn"
Jul 17 11:38:00.884037 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:38:00.883945    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e543994-9461-4184-8aa4-f72b45972dfe-openshift-service-ca\") pod \"maas-api-e2e-inf-b-b18220-56b6d9c74c-tmfzn\" (UID: \"8e543994-9461-4184-8aa4-f72b45972dfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b18220-56b6d9c74c-tmfzn"
Jul 17 11:38:00.985054 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:38:00.985012    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsvgz\" (UniqueName: \"kubernetes.io/projected/8e543994-9461-4184-8aa4-f72b45972dfe-kube-api-access-nsvgz\") pod \"maas-api-e2e-inf-b-b18220-56b6d9c74c-tmfzn\" (UID: \"8e543994-9461-4184-8aa4-f72b45972dfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b18220-56b6d9c74c-tmfzn"
Jul 17 11:38:00.985223 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:38:00.985069    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e543994-9461-4184-8aa4-f72b45972dfe-maas-api-tls\") pod \"maas-api-e2e-inf-b-b18220-56b6d9c74c-tmfzn\" (UID: \"8e543994-9461-4184-8aa4-f72b45972dfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b18220-56b6d9c74c-tmfzn"
Jul 17 11:38:00.985223 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:38:00.985106    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e543994-9461-4184-8aa4-f72b45972dfe-openshift-service-ca\") pod \"maas-api-e2e-inf-b-b18220-56b6d9c74c-tmfzn\" (UID: \"8e543994-9461-4184-8aa4-f72b45972dfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b18220-56b6d9c74c-tmfzn"
Jul 17 11:38:00.985478 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:38:00.985244    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-b18220-serving-cert: secret "maas-api-e2e-inf-b-b18220-serving-cert" not found
Jul 17 11:38:00.985478 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:38:00.985342    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e543994-9461-4184-8aa4-f72b45972dfe-maas-api-tls podName:8e543994-9461-4184-8aa4-f72b45972dfe nodeName:}" failed. No retries permitted until 2026-07-17 11:38:01.485319638 +0000 UTC m=+2746.666352590 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8e543994-9461-4184-8aa4-f72b45972dfe-maas-api-tls") pod "maas-api-e2e-inf-b-b18220-56b6d9c74c-tmfzn" (UID: "8e543994-9461-4184-8aa4-f72b45972dfe") : secret "maas-api-e2e-inf-b-b18220-serving-cert" not found
Jul 17 11:38:00.985827 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:38:00.985808    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e543994-9461-4184-8aa4-f72b45972dfe-openshift-service-ca\") pod \"maas-api-e2e-inf-b-b18220-56b6d9c74c-tmfzn\" (UID: \"8e543994-9461-4184-8aa4-f72b45972dfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b18220-56b6d9c74c-tmfzn"
Jul 17 11:38:01.004781 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:38:01.004751    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsvgz\" (UniqueName: \"kubernetes.io/projected/8e543994-9461-4184-8aa4-f72b45972dfe-kube-api-access-nsvgz\") pod \"maas-api-e2e-inf-b-b18220-56b6d9c74c-tmfzn\" (UID: \"8e543994-9461-4184-8aa4-f72b45972dfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b18220-56b6d9c74c-tmfzn"
Jul 17 11:38:01.488974 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:38:01.488932    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e543994-9461-4184-8aa4-f72b45972dfe-maas-api-tls\") pod \"maas-api-e2e-inf-b-b18220-56b6d9c74c-tmfzn\" (UID: \"8e543994-9461-4184-8aa4-f72b45972dfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b18220-56b6d9c74c-tmfzn"
Jul 17 11:38:01.491483 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:38:01.491447    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e543994-9461-4184-8aa4-f72b45972dfe-maas-api-tls\") pod \"maas-api-e2e-inf-b-b18220-56b6d9c74c-tmfzn\" (UID: \"8e543994-9461-4184-8aa4-f72b45972dfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b18220-56b6d9c74c-tmfzn"
Jul 17 11:38:01.677037 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:38:01.676998    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b18220-56b6d9c74c-tmfzn"
Jul 17 11:38:01.831032 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:38:01.830983    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-b18220-56b6d9c74c-tmfzn"]
Jul 17 11:38:01.834189 ip-10-0-143-12 kubenswrapper[2563]: W0717 11:38:01.834155    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e543994_9461_4184_8aa4_f72b45972dfe.slice/crio-f1f8f2522a4f47c5b6561aee4b46d2aded042143b04b79f3f35a1e1165c523dd WatchSource:0}: Error finding container f1f8f2522a4f47c5b6561aee4b46d2aded042143b04b79f3f35a1e1165c523dd: Status 404 returned error can't find the container with id f1f8f2522a4f47c5b6561aee4b46d2aded042143b04b79f3f35a1e1165c523dd
Jul 17 11:38:02.167953 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:38:02.167909    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b18220-56b6d9c74c-tmfzn" event={"ID":"8e543994-9461-4184-8aa4-f72b45972dfe","Type":"ContainerStarted","Data":"f1f8f2522a4f47c5b6561aee4b46d2aded042143b04b79f3f35a1e1165c523dd"}
Jul 17 11:38:03.173724 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:38:03.173685    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b18220-56b6d9c74c-tmfzn" event={"ID":"8e543994-9461-4184-8aa4-f72b45972dfe","Type":"ContainerStarted","Data":"40ec5208bcf479a1295650ab67e9618f99e8338b754be623d464892239aa4c75"}
Jul 17 11:38:03.174141 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:38:03.173748    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b18220-56b6d9c74c-tmfzn"
Jul 17 11:38:09.184875 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:38:09.184845    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b18220-56b6d9c74c-tmfzn"
Jul 17 11:38:09.205453 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:38:09.205374    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b18220-56b6d9c74c-tmfzn" podStartSLOduration=8.725409351 podStartE2EDuration="9.205358637s" totalImagesPullingTime="479.949286ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:38:03.198619825 +0000 UTC m=+2748.379652787" watchObservedRunningTime="2026-07-17 11:38:09.205358637 +0000 UTC m=+2754.386391599"
Jul 17 11:39:35.956190 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:39:35.956158    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4da7d6-68d84b8f5f-9l6l8"]
Jul 17 11:39:35.956681 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:39:35.956372    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4da7d6-68d84b8f5f-9l6l8" podUID="5a5d4a3f-0702-41b3-9c13-ace072880b08" containerName="maas-api" containerID="cri-o://bc496b662c527f99b6e7b86bf123b5f6b6ce877269fa8730a549c8544f6daf93" gracePeriod=30
Jul 17 11:39:36.207192 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:39:36.207121    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4da7d6-68d84b8f5f-9l6l8"
Jul 17 11:39:36.332298 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:39:36.332268    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a5d4a3f-0702-41b3-9c13-ace072880b08-maas-api-tls\") pod \"5a5d4a3f-0702-41b3-9c13-ace072880b08\" (UID: \"5a5d4a3f-0702-41b3-9c13-ace072880b08\") "
Jul 17 11:39:36.332500 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:39:36.332319    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qdct\" (UniqueName: \"kubernetes.io/projected/5a5d4a3f-0702-41b3-9c13-ace072880b08-kube-api-access-6qdct\") pod \"5a5d4a3f-0702-41b3-9c13-ace072880b08\" (UID: \"5a5d4a3f-0702-41b3-9c13-ace072880b08\") "
Jul 17 11:39:36.332500 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:39:36.332468    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a5d4a3f-0702-41b3-9c13-ace072880b08-openshift-service-ca\") pod \"5a5d4a3f-0702-41b3-9c13-ace072880b08\" (UID: \"5a5d4a3f-0702-41b3-9c13-ace072880b08\") "
Jul 17 11:39:36.332817 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:39:36.332785    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a5d4a3f-0702-41b3-9c13-ace072880b08-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5a5d4a3f-0702-41b3-9c13-ace072880b08" (UID: "5a5d4a3f-0702-41b3-9c13-ace072880b08"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:39:36.334569 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:39:36.334548    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a5d4a3f-0702-41b3-9c13-ace072880b08-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5a5d4a3f-0702-41b3-9c13-ace072880b08" (UID: "5a5d4a3f-0702-41b3-9c13-ace072880b08"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:39:36.334648 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:39:36.334550    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a5d4a3f-0702-41b3-9c13-ace072880b08-kube-api-access-6qdct" (OuterVolumeSpecName: "kube-api-access-6qdct") pod "5a5d4a3f-0702-41b3-9c13-ace072880b08" (UID: "5a5d4a3f-0702-41b3-9c13-ace072880b08"). InnerVolumeSpecName "kube-api-access-6qdct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:39:36.434191 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:39:36.434159    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a5d4a3f-0702-41b3-9c13-ace072880b08-maas-api-tls\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:39:36.434191 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:39:36.434187    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qdct\" (UniqueName: \"kubernetes.io/projected/5a5d4a3f-0702-41b3-9c13-ace072880b08-kube-api-access-6qdct\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:39:36.434383 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:39:36.434196    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a5d4a3f-0702-41b3-9c13-ace072880b08-openshift-service-ca\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:39:36.616800 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:39:36.616708    2563 generic.go:356] "Generic (PLEG): container finished" podID="5a5d4a3f-0702-41b3-9c13-ace072880b08" containerID="bc496b662c527f99b6e7b86bf123b5f6b6ce877269fa8730a549c8544f6daf93" exitCode=0
Jul 17 11:39:36.616800 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:39:36.616750    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4da7d6-68d84b8f5f-9l6l8"
Jul 17 11:39:36.617032 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:39:36.616800    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4da7d6-68d84b8f5f-9l6l8" event={"ID":"5a5d4a3f-0702-41b3-9c13-ace072880b08","Type":"ContainerDied","Data":"bc496b662c527f99b6e7b86bf123b5f6b6ce877269fa8730a549c8544f6daf93"}
Jul 17 11:39:36.617032 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:39:36.616865    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4da7d6-68d84b8f5f-9l6l8" event={"ID":"5a5d4a3f-0702-41b3-9c13-ace072880b08","Type":"ContainerDied","Data":"309f74578a0df39a2242886466b93d995a6fd3bb019e483ca55b097397fc9232"}
Jul 17 11:39:36.617032 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:39:36.616886    2563 scope.go:117] "RemoveContainer" containerID="bc496b662c527f99b6e7b86bf123b5f6b6ce877269fa8730a549c8544f6daf93"
Jul 17 11:39:36.625878 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:39:36.625858    2563 scope.go:117] "RemoveContainer" containerID="bc496b662c527f99b6e7b86bf123b5f6b6ce877269fa8730a549c8544f6daf93"
Jul 17 11:39:36.626122 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:39:36.626104    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc496b662c527f99b6e7b86bf123b5f6b6ce877269fa8730a549c8544f6daf93\": container with ID starting with bc496b662c527f99b6e7b86bf123b5f6b6ce877269fa8730a549c8544f6daf93 not found: ID does not exist" containerID="bc496b662c527f99b6e7b86bf123b5f6b6ce877269fa8730a549c8544f6daf93"
Jul 17 11:39:36.626174 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:39:36.626134    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc496b662c527f99b6e7b86bf123b5f6b6ce877269fa8730a549c8544f6daf93"} err="failed to get container status \"bc496b662c527f99b6e7b86bf123b5f6b6ce877269fa8730a549c8544f6daf93\": rpc error: code = NotFound desc = could not find container \"bc496b662c527f99b6e7b86bf123b5f6b6ce877269fa8730a549c8544f6daf93\": container with ID starting with bc496b662c527f99b6e7b86bf123b5f6b6ce877269fa8730a549c8544f6daf93 not found: ID does not exist"
Jul 17 11:39:36.641825 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:39:36.641804    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4da7d6-68d84b8f5f-9l6l8"]
Jul 17 11:39:36.646398 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:39:36.646362    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4da7d6-68d84b8f5f-9l6l8"]
Jul 17 11:39:37.264877 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:39:37.264845    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a5d4a3f-0702-41b3-9c13-ace072880b08" path="/var/lib/kubelet/pods/5a5d4a3f-0702-41b3-9c13-ace072880b08/volumes"
Jul 17 11:40:02.037762 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:02.037726    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-b18220-56b6d9c74c-tmfzn"]
Jul 17 11:40:02.038232 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:02.037988    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b18220-56b6d9c74c-tmfzn" podUID="8e543994-9461-4184-8aa4-f72b45972dfe" containerName="maas-api" containerID="cri-o://40ec5208bcf479a1295650ab67e9618f99e8338b754be623d464892239aa4c75" gracePeriod=30
Jul 17 11:40:02.286704 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:02.286675    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b18220-56b6d9c74c-tmfzn"
Jul 17 11:40:02.471810 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:02.471770    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e543994-9461-4184-8aa4-f72b45972dfe-openshift-service-ca\") pod \"8e543994-9461-4184-8aa4-f72b45972dfe\" (UID: \"8e543994-9461-4184-8aa4-f72b45972dfe\") "
Jul 17 11:40:02.472020 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:02.471874    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nsvgz\" (UniqueName: \"kubernetes.io/projected/8e543994-9461-4184-8aa4-f72b45972dfe-kube-api-access-nsvgz\") pod \"8e543994-9461-4184-8aa4-f72b45972dfe\" (UID: \"8e543994-9461-4184-8aa4-f72b45972dfe\") "
Jul 17 11:40:02.472020 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:02.471909    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e543994-9461-4184-8aa4-f72b45972dfe-maas-api-tls\") pod \"8e543994-9461-4184-8aa4-f72b45972dfe\" (UID: \"8e543994-9461-4184-8aa4-f72b45972dfe\") "
Jul 17 11:40:02.472199 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:02.472175    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e543994-9461-4184-8aa4-f72b45972dfe-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8e543994-9461-4184-8aa4-f72b45972dfe" (UID: "8e543994-9461-4184-8aa4-f72b45972dfe"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:40:02.474161 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:02.474129    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e543994-9461-4184-8aa4-f72b45972dfe-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8e543994-9461-4184-8aa4-f72b45972dfe" (UID: "8e543994-9461-4184-8aa4-f72b45972dfe"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:40:02.474319 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:02.474160    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e543994-9461-4184-8aa4-f72b45972dfe-kube-api-access-nsvgz" (OuterVolumeSpecName: "kube-api-access-nsvgz") pod "8e543994-9461-4184-8aa4-f72b45972dfe" (UID: "8e543994-9461-4184-8aa4-f72b45972dfe"). InnerVolumeSpecName "kube-api-access-nsvgz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:40:02.573412 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:02.573378    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e543994-9461-4184-8aa4-f72b45972dfe-openshift-service-ca\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:40:02.573412 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:02.573410    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nsvgz\" (UniqueName: \"kubernetes.io/projected/8e543994-9461-4184-8aa4-f72b45972dfe-kube-api-access-nsvgz\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:40:02.573642 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:02.573422    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e543994-9461-4184-8aa4-f72b45972dfe-maas-api-tls\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:40:02.740439 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:02.740335    2563 generic.go:356] "Generic (PLEG): container finished" podID="8e543994-9461-4184-8aa4-f72b45972dfe" containerID="40ec5208bcf479a1295650ab67e9618f99e8338b754be623d464892239aa4c75" exitCode=0
Jul 17 11:40:02.740439 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:02.740384    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b18220-56b6d9c74c-tmfzn"
Jul 17 11:40:02.740615 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:02.740419    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b18220-56b6d9c74c-tmfzn" event={"ID":"8e543994-9461-4184-8aa4-f72b45972dfe","Type":"ContainerDied","Data":"40ec5208bcf479a1295650ab67e9618f99e8338b754be623d464892239aa4c75"}
Jul 17 11:40:02.740615 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:02.740485    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b18220-56b6d9c74c-tmfzn" event={"ID":"8e543994-9461-4184-8aa4-f72b45972dfe","Type":"ContainerDied","Data":"f1f8f2522a4f47c5b6561aee4b46d2aded042143b04b79f3f35a1e1165c523dd"}
Jul 17 11:40:02.740615 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:02.740510    2563 scope.go:117] "RemoveContainer" containerID="40ec5208bcf479a1295650ab67e9618f99e8338b754be623d464892239aa4c75"
Jul 17 11:40:02.755337 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:02.755316    2563 scope.go:117] "RemoveContainer" containerID="40ec5208bcf479a1295650ab67e9618f99e8338b754be623d464892239aa4c75"
Jul 17 11:40:02.755647 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:40:02.755609    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40ec5208bcf479a1295650ab67e9618f99e8338b754be623d464892239aa4c75\": container with ID starting with 40ec5208bcf479a1295650ab67e9618f99e8338b754be623d464892239aa4c75 not found: ID does not exist" containerID="40ec5208bcf479a1295650ab67e9618f99e8338b754be623d464892239aa4c75"
Jul 17 11:40:02.755747 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:02.755653    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40ec5208bcf479a1295650ab67e9618f99e8338b754be623d464892239aa4c75"} err="failed to get container status \"40ec5208bcf479a1295650ab67e9618f99e8338b754be623d464892239aa4c75\": rpc error: code = NotFound desc = could not find container \"40ec5208bcf479a1295650ab67e9618f99e8338b754be623d464892239aa4c75\": container with ID starting with 40ec5208bcf479a1295650ab67e9618f99e8338b754be623d464892239aa4c75 not found: ID does not exist"
Jul 17 11:40:02.766622 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:02.766598    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-b18220-56b6d9c74c-tmfzn"]
Jul 17 11:40:02.770869 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:02.770850    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-b18220-56b6d9c74c-tmfzn"]
Jul 17 11:40:03.264858 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:03.264825    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e543994-9461-4184-8aa4-f72b45972dfe" path="/var/lib/kubelet/pods/8e543994-9461-4184-8aa4-f72b45972dfe/volumes"
Jul 17 11:40:22.119772 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:22.119741    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-02cb6e-597445cf66-rnz96"]
Jul 17 11:40:22.120268 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:22.120249    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a5d4a3f-0702-41b3-9c13-ace072880b08" containerName="maas-api"
Jul 17 11:40:22.120345 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:22.120272    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a5d4a3f-0702-41b3-9c13-ace072880b08" containerName="maas-api"
Jul 17 11:40:22.120345 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:22.120290    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e543994-9461-4184-8aa4-f72b45972dfe" containerName="maas-api"
Jul 17 11:40:22.120345 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:22.120298    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e543994-9461-4184-8aa4-f72b45972dfe" containerName="maas-api"
Jul 17 11:40:22.120514 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:22.120445    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e543994-9461-4184-8aa4-f72b45972dfe" containerName="maas-api"
Jul 17 11:40:22.120514 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:22.120465    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a5d4a3f-0702-41b3-9c13-ace072880b08" containerName="maas-api"
Jul 17 11:40:22.124944 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:22.124923    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-02cb6e-597445cf66-rnz96"
Jul 17 11:40:22.127385 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:22.127363    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-02cb6e-serving-cert\""
Jul 17 11:40:22.136729 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:22.136705    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-02cb6e-597445cf66-rnz96"]
Jul 17 11:40:22.244145 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:22.244110    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4cd50311-0230-4b8c-8ac3-476a6c85bed4-maas-api-tls\") pod \"maas-api-e2e-api-a-02cb6e-597445cf66-rnz96\" (UID: \"4cd50311-0230-4b8c-8ac3-476a6c85bed4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-02cb6e-597445cf66-rnz96"
Jul 17 11:40:22.244329 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:22.244157    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7p75\" (UniqueName: \"kubernetes.io/projected/4cd50311-0230-4b8c-8ac3-476a6c85bed4-kube-api-access-h7p75\") pod \"maas-api-e2e-api-a-02cb6e-597445cf66-rnz96\" (UID: \"4cd50311-0230-4b8c-8ac3-476a6c85bed4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-02cb6e-597445cf66-rnz96"
Jul 17 11:40:22.244329 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:22.244178    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cd50311-0230-4b8c-8ac3-476a6c85bed4-openshift-service-ca\") pod \"maas-api-e2e-api-a-02cb6e-597445cf66-rnz96\" (UID: \"4cd50311-0230-4b8c-8ac3-476a6c85bed4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-02cb6e-597445cf66-rnz96"
Jul 17 11:40:22.345609 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:22.345572    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4cd50311-0230-4b8c-8ac3-476a6c85bed4-maas-api-tls\") pod \"maas-api-e2e-api-a-02cb6e-597445cf66-rnz96\" (UID: \"4cd50311-0230-4b8c-8ac3-476a6c85bed4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-02cb6e-597445cf66-rnz96"
Jul 17 11:40:22.345763 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:22.345622    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7p75\" (UniqueName: \"kubernetes.io/projected/4cd50311-0230-4b8c-8ac3-476a6c85bed4-kube-api-access-h7p75\") pod \"maas-api-e2e-api-a-02cb6e-597445cf66-rnz96\" (UID: \"4cd50311-0230-4b8c-8ac3-476a6c85bed4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-02cb6e-597445cf66-rnz96"
Jul 17 11:40:22.345763 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:40:22.345732    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-02cb6e-serving-cert: secret "maas-api-e2e-api-a-02cb6e-serving-cert" not found
Jul 17 11:40:22.345853 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:22.345738    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cd50311-0230-4b8c-8ac3-476a6c85bed4-openshift-service-ca\") pod \"maas-api-e2e-api-a-02cb6e-597445cf66-rnz96\" (UID: \"4cd50311-0230-4b8c-8ac3-476a6c85bed4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-02cb6e-597445cf66-rnz96"
Jul 17 11:40:22.345853 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:40:22.345816    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cd50311-0230-4b8c-8ac3-476a6c85bed4-maas-api-tls podName:4cd50311-0230-4b8c-8ac3-476a6c85bed4 nodeName:}" failed. No retries permitted until 2026-07-17 11:40:22.845794159 +0000 UTC m=+2888.026827103 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4cd50311-0230-4b8c-8ac3-476a6c85bed4-maas-api-tls") pod "maas-api-e2e-api-a-02cb6e-597445cf66-rnz96" (UID: "4cd50311-0230-4b8c-8ac3-476a6c85bed4") : secret "maas-api-e2e-api-a-02cb6e-serving-cert" not found
Jul 17 11:40:22.346295 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:22.346278    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cd50311-0230-4b8c-8ac3-476a6c85bed4-openshift-service-ca\") pod \"maas-api-e2e-api-a-02cb6e-597445cf66-rnz96\" (UID: \"4cd50311-0230-4b8c-8ac3-476a6c85bed4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-02cb6e-597445cf66-rnz96"
Jul 17 11:40:22.366565 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:22.366536    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7p75\" (UniqueName: \"kubernetes.io/projected/4cd50311-0230-4b8c-8ac3-476a6c85bed4-kube-api-access-h7p75\") pod \"maas-api-e2e-api-a-02cb6e-597445cf66-rnz96\" (UID: \"4cd50311-0230-4b8c-8ac3-476a6c85bed4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-02cb6e-597445cf66-rnz96"
Jul 17 11:40:22.849846 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:22.849810    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4cd50311-0230-4b8c-8ac3-476a6c85bed4-maas-api-tls\") pod \"maas-api-e2e-api-a-02cb6e-597445cf66-rnz96\" (UID: \"4cd50311-0230-4b8c-8ac3-476a6c85bed4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-02cb6e-597445cf66-rnz96"
Jul 17 11:40:22.852132 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:22.852112    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4cd50311-0230-4b8c-8ac3-476a6c85bed4-maas-api-tls\") pod \"maas-api-e2e-api-a-02cb6e-597445cf66-rnz96\" (UID: \"4cd50311-0230-4b8c-8ac3-476a6c85bed4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-02cb6e-597445cf66-rnz96"
Jul 17 11:40:23.036815 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:23.036780    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-02cb6e-597445cf66-rnz96"
Jul 17 11:40:23.177164 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:23.177127    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-02cb6e-597445cf66-rnz96"]
Jul 17 11:40:23.180482 ip-10-0-143-12 kubenswrapper[2563]: W0717 11:40:23.180419    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cd50311_0230_4b8c_8ac3_476a6c85bed4.slice/crio-7e9de96475880b8c39914d2486996d7808051a3de3460141677d4399d6c46a7b WatchSource:0}: Error finding container 7e9de96475880b8c39914d2486996d7808051a3de3460141677d4399d6c46a7b: Status 404 returned error can't find the container with id 7e9de96475880b8c39914d2486996d7808051a3de3460141677d4399d6c46a7b
Jul 17 11:40:23.182031 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:23.182009    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 11:40:23.834544 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:23.834492    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-02cb6e-597445cf66-rnz96" event={"ID":"4cd50311-0230-4b8c-8ac3-476a6c85bed4","Type":"ContainerStarted","Data":"d9a674a375b280d4c39a2659cc0eb2fefcdcd8e1b016d42bd665b0ade7db1cac"}
Jul 17 11:40:23.834735 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:23.834562    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-02cb6e-597445cf66-rnz96" event={"ID":"4cd50311-0230-4b8c-8ac3-476a6c85bed4","Type":"ContainerStarted","Data":"7e9de96475880b8c39914d2486996d7808051a3de3460141677d4399d6c46a7b"}
Jul 17 11:40:23.834735 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:23.834591    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-02cb6e-597445cf66-rnz96"
Jul 17 11:40:23.861875 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:23.861825    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-02cb6e-597445cf66-rnz96" podStartSLOduration=1.388053416 podStartE2EDuration="1.861810229s" totalImagesPullingTime="473.756813ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:40:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:40:23.861625969 +0000 UTC m=+2889.042658933" watchObservedRunningTime="2026-07-17 11:40:23.861810229 +0000 UTC m=+2889.042843192"
Jul 17 11:40:29.844477 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:29.844425    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-02cb6e-597445cf66-rnz96"
Jul 17 11:40:30.573638 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:30.573604    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-42637c-695684fc6d-f9xw2"]
Jul 17 11:40:30.576955 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:30.576938    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-42637c-695684fc6d-f9xw2"
Jul 17 11:40:30.582663 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:30.582640    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-42637c-serving-cert\""
Jul 17 11:40:30.617101 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:30.617076    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-42637c-695684fc6d-f9xw2"]
Jul 17 11:40:30.719926 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:30.719886    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73aac484-0b17-4595-9663-246a25ced168-maas-api-tls\") pod \"maas-api-e2e-api-b-42637c-695684fc6d-f9xw2\" (UID: \"73aac484-0b17-4595-9663-246a25ced168\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-42637c-695684fc6d-f9xw2"
Jul 17 11:40:30.719926 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:30.719931    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73aac484-0b17-4595-9663-246a25ced168-openshift-service-ca\") pod \"maas-api-e2e-api-b-42637c-695684fc6d-f9xw2\" (UID: \"73aac484-0b17-4595-9663-246a25ced168\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-42637c-695684fc6d-f9xw2"
Jul 17 11:40:30.720176 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:30.720075    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2zdw\" (UniqueName: \"kubernetes.io/projected/73aac484-0b17-4595-9663-246a25ced168-kube-api-access-h2zdw\") pod \"maas-api-e2e-api-b-42637c-695684fc6d-f9xw2\" (UID: \"73aac484-0b17-4595-9663-246a25ced168\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-42637c-695684fc6d-f9xw2"
Jul 17 11:40:30.820745 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:30.820708    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2zdw\" (UniqueName: \"kubernetes.io/projected/73aac484-0b17-4595-9663-246a25ced168-kube-api-access-h2zdw\") pod \"maas-api-e2e-api-b-42637c-695684fc6d-f9xw2\" (UID: \"73aac484-0b17-4595-9663-246a25ced168\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-42637c-695684fc6d-f9xw2"
Jul 17 11:40:30.820929 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:30.820766    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73aac484-0b17-4595-9663-246a25ced168-maas-api-tls\") pod \"maas-api-e2e-api-b-42637c-695684fc6d-f9xw2\" (UID: \"73aac484-0b17-4595-9663-246a25ced168\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-42637c-695684fc6d-f9xw2"
Jul 17 11:40:30.820929 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:30.820791    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73aac484-0b17-4595-9663-246a25ced168-openshift-service-ca\") pod \"maas-api-e2e-api-b-42637c-695684fc6d-f9xw2\" (UID: \"73aac484-0b17-4595-9663-246a25ced168\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-42637c-695684fc6d-f9xw2"
Jul 17 11:40:30.820929 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:40:30.820900    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-42637c-serving-cert: secret "maas-api-e2e-api-b-42637c-serving-cert" not found
Jul 17 11:40:30.821129 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:40:30.820968    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73aac484-0b17-4595-9663-246a25ced168-maas-api-tls podName:73aac484-0b17-4595-9663-246a25ced168 nodeName:}" failed. No retries permitted until 2026-07-17 11:40:31.320951471 +0000 UTC m=+2896.501984411 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/73aac484-0b17-4595-9663-246a25ced168-maas-api-tls") pod "maas-api-e2e-api-b-42637c-695684fc6d-f9xw2" (UID: "73aac484-0b17-4595-9663-246a25ced168") : secret "maas-api-e2e-api-b-42637c-serving-cert" not found
Jul 17 11:40:30.821481 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:30.821461    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73aac484-0b17-4595-9663-246a25ced168-openshift-service-ca\") pod \"maas-api-e2e-api-b-42637c-695684fc6d-f9xw2\" (UID: \"73aac484-0b17-4595-9663-246a25ced168\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-42637c-695684fc6d-f9xw2"
Jul 17 11:40:30.831020 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:30.830969    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2zdw\" (UniqueName: \"kubernetes.io/projected/73aac484-0b17-4595-9663-246a25ced168-kube-api-access-h2zdw\") pod \"maas-api-e2e-api-b-42637c-695684fc6d-f9xw2\" (UID: \"73aac484-0b17-4595-9663-246a25ced168\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-42637c-695684fc6d-f9xw2"
Jul 17 11:40:31.326294 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:31.326257    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73aac484-0b17-4595-9663-246a25ced168-maas-api-tls\") pod \"maas-api-e2e-api-b-42637c-695684fc6d-f9xw2\" (UID: \"73aac484-0b17-4595-9663-246a25ced168\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-42637c-695684fc6d-f9xw2"
Jul 17 11:40:31.328822 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:31.328796    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73aac484-0b17-4595-9663-246a25ced168-maas-api-tls\") pod \"maas-api-e2e-api-b-42637c-695684fc6d-f9xw2\" (UID: \"73aac484-0b17-4595-9663-246a25ced168\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-42637c-695684fc6d-f9xw2"
Jul 17 11:40:31.488676 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:31.488646    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-42637c-695684fc6d-f9xw2"
Jul 17 11:40:31.628698 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:31.628669    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-42637c-695684fc6d-f9xw2"]
Jul 17 11:40:31.631015 ip-10-0-143-12 kubenswrapper[2563]: W0717 11:40:31.630990    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73aac484_0b17_4595_9663_246a25ced168.slice/crio-b533461b819e63b0acfbeeb5d3b4e6a94435873e4828107c184b9c719e829a06 WatchSource:0}: Error finding container b533461b819e63b0acfbeeb5d3b4e6a94435873e4828107c184b9c719e829a06: Status 404 returned error can't find the container with id b533461b819e63b0acfbeeb5d3b4e6a94435873e4828107c184b9c719e829a06
Jul 17 11:40:31.872061 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:31.872022    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-42637c-695684fc6d-f9xw2" event={"ID":"73aac484-0b17-4595-9663-246a25ced168","Type":"ContainerStarted","Data":"b533461b819e63b0acfbeeb5d3b4e6a94435873e4828107c184b9c719e829a06"}
Jul 17 11:40:32.879422 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:32.879382    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-42637c-695684fc6d-f9xw2" event={"ID":"73aac484-0b17-4595-9663-246a25ced168","Type":"ContainerStarted","Data":"0eea8b0587b998b65ba05f5b1bf6f111481702022b0b35fea21972db48b9849c"}
Jul 17 11:40:32.879850 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:32.879550    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-42637c-695684fc6d-f9xw2"
Jul 17 11:40:32.899491 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:32.899420    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-42637c-695684fc6d-f9xw2" podStartSLOduration=2.497305511 podStartE2EDuration="2.899400203s" totalImagesPullingTime="402.094692ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:40:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:40:32.89639767 +0000 UTC m=+2898.077430630" watchObservedRunningTime="2026-07-17 11:40:32.899400203 +0000 UTC m=+2898.080433169"
Jul 17 11:40:38.889860 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:38.889829    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-42637c-695684fc6d-f9xw2"
Jul 17 11:40:53.081220 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:53.081066    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-02cb6e-597445cf66-rnz96"]
Jul 17 11:40:53.081822 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:53.081314    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-02cb6e-597445cf66-rnz96" podUID="4cd50311-0230-4b8c-8ac3-476a6c85bed4" containerName="maas-api" containerID="cri-o://d9a674a375b280d4c39a2659cc0eb2fefcdcd8e1b016d42bd665b0ade7db1cac" gracePeriod=30
Jul 17 11:40:53.330993 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:53.330968    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-02cb6e-597445cf66-rnz96"
Jul 17 11:40:53.512936 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:53.512908    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4cd50311-0230-4b8c-8ac3-476a6c85bed4-maas-api-tls\") pod \"4cd50311-0230-4b8c-8ac3-476a6c85bed4\" (UID: \"4cd50311-0230-4b8c-8ac3-476a6c85bed4\") "
Jul 17 11:40:53.513142 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:53.512985    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7p75\" (UniqueName: \"kubernetes.io/projected/4cd50311-0230-4b8c-8ac3-476a6c85bed4-kube-api-access-h7p75\") pod \"4cd50311-0230-4b8c-8ac3-476a6c85bed4\" (UID: \"4cd50311-0230-4b8c-8ac3-476a6c85bed4\") "
Jul 17 11:40:53.513142 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:53.513045    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cd50311-0230-4b8c-8ac3-476a6c85bed4-openshift-service-ca\") pod \"4cd50311-0230-4b8c-8ac3-476a6c85bed4\" (UID: \"4cd50311-0230-4b8c-8ac3-476a6c85bed4\") "
Jul 17 11:40:53.513417 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:53.513391    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cd50311-0230-4b8c-8ac3-476a6c85bed4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4cd50311-0230-4b8c-8ac3-476a6c85bed4" (UID: "4cd50311-0230-4b8c-8ac3-476a6c85bed4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:40:53.515004 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:53.514970    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cd50311-0230-4b8c-8ac3-476a6c85bed4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4cd50311-0230-4b8c-8ac3-476a6c85bed4" (UID: "4cd50311-0230-4b8c-8ac3-476a6c85bed4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:40:53.515098 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:53.515049    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cd50311-0230-4b8c-8ac3-476a6c85bed4-kube-api-access-h7p75" (OuterVolumeSpecName: "kube-api-access-h7p75") pod "4cd50311-0230-4b8c-8ac3-476a6c85bed4" (UID: "4cd50311-0230-4b8c-8ac3-476a6c85bed4"). InnerVolumeSpecName "kube-api-access-h7p75". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:40:53.614614 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:53.614584    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7p75\" (UniqueName: \"kubernetes.io/projected/4cd50311-0230-4b8c-8ac3-476a6c85bed4-kube-api-access-h7p75\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:40:53.614614 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:53.614610    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cd50311-0230-4b8c-8ac3-476a6c85bed4-openshift-service-ca\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:40:53.614755 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:53.614619    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4cd50311-0230-4b8c-8ac3-476a6c85bed4-maas-api-tls\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:40:53.977814 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:53.977779    2563 generic.go:356] "Generic (PLEG): container finished" podID="4cd50311-0230-4b8c-8ac3-476a6c85bed4" containerID="d9a674a375b280d4c39a2659cc0eb2fefcdcd8e1b016d42bd665b0ade7db1cac" exitCode=0
Jul 17 11:40:53.978002 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:53.977823    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-02cb6e-597445cf66-rnz96" event={"ID":"4cd50311-0230-4b8c-8ac3-476a6c85bed4","Type":"ContainerDied","Data":"d9a674a375b280d4c39a2659cc0eb2fefcdcd8e1b016d42bd665b0ade7db1cac"}
Jul 17 11:40:53.978002 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:53.977869    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-02cb6e-597445cf66-rnz96" event={"ID":"4cd50311-0230-4b8c-8ac3-476a6c85bed4","Type":"ContainerDied","Data":"7e9de96475880b8c39914d2486996d7808051a3de3460141677d4399d6c46a7b"}
Jul 17 11:40:53.978002 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:53.977892    2563 scope.go:117] "RemoveContainer" containerID="d9a674a375b280d4c39a2659cc0eb2fefcdcd8e1b016d42bd665b0ade7db1cac"
Jul 17 11:40:53.978002 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:53.977824    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-02cb6e-597445cf66-rnz96"
Jul 17 11:40:53.987563 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:53.987546    2563 scope.go:117] "RemoveContainer" containerID="d9a674a375b280d4c39a2659cc0eb2fefcdcd8e1b016d42bd665b0ade7db1cac"
Jul 17 11:40:53.987849 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:40:53.987831    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9a674a375b280d4c39a2659cc0eb2fefcdcd8e1b016d42bd665b0ade7db1cac\": container with ID starting with d9a674a375b280d4c39a2659cc0eb2fefcdcd8e1b016d42bd665b0ade7db1cac not found: ID does not exist" containerID="d9a674a375b280d4c39a2659cc0eb2fefcdcd8e1b016d42bd665b0ade7db1cac"
Jul 17 11:40:53.987918 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:53.987857    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9a674a375b280d4c39a2659cc0eb2fefcdcd8e1b016d42bd665b0ade7db1cac"} err="failed to get container status \"d9a674a375b280d4c39a2659cc0eb2fefcdcd8e1b016d42bd665b0ade7db1cac\": rpc error: code = NotFound desc = could not find container \"d9a674a375b280d4c39a2659cc0eb2fefcdcd8e1b016d42bd665b0ade7db1cac\": container with ID starting with d9a674a375b280d4c39a2659cc0eb2fefcdcd8e1b016d42bd665b0ade7db1cac not found: ID does not exist"
Jul 17 11:40:54.000014 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:53.999986    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-02cb6e-597445cf66-rnz96"]
Jul 17 11:40:54.004556 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:54.004536    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-02cb6e-597445cf66-rnz96"]
Jul 17 11:40:55.264765 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:40:55.264737    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cd50311-0230-4b8c-8ac3-476a6c85bed4" path="/var/lib/kubelet/pods/4cd50311-0230-4b8c-8ac3-476a6c85bed4/volumes"
Jul 17 11:41:19.626941 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:19.626901    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-42637c-695684fc6d-f9xw2"]
Jul 17 11:41:19.627382 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:19.627147    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-42637c-695684fc6d-f9xw2" podUID="73aac484-0b17-4595-9663-246a25ced168" containerName="maas-api" containerID="cri-o://0eea8b0587b998b65ba05f5b1bf6f111481702022b0b35fea21972db48b9849c" gracePeriod=30
Jul 17 11:41:19.878572 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:19.878509    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-42637c-695684fc6d-f9xw2"
Jul 17 11:41:19.925049 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:19.925023    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73aac484-0b17-4595-9663-246a25ced168-maas-api-tls\") pod \"73aac484-0b17-4595-9663-246a25ced168\" (UID: \"73aac484-0b17-4595-9663-246a25ced168\") "
Jul 17 11:41:19.925219 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:19.925123    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2zdw\" (UniqueName: \"kubernetes.io/projected/73aac484-0b17-4595-9663-246a25ced168-kube-api-access-h2zdw\") pod \"73aac484-0b17-4595-9663-246a25ced168\" (UID: \"73aac484-0b17-4595-9663-246a25ced168\") "
Jul 17 11:41:19.925219 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:19.925158    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73aac484-0b17-4595-9663-246a25ced168-openshift-service-ca\") pod \"73aac484-0b17-4595-9663-246a25ced168\" (UID: \"73aac484-0b17-4595-9663-246a25ced168\") "
Jul 17 11:41:19.925683 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:19.925589    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73aac484-0b17-4595-9663-246a25ced168-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "73aac484-0b17-4595-9663-246a25ced168" (UID: "73aac484-0b17-4595-9663-246a25ced168"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:41:19.927281 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:19.927258    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73aac484-0b17-4595-9663-246a25ced168-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "73aac484-0b17-4595-9663-246a25ced168" (UID: "73aac484-0b17-4595-9663-246a25ced168"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:41:19.927424 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:19.927402    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73aac484-0b17-4595-9663-246a25ced168-kube-api-access-h2zdw" (OuterVolumeSpecName: "kube-api-access-h2zdw") pod "73aac484-0b17-4595-9663-246a25ced168" (UID: "73aac484-0b17-4595-9663-246a25ced168"). InnerVolumeSpecName "kube-api-access-h2zdw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:41:20.026647 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:20.026621    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73aac484-0b17-4595-9663-246a25ced168-maas-api-tls\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:41:20.026647 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:20.026645    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2zdw\" (UniqueName: \"kubernetes.io/projected/73aac484-0b17-4595-9663-246a25ced168-kube-api-access-h2zdw\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:41:20.026785 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:20.026656    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73aac484-0b17-4595-9663-246a25ced168-openshift-service-ca\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:41:20.097029 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:20.097000    2563 generic.go:356] "Generic (PLEG): container finished" podID="73aac484-0b17-4595-9663-246a25ced168" containerID="0eea8b0587b998b65ba05f5b1bf6f111481702022b0b35fea21972db48b9849c" exitCode=0
Jul 17 11:41:20.097203 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:20.097044    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-42637c-695684fc6d-f9xw2"
Jul 17 11:41:20.097203 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:20.097091    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-42637c-695684fc6d-f9xw2" event={"ID":"73aac484-0b17-4595-9663-246a25ced168","Type":"ContainerDied","Data":"0eea8b0587b998b65ba05f5b1bf6f111481702022b0b35fea21972db48b9849c"}
Jul 17 11:41:20.097203 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:20.097158    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-42637c-695684fc6d-f9xw2" event={"ID":"73aac484-0b17-4595-9663-246a25ced168","Type":"ContainerDied","Data":"b533461b819e63b0acfbeeb5d3b4e6a94435873e4828107c184b9c719e829a06"}
Jul 17 11:41:20.097203 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:20.097187    2563 scope.go:117] "RemoveContainer" containerID="0eea8b0587b998b65ba05f5b1bf6f111481702022b0b35fea21972db48b9849c"
Jul 17 11:41:20.105786 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:20.105771    2563 scope.go:117] "RemoveContainer" containerID="0eea8b0587b998b65ba05f5b1bf6f111481702022b0b35fea21972db48b9849c"
Jul 17 11:41:20.106039 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:41:20.106022    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0eea8b0587b998b65ba05f5b1bf6f111481702022b0b35fea21972db48b9849c\": container with ID starting with 0eea8b0587b998b65ba05f5b1bf6f111481702022b0b35fea21972db48b9849c not found: ID does not exist" containerID="0eea8b0587b998b65ba05f5b1bf6f111481702022b0b35fea21972db48b9849c"
Jul 17 11:41:20.106092 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:20.106048    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0eea8b0587b998b65ba05f5b1bf6f111481702022b0b35fea21972db48b9849c"} err="failed to get container status \"0eea8b0587b998b65ba05f5b1bf6f111481702022b0b35fea21972db48b9849c\": rpc error: code = NotFound desc = could not find container \"0eea8b0587b998b65ba05f5b1bf6f111481702022b0b35fea21972db48b9849c\": container with ID starting with 0eea8b0587b998b65ba05f5b1bf6f111481702022b0b35fea21972db48b9849c not found: ID does not exist"
Jul 17 11:41:20.119180 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:20.119159    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-42637c-695684fc6d-f9xw2"]
Jul 17 11:41:20.123588 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:20.123568    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-42637c-695684fc6d-f9xw2"]
Jul 17 11:41:21.265244 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:21.265211    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73aac484-0b17-4595-9663-246a25ced168" path="/var/lib/kubelet/pods/73aac484-0b17-4595-9663-246a25ced168/volumes"
Jul 17 11:41:39.411037 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:39.410960    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-bbe1d4-764cdd7947-8cnzk"]
Jul 17 11:41:39.411425 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:39.411310    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73aac484-0b17-4595-9663-246a25ced168" containerName="maas-api"
Jul 17 11:41:39.411425 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:39.411321    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="73aac484-0b17-4595-9663-246a25ced168" containerName="maas-api"
Jul 17 11:41:39.411425 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:39.411332    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cd50311-0230-4b8c-8ac3-476a6c85bed4" containerName="maas-api"
Jul 17 11:41:39.411425 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:39.411337    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cd50311-0230-4b8c-8ac3-476a6c85bed4" containerName="maas-api"
Jul 17 11:41:39.411425 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:39.411386    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cd50311-0230-4b8c-8ac3-476a6c85bed4" containerName="maas-api"
Jul 17 11:41:39.411425 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:39.411393    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="73aac484-0b17-4595-9663-246a25ced168" containerName="maas-api"
Jul 17 11:41:39.420015 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:39.419984    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bbe1d4-764cdd7947-8cnzk"
Jul 17 11:41:39.424489 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:39.424465    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-bbe1d4-serving-cert\""
Jul 17 11:41:39.427185 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:39.427162    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-bbe1d4-764cdd7947-8cnzk"]
Jul 17 11:41:39.494929 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:39.494898    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9bc5c07-9974-4e62-8787-3b6932321973-maas-api-tls\") pod \"maas-api-e2e-shared-a-bbe1d4-764cdd7947-8cnzk\" (UID: \"c9bc5c07-9974-4e62-8787-3b6932321973\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bbe1d4-764cdd7947-8cnzk"
Jul 17 11:41:39.495092 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:39.494980    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd6h6\" (UniqueName: \"kubernetes.io/projected/c9bc5c07-9974-4e62-8787-3b6932321973-kube-api-access-hd6h6\") pod \"maas-api-e2e-shared-a-bbe1d4-764cdd7947-8cnzk\" (UID: \"c9bc5c07-9974-4e62-8787-3b6932321973\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bbe1d4-764cdd7947-8cnzk"
Jul 17 11:41:39.495092 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:39.495002    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9bc5c07-9974-4e62-8787-3b6932321973-openshift-service-ca\") pod \"maas-api-e2e-shared-a-bbe1d4-764cdd7947-8cnzk\" (UID: \"c9bc5c07-9974-4e62-8787-3b6932321973\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bbe1d4-764cdd7947-8cnzk"
Jul 17 11:41:39.596168 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:39.596132    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd6h6\" (UniqueName: \"kubernetes.io/projected/c9bc5c07-9974-4e62-8787-3b6932321973-kube-api-access-hd6h6\") pod \"maas-api-e2e-shared-a-bbe1d4-764cdd7947-8cnzk\" (UID: \"c9bc5c07-9974-4e62-8787-3b6932321973\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bbe1d4-764cdd7947-8cnzk"
Jul 17 11:41:39.596168 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:39.596169    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9bc5c07-9974-4e62-8787-3b6932321973-openshift-service-ca\") pod \"maas-api-e2e-shared-a-bbe1d4-764cdd7947-8cnzk\" (UID: \"c9bc5c07-9974-4e62-8787-3b6932321973\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bbe1d4-764cdd7947-8cnzk"
Jul 17 11:41:39.596363 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:39.596212    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9bc5c07-9974-4e62-8787-3b6932321973-maas-api-tls\") pod \"maas-api-e2e-shared-a-bbe1d4-764cdd7947-8cnzk\" (UID: \"c9bc5c07-9974-4e62-8787-3b6932321973\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bbe1d4-764cdd7947-8cnzk"
Jul 17 11:41:39.596363 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:41:39.596295    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-bbe1d4-serving-cert: secret "maas-api-e2e-shared-a-bbe1d4-serving-cert" not found
Jul 17 11:41:39.596363 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:41:39.596356    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9bc5c07-9974-4e62-8787-3b6932321973-maas-api-tls podName:c9bc5c07-9974-4e62-8787-3b6932321973 nodeName:}" failed. No retries permitted until 2026-07-17 11:41:40.096334663 +0000 UTC m=+2965.277367612 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c9bc5c07-9974-4e62-8787-3b6932321973-maas-api-tls") pod "maas-api-e2e-shared-a-bbe1d4-764cdd7947-8cnzk" (UID: "c9bc5c07-9974-4e62-8787-3b6932321973") : secret "maas-api-e2e-shared-a-bbe1d4-serving-cert" not found
Jul 17 11:41:39.596930 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:39.596910    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9bc5c07-9974-4e62-8787-3b6932321973-openshift-service-ca\") pod \"maas-api-e2e-shared-a-bbe1d4-764cdd7947-8cnzk\" (UID: \"c9bc5c07-9974-4e62-8787-3b6932321973\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bbe1d4-764cdd7947-8cnzk"
Jul 17 11:41:39.611605 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:39.611581    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd6h6\" (UniqueName: \"kubernetes.io/projected/c9bc5c07-9974-4e62-8787-3b6932321973-kube-api-access-hd6h6\") pod \"maas-api-e2e-shared-a-bbe1d4-764cdd7947-8cnzk\" (UID: \"c9bc5c07-9974-4e62-8787-3b6932321973\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bbe1d4-764cdd7947-8cnzk"
Jul 17 11:41:40.100792 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:40.100755    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9bc5c07-9974-4e62-8787-3b6932321973-maas-api-tls\") pod \"maas-api-e2e-shared-a-bbe1d4-764cdd7947-8cnzk\" (UID: \"c9bc5c07-9974-4e62-8787-3b6932321973\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bbe1d4-764cdd7947-8cnzk"
Jul 17 11:41:40.103297 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:40.103271    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9bc5c07-9974-4e62-8787-3b6932321973-maas-api-tls\") pod \"maas-api-e2e-shared-a-bbe1d4-764cdd7947-8cnzk\" (UID: \"c9bc5c07-9974-4e62-8787-3b6932321973\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bbe1d4-764cdd7947-8cnzk"
Jul 17 11:41:40.332262 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:40.332230    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bbe1d4-764cdd7947-8cnzk"
Jul 17 11:41:40.688808 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:40.688780    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-bbe1d4-764cdd7947-8cnzk"]
Jul 17 11:41:40.691614 ip-10-0-143-12 kubenswrapper[2563]: W0717 11:41:40.691583    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9bc5c07_9974_4e62_8787_3b6932321973.slice/crio-b6f9c8a842907f64df1f628af6e4a90854a6f37cef2b2d29f8a39c5222cdb9f7 WatchSource:0}: Error finding container b6f9c8a842907f64df1f628af6e4a90854a6f37cef2b2d29f8a39c5222cdb9f7: Status 404 returned error can't find the container with id b6f9c8a842907f64df1f628af6e4a90854a6f37cef2b2d29f8a39c5222cdb9f7
Jul 17 11:41:41.191919 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:41.191881    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bbe1d4-764cdd7947-8cnzk" event={"ID":"c9bc5c07-9974-4e62-8787-3b6932321973","Type":"ContainerStarted","Data":"b6f9c8a842907f64df1f628af6e4a90854a6f37cef2b2d29f8a39c5222cdb9f7"}
Jul 17 11:41:42.198689 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:42.198655    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bbe1d4-764cdd7947-8cnzk" event={"ID":"c9bc5c07-9974-4e62-8787-3b6932321973","Type":"ContainerStarted","Data":"d4a6415dc0500ffa44e127d625110248f3bbdb254527fd81fc4b488702113857"}
Jul 17 11:41:42.199067 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:42.198785    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bbe1d4-764cdd7947-8cnzk"
Jul 17 11:41:42.217797 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:42.217753    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bbe1d4-764cdd7947-8cnzk" podStartSLOduration=2.778563963 podStartE2EDuration="3.217738647s" totalImagesPullingTime="439.174684ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:41:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:41:42.216174803 +0000 UTC m=+2967.397207776" watchObservedRunningTime="2026-07-17 11:41:42.217738647 +0000 UTC m=+2967.398771609"
Jul 17 11:41:47.966675 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:47.966634    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-7df590-6b4559d6bf-g79d2"]
Jul 17 11:41:47.970322 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:47.970297    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7df590-6b4559d6bf-g79d2"
Jul 17 11:41:47.973053 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:47.973035    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-7df590-serving-cert\""
Jul 17 11:41:47.983658 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:47.983636    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-7df590-6b4559d6bf-g79d2"]
Jul 17 11:41:48.069324 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:48.069290    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpl64\" (UniqueName: \"kubernetes.io/projected/e4872e1c-5d24-4874-86ba-7fc0599c8989-kube-api-access-lpl64\") pod \"maas-api-e2e-shared-b-7df590-6b4559d6bf-g79d2\" (UID: \"e4872e1c-5d24-4874-86ba-7fc0599c8989\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7df590-6b4559d6bf-g79d2"
Jul 17 11:41:48.069324 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:48.069328    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4872e1c-5d24-4874-86ba-7fc0599c8989-openshift-service-ca\") pod \"maas-api-e2e-shared-b-7df590-6b4559d6bf-g79d2\" (UID: \"e4872e1c-5d24-4874-86ba-7fc0599c8989\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7df590-6b4559d6bf-g79d2"
Jul 17 11:41:48.069568 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:48.069399    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4872e1c-5d24-4874-86ba-7fc0599c8989-maas-api-tls\") pod \"maas-api-e2e-shared-b-7df590-6b4559d6bf-g79d2\" (UID: \"e4872e1c-5d24-4874-86ba-7fc0599c8989\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7df590-6b4559d6bf-g79d2"
Jul 17 11:41:48.170371 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:48.170339    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpl64\" (UniqueName: \"kubernetes.io/projected/e4872e1c-5d24-4874-86ba-7fc0599c8989-kube-api-access-lpl64\") pod \"maas-api-e2e-shared-b-7df590-6b4559d6bf-g79d2\" (UID: \"e4872e1c-5d24-4874-86ba-7fc0599c8989\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7df590-6b4559d6bf-g79d2"
Jul 17 11:41:48.170546 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:48.170376    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4872e1c-5d24-4874-86ba-7fc0599c8989-openshift-service-ca\") pod \"maas-api-e2e-shared-b-7df590-6b4559d6bf-g79d2\" (UID: \"e4872e1c-5d24-4874-86ba-7fc0599c8989\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7df590-6b4559d6bf-g79d2"
Jul 17 11:41:48.170546 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:48.170423    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4872e1c-5d24-4874-86ba-7fc0599c8989-maas-api-tls\") pod \"maas-api-e2e-shared-b-7df590-6b4559d6bf-g79d2\" (UID: \"e4872e1c-5d24-4874-86ba-7fc0599c8989\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7df590-6b4559d6bf-g79d2"
Jul 17 11:41:48.170642 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:41:48.170561    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-7df590-serving-cert: secret "maas-api-e2e-shared-b-7df590-serving-cert" not found
Jul 17 11:41:48.170642 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:41:48.170611    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4872e1c-5d24-4874-86ba-7fc0599c8989-maas-api-tls podName:e4872e1c-5d24-4874-86ba-7fc0599c8989 nodeName:}" failed. No retries permitted until 2026-07-17 11:41:48.670594383 +0000 UTC m=+2973.851627324 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e4872e1c-5d24-4874-86ba-7fc0599c8989-maas-api-tls") pod "maas-api-e2e-shared-b-7df590-6b4559d6bf-g79d2" (UID: "e4872e1c-5d24-4874-86ba-7fc0599c8989") : secret "maas-api-e2e-shared-b-7df590-serving-cert" not found
Jul 17 11:41:48.171091 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:48.171061    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4872e1c-5d24-4874-86ba-7fc0599c8989-openshift-service-ca\") pod \"maas-api-e2e-shared-b-7df590-6b4559d6bf-g79d2\" (UID: \"e4872e1c-5d24-4874-86ba-7fc0599c8989\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7df590-6b4559d6bf-g79d2"
Jul 17 11:41:48.179264 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:48.179235    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpl64\" (UniqueName: \"kubernetes.io/projected/e4872e1c-5d24-4874-86ba-7fc0599c8989-kube-api-access-lpl64\") pod \"maas-api-e2e-shared-b-7df590-6b4559d6bf-g79d2\" (UID: \"e4872e1c-5d24-4874-86ba-7fc0599c8989\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7df590-6b4559d6bf-g79d2"
Jul 17 11:41:48.208269 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:48.208242    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bbe1d4-764cdd7947-8cnzk"
Jul 17 11:41:48.674608 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:48.674571    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4872e1c-5d24-4874-86ba-7fc0599c8989-maas-api-tls\") pod \"maas-api-e2e-shared-b-7df590-6b4559d6bf-g79d2\" (UID: \"e4872e1c-5d24-4874-86ba-7fc0599c8989\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7df590-6b4559d6bf-g79d2"
Jul 17 11:41:48.677044 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:48.677021    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4872e1c-5d24-4874-86ba-7fc0599c8989-maas-api-tls\") pod \"maas-api-e2e-shared-b-7df590-6b4559d6bf-g79d2\" (UID: \"e4872e1c-5d24-4874-86ba-7fc0599c8989\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7df590-6b4559d6bf-g79d2"
Jul 17 11:41:48.881282 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:48.881240    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7df590-6b4559d6bf-g79d2"
Jul 17 11:41:49.018484 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:49.018458    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-7df590-6b4559d6bf-g79d2"]
Jul 17 11:41:49.021222 ip-10-0-143-12 kubenswrapper[2563]: W0717 11:41:49.021187    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4872e1c_5d24_4874_86ba_7fc0599c8989.slice/crio-282cf8c39de9202941f5bb92a90292fd72f4d794c889f1bc5c6660d140d65a44 WatchSource:0}: Error finding container 282cf8c39de9202941f5bb92a90292fd72f4d794c889f1bc5c6660d140d65a44: Status 404 returned error can't find the container with id 282cf8c39de9202941f5bb92a90292fd72f4d794c889f1bc5c6660d140d65a44
Jul 17 11:41:49.231689 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:49.231601    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7df590-6b4559d6bf-g79d2" event={"ID":"e4872e1c-5d24-4874-86ba-7fc0599c8989","Type":"ContainerStarted","Data":"282cf8c39de9202941f5bb92a90292fd72f4d794c889f1bc5c6660d140d65a44"}
Jul 17 11:41:50.237371 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:50.237324    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7df590-6b4559d6bf-g79d2" event={"ID":"e4872e1c-5d24-4874-86ba-7fc0599c8989","Type":"ContainerStarted","Data":"0a69324f0cd0bddf0ab063a127f6cfb4f73a5f80e7ab21b9504e4d4921952e80"}
Jul 17 11:41:50.237769 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:50.237474    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7df590-6b4559d6bf-g79d2"
Jul 17 11:41:50.254926 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:50.254884    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7df590-6b4559d6bf-g79d2" podStartSLOduration=2.824858143 podStartE2EDuration="3.254869962s" totalImagesPullingTime="430.011819ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:41:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:41:50.253031193 +0000 UTC m=+2975.434064156" watchObservedRunningTime="2026-07-17 11:41:50.254869962 +0000 UTC m=+2975.435902970"
Jul 17 11:41:56.247886 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:41:56.247856    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7df590-6b4559d6bf-g79d2"
Jul 17 11:42:15.438827 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:42:15.438793    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xdrhl_48cc1998-ebc5-4702-8b08-027479580e57/ovn-acl-logging/0.log"
Jul 17 11:42:15.447338 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:42:15.447315    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xdrhl_48cc1998-ebc5-4702-8b08-027479580e57/ovn-acl-logging/0.log"
Jul 17 11:47:15.466867 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:47:15.466838    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xdrhl_48cc1998-ebc5-4702-8b08-027479580e57/ovn-acl-logging/0.log"
Jul 17 11:47:15.476353 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:47:15.476323    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xdrhl_48cc1998-ebc5-4702-8b08-027479580e57/ovn-acl-logging/0.log"
Jul 17 11:47:38.357145 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:47:38.357016    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-bbe1d4-764cdd7947-8cnzk"]
Jul 17 11:47:38.357672 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:47:38.357267    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bbe1d4-764cdd7947-8cnzk" podUID="c9bc5c07-9974-4e62-8787-3b6932321973" containerName="maas-api" containerID="cri-o://d4a6415dc0500ffa44e127d625110248f3bbdb254527fd81fc4b488702113857" gracePeriod=30
Jul 17 11:47:38.600632 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:47:38.600605    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bbe1d4-764cdd7947-8cnzk"
Jul 17 11:47:38.653678 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:47:38.653648    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hd6h6\" (UniqueName: \"kubernetes.io/projected/c9bc5c07-9974-4e62-8787-3b6932321973-kube-api-access-hd6h6\") pod \"c9bc5c07-9974-4e62-8787-3b6932321973\" (UID: \"c9bc5c07-9974-4e62-8787-3b6932321973\") "
Jul 17 11:47:38.653845 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:47:38.653716    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9bc5c07-9974-4e62-8787-3b6932321973-maas-api-tls\") pod \"c9bc5c07-9974-4e62-8787-3b6932321973\" (UID: \"c9bc5c07-9974-4e62-8787-3b6932321973\") "
Jul 17 11:47:38.653845 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:47:38.653800    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9bc5c07-9974-4e62-8787-3b6932321973-openshift-service-ca\") pod \"c9bc5c07-9974-4e62-8787-3b6932321973\" (UID: \"c9bc5c07-9974-4e62-8787-3b6932321973\") "
Jul 17 11:47:38.654115 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:47:38.654093    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9bc5c07-9974-4e62-8787-3b6932321973-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c9bc5c07-9974-4e62-8787-3b6932321973" (UID: "c9bc5c07-9974-4e62-8787-3b6932321973"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:47:38.655860 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:47:38.655829    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9bc5c07-9974-4e62-8787-3b6932321973-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c9bc5c07-9974-4e62-8787-3b6932321973" (UID: "c9bc5c07-9974-4e62-8787-3b6932321973"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:47:38.655999 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:47:38.655940    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9bc5c07-9974-4e62-8787-3b6932321973-kube-api-access-hd6h6" (OuterVolumeSpecName: "kube-api-access-hd6h6") pod "c9bc5c07-9974-4e62-8787-3b6932321973" (UID: "c9bc5c07-9974-4e62-8787-3b6932321973"). InnerVolumeSpecName "kube-api-access-hd6h6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:47:38.754865 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:47:38.754824    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9bc5c07-9974-4e62-8787-3b6932321973-openshift-service-ca\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:47:38.754865 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:47:38.754859    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hd6h6\" (UniqueName: \"kubernetes.io/projected/c9bc5c07-9974-4e62-8787-3b6932321973-kube-api-access-hd6h6\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:47:38.754865 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:47:38.754873    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9bc5c07-9974-4e62-8787-3b6932321973-maas-api-tls\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:47:38.820902 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:47:38.820865    2563 generic.go:356] "Generic (PLEG): container finished" podID="c9bc5c07-9974-4e62-8787-3b6932321973" containerID="d4a6415dc0500ffa44e127d625110248f3bbdb254527fd81fc4b488702113857" exitCode=0
Jul 17 11:47:38.821058 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:47:38.820915    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bbe1d4-764cdd7947-8cnzk"
Jul 17 11:47:38.821058 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:47:38.820957    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bbe1d4-764cdd7947-8cnzk" event={"ID":"c9bc5c07-9974-4e62-8787-3b6932321973","Type":"ContainerDied","Data":"d4a6415dc0500ffa44e127d625110248f3bbdb254527fd81fc4b488702113857"}
Jul 17 11:47:38.821058 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:47:38.821020    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bbe1d4-764cdd7947-8cnzk" event={"ID":"c9bc5c07-9974-4e62-8787-3b6932321973","Type":"ContainerDied","Data":"b6f9c8a842907f64df1f628af6e4a90854a6f37cef2b2d29f8a39c5222cdb9f7"}
Jul 17 11:47:38.821058 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:47:38.821056    2563 scope.go:117] "RemoveContainer" containerID="d4a6415dc0500ffa44e127d625110248f3bbdb254527fd81fc4b488702113857"
Jul 17 11:47:38.830008 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:47:38.829992    2563 scope.go:117] "RemoveContainer" containerID="d4a6415dc0500ffa44e127d625110248f3bbdb254527fd81fc4b488702113857"
Jul 17 11:47:38.830250 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:47:38.830233    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4a6415dc0500ffa44e127d625110248f3bbdb254527fd81fc4b488702113857\": container with ID starting with d4a6415dc0500ffa44e127d625110248f3bbdb254527fd81fc4b488702113857 not found: ID does not exist" containerID="d4a6415dc0500ffa44e127d625110248f3bbdb254527fd81fc4b488702113857"
Jul 17 11:47:38.830311 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:47:38.830258    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4a6415dc0500ffa44e127d625110248f3bbdb254527fd81fc4b488702113857"} err="failed to get container status \"d4a6415dc0500ffa44e127d625110248f3bbdb254527fd81fc4b488702113857\": rpc error: code = NotFound desc = could not find container \"d4a6415dc0500ffa44e127d625110248f3bbdb254527fd81fc4b488702113857\": container with ID starting with d4a6415dc0500ffa44e127d625110248f3bbdb254527fd81fc4b488702113857 not found: ID does not exist"
Jul 17 11:47:38.841157 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:47:38.841133    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-bbe1d4-764cdd7947-8cnzk"]
Jul 17 11:47:38.846097 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:47:38.846077    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-bbe1d4-764cdd7947-8cnzk"]
Jul 17 11:47:39.265316 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:47:39.265279    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9bc5c07-9974-4e62-8787-3b6932321973" path="/var/lib/kubelet/pods/c9bc5c07-9974-4e62-8787-3b6932321973/volumes"
Jul 17 11:48:04.461554 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:04.461520    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-7df590-6b4559d6bf-g79d2"]
Jul 17 11:48:04.462143 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:04.461793    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7df590-6b4559d6bf-g79d2" podUID="e4872e1c-5d24-4874-86ba-7fc0599c8989" containerName="maas-api" containerID="cri-o://0a69324f0cd0bddf0ab063a127f6cfb4f73a5f80e7ab21b9504e4d4921952e80" gracePeriod=30
Jul 17 11:48:04.909549 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:04.909522    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7df590-6b4559d6bf-g79d2"
Jul 17 11:48:04.945452 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:04.945397    2563 generic.go:356] "Generic (PLEG): container finished" podID="e4872e1c-5d24-4874-86ba-7fc0599c8989" containerID="0a69324f0cd0bddf0ab063a127f6cfb4f73a5f80e7ab21b9504e4d4921952e80" exitCode=0
Jul 17 11:48:04.945586 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:04.945463    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7df590-6b4559d6bf-g79d2"
Jul 17 11:48:04.945586 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:04.945489    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7df590-6b4559d6bf-g79d2" event={"ID":"e4872e1c-5d24-4874-86ba-7fc0599c8989","Type":"ContainerDied","Data":"0a69324f0cd0bddf0ab063a127f6cfb4f73a5f80e7ab21b9504e4d4921952e80"}
Jul 17 11:48:04.945586 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:04.945547    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7df590-6b4559d6bf-g79d2" event={"ID":"e4872e1c-5d24-4874-86ba-7fc0599c8989","Type":"ContainerDied","Data":"282cf8c39de9202941f5bb92a90292fd72f4d794c889f1bc5c6660d140d65a44"}
Jul 17 11:48:04.945586 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:04.945573    2563 scope.go:117] "RemoveContainer" containerID="0a69324f0cd0bddf0ab063a127f6cfb4f73a5f80e7ab21b9504e4d4921952e80"
Jul 17 11:48:04.953783 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:04.953764    2563 scope.go:117] "RemoveContainer" containerID="0a69324f0cd0bddf0ab063a127f6cfb4f73a5f80e7ab21b9504e4d4921952e80"
Jul 17 11:48:04.954028 ip-10-0-143-12 kubenswrapper[2563]: E0717 11:48:04.954008    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a69324f0cd0bddf0ab063a127f6cfb4f73a5f80e7ab21b9504e4d4921952e80\": container with ID starting with 0a69324f0cd0bddf0ab063a127f6cfb4f73a5f80e7ab21b9504e4d4921952e80 not found: ID does not exist" containerID="0a69324f0cd0bddf0ab063a127f6cfb4f73a5f80e7ab21b9504e4d4921952e80"
Jul 17 11:48:04.954106 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:04.954035    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a69324f0cd0bddf0ab063a127f6cfb4f73a5f80e7ab21b9504e4d4921952e80"} err="failed to get container status \"0a69324f0cd0bddf0ab063a127f6cfb4f73a5f80e7ab21b9504e4d4921952e80\": rpc error: code = NotFound desc = could not find container \"0a69324f0cd0bddf0ab063a127f6cfb4f73a5f80e7ab21b9504e4d4921952e80\": container with ID starting with 0a69324f0cd0bddf0ab063a127f6cfb4f73a5f80e7ab21b9504e4d4921952e80 not found: ID does not exist"
Jul 17 11:48:05.064125 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:05.064062    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpl64\" (UniqueName: \"kubernetes.io/projected/e4872e1c-5d24-4874-86ba-7fc0599c8989-kube-api-access-lpl64\") pod \"e4872e1c-5d24-4874-86ba-7fc0599c8989\" (UID: \"e4872e1c-5d24-4874-86ba-7fc0599c8989\") "
Jul 17 11:48:05.064236 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:05.064150    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4872e1c-5d24-4874-86ba-7fc0599c8989-openshift-service-ca\") pod \"e4872e1c-5d24-4874-86ba-7fc0599c8989\" (UID: \"e4872e1c-5d24-4874-86ba-7fc0599c8989\") "
Jul 17 11:48:05.064236 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:05.064173    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4872e1c-5d24-4874-86ba-7fc0599c8989-maas-api-tls\") pod \"e4872e1c-5d24-4874-86ba-7fc0599c8989\" (UID: \"e4872e1c-5d24-4874-86ba-7fc0599c8989\") "
Jul 17 11:48:05.064514 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:05.064489    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4872e1c-5d24-4874-86ba-7fc0599c8989-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e4872e1c-5d24-4874-86ba-7fc0599c8989" (UID: "e4872e1c-5d24-4874-86ba-7fc0599c8989"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:48:05.066061 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:05.066027    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4872e1c-5d24-4874-86ba-7fc0599c8989-kube-api-access-lpl64" (OuterVolumeSpecName: "kube-api-access-lpl64") pod "e4872e1c-5d24-4874-86ba-7fc0599c8989" (UID: "e4872e1c-5d24-4874-86ba-7fc0599c8989"). InnerVolumeSpecName "kube-api-access-lpl64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:48:05.066163 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:05.066118    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4872e1c-5d24-4874-86ba-7fc0599c8989-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e4872e1c-5d24-4874-86ba-7fc0599c8989" (UID: "e4872e1c-5d24-4874-86ba-7fc0599c8989"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:48:05.165751 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:05.165728    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4872e1c-5d24-4874-86ba-7fc0599c8989-openshift-service-ca\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:48:05.165751 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:05.165751    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4872e1c-5d24-4874-86ba-7fc0599c8989-maas-api-tls\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:48:05.165909 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:05.165760    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpl64\" (UniqueName: \"kubernetes.io/projected/e4872e1c-5d24-4874-86ba-7fc0599c8989-kube-api-access-lpl64\") on node \"ip-10-0-143-12.ec2.internal\" DevicePath \"\""
Jul 17 11:48:05.266110 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:05.266080    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-7df590-6b4559d6bf-g79d2"]
Jul 17 11:48:05.272462 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:05.270655    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-7df590-6b4559d6bf-g79d2"]
Jul 17 11:48:07.264425 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:07.264392    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4872e1c-5d24-4874-86ba-7fc0599c8989" path="/var/lib/kubelet/pods/e4872e1c-5d24-4874-86ba-7fc0599c8989/volumes"
Jul 17 11:48:26.196713 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:26.196679    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-76b5fcbfd-bt5lk_a2d69d0a-6d06-44c3-995b-b75a48582b92/manager/0.log"
Jul 17 11:48:26.668680 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:26.668654    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp_504118f3-6caf-4324-90c3-692d18de714a/copy-manifests/0.log"
Jul 17 11:48:26.690889 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:26.690855    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp_504118f3-6caf-4324-90c3-692d18de714a/manager/0.log"
Jul 17 11:48:27.187172 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:27.187145    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5cbc55679f-lz6l8_1b022cf2-51c3-4af9-b358-ab791b075a6e/maas-api/0.log"
Jul 17 11:48:28.530794 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:28.530760    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-8bml2_cad15fee-0785-4f3b-9394-54129ee30b46/postgres/0.log"
Jul 17 11:48:29.970464 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:29.970416    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-hwjf6_fef1d476-1e14-49ce-92ca-af77a0511610/manager/0.log"
Jul 17 11:48:30.086879 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:30.086844    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-t2lmw_0652b352-b67e-4d5e-a470-196b6d295074/manager/0.log"
Jul 17 11:48:30.195615 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:30.195597    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-f48h8_9fc054d0-6631-448d-86bd-a2ed2b11d29c/kuadrant-console-plugin/0.log"
Jul 17 11:48:30.323685 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:30.323615    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-tzxf9_8de2a0dd-71a6-4123-a507-9f26494d1b5d/registry-server/0.log"
Jul 17 11:48:30.450875 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:30.450840    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-rh72m_65890766-1d01-4ae8-adb1-3ddc746531c2/manager/0.log"
Jul 17 11:48:31.663220 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:31.663188    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-zhvgn_da34ff4e-059d-480d-9814-c935bbb18fd5/payload-pre-processing/0.log"
Jul 17 11:48:31.783851 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:31.783826    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-vx4g4_51edfb3d-8631-4e95-8141-148110c6bfc1/payload-processing/0.log"
Jul 17 11:48:32.252211 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:32.252189    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-z76cg_ca558ead-0418-4e9b-9b1f-b6a5a43c35d0/main/0.log"
Jul 17 11:48:32.480648 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:32.480623    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-ddrns_30ba9185-7fb6-4631-9433-cec280bdfdcc/main/0.log"
Jul 17 11:48:32.704900 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:32.704877    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-vgdjk_f29e967a-0a1c-4243-93f6-8b54e421ee50/main/0.log"
Jul 17 11:48:41.247345 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:41.247307    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tw6nz_ca964baf-243f-4cb7-a20e-3c802e627f2c/global-pull-secret-syncer/0.log"
Jul 17 11:48:41.426319 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:41.426287    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-j9v7m_e30ba440-b1f4-466d-912e-89c364980c7c/konnectivity-agent/0.log"
Jul 17 11:48:41.475971 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:41.475938    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-12.ec2.internal_37f630f90b2f531885effe9035c04ad9/haproxy/0.log"
Jul 17 11:48:46.838192 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:46.838104    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-hwjf6_fef1d476-1e14-49ce-92ca-af77a0511610/manager/0.log"
Jul 17 11:48:46.894933 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:46.894901    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-t2lmw_0652b352-b67e-4d5e-a470-196b6d295074/manager/0.log"
Jul 17 11:48:46.935489 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:46.935459    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-f48h8_9fc054d0-6631-448d-86bd-a2ed2b11d29c/kuadrant-console-plugin/0.log"
Jul 17 11:48:46.996444 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:46.996405    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-tzxf9_8de2a0dd-71a6-4123-a507-9f26494d1b5d/registry-server/0.log"
Jul 17 11:48:47.196856 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:47.196820    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-rh72m_65890766-1d01-4ae8-adb1-3ddc746531c2/manager/0.log"
Jul 17 11:48:49.228112 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:49.228070    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-lh2pk_bcacde69-b0da-4aa1-8d6b-f9a248008f6e/cluster-monitoring-operator/0.log"
Jul 17 11:48:49.476306 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:49.476266    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jg2vb_9a1e3c22-8a25-4743-84ac-a15371808df5/node-exporter/0.log"
Jul 17 11:48:49.496943 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:49.496916    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jg2vb_9a1e3c22-8a25-4743-84ac-a15371808df5/kube-rbac-proxy/0.log"
Jul 17 11:48:49.516913 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:49.516879    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jg2vb_9a1e3c22-8a25-4743-84ac-a15371808df5/init-textfile/0.log"
Jul 17 11:48:49.724501 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:49.724466    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_80bf7d53-e9f4-455a-af96-b997888bd6ca/prometheus/0.log"
Jul 17 11:48:49.754295 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:49.754212    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_80bf7d53-e9f4-455a-af96-b997888bd6ca/config-reloader/0.log"
Jul 17 11:48:49.780883 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:49.780850    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_80bf7d53-e9f4-455a-af96-b997888bd6ca/thanos-sidecar/0.log"
Jul 17 11:48:49.803223 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:49.803192    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_80bf7d53-e9f4-455a-af96-b997888bd6ca/kube-rbac-proxy-web/0.log"
Jul 17 11:48:49.826716 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:49.826678    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_80bf7d53-e9f4-455a-af96-b997888bd6ca/kube-rbac-proxy/0.log"
Jul 17 11:48:49.857906 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:49.857855    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_80bf7d53-e9f4-455a-af96-b997888bd6ca/kube-rbac-proxy-thanos/0.log"
Jul 17 11:48:49.880294 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:49.880260    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_80bf7d53-e9f4-455a-af96-b997888bd6ca/init-config-reloader/0.log"
Jul 17 11:48:51.473241 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:51.473209    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-m29nl/perf-node-gather-daemonset-54zwd"]
Jul 17 11:48:51.473630 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:51.473551    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9bc5c07-9974-4e62-8787-3b6932321973" containerName="maas-api"
Jul 17 11:48:51.473630 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:51.473562    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9bc5c07-9974-4e62-8787-3b6932321973" containerName="maas-api"
Jul 17 11:48:51.473630 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:51.473580    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4872e1c-5d24-4874-86ba-7fc0599c8989" containerName="maas-api"
Jul 17 11:48:51.473630 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:51.473585    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4872e1c-5d24-4874-86ba-7fc0599c8989" containerName="maas-api"
Jul 17 11:48:51.473760 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:51.473638    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9bc5c07-9974-4e62-8787-3b6932321973" containerName="maas-api"
Jul 17 11:48:51.473760 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:51.473650    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4872e1c-5d24-4874-86ba-7fc0599c8989" containerName="maas-api"
Jul 17 11:48:51.476677 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:51.476655    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-54zwd"
Jul 17 11:48:51.479760 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:51.479740    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m29nl\"/\"kube-root-ca.crt\""
Jul 17 11:48:51.479973 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:51.479956    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-m29nl\"/\"default-dockercfg-gjkbp\""
Jul 17 11:48:51.480859 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:51.480840    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m29nl\"/\"openshift-service-ca.crt\""
Jul 17 11:48:51.511367 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:51.511346    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m29nl/perf-node-gather-daemonset-54zwd"]
Jul 17 11:48:51.541469 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:51.541447    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4fd2bab1-72c6-4376-a996-049364c9e78b-sys\") pod \"perf-node-gather-daemonset-54zwd\" (UID: \"4fd2bab1-72c6-4376-a996-049364c9e78b\") " pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-54zwd"
Jul 17 11:48:51.541606 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:51.541501    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4fd2bab1-72c6-4376-a996-049364c9e78b-podres\") pod \"perf-node-gather-daemonset-54zwd\" (UID: \"4fd2bab1-72c6-4376-a996-049364c9e78b\") " pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-54zwd"
Jul 17 11:48:51.541606 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:51.541577    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4fd2bab1-72c6-4376-a996-049364c9e78b-proc\") pod \"perf-node-gather-daemonset-54zwd\" (UID: \"4fd2bab1-72c6-4376-a996-049364c9e78b\") " pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-54zwd"
Jul 17 11:48:51.541721 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:51.541624    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swtq5\" (UniqueName: \"kubernetes.io/projected/4fd2bab1-72c6-4376-a996-049364c9e78b-kube-api-access-swtq5\") pod \"perf-node-gather-daemonset-54zwd\" (UID: \"4fd2bab1-72c6-4376-a996-049364c9e78b\") " pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-54zwd"
Jul 17 11:48:51.541721 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:51.541665    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4fd2bab1-72c6-4376-a996-049364c9e78b-lib-modules\") pod \"perf-node-gather-daemonset-54zwd\" (UID: \"4fd2bab1-72c6-4376-a996-049364c9e78b\") " pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-54zwd"
Jul 17 11:48:51.644968 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:51.643973    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4fd2bab1-72c6-4376-a996-049364c9e78b-lib-modules\") pod \"perf-node-gather-daemonset-54zwd\" (UID: \"4fd2bab1-72c6-4376-a996-049364c9e78b\") " pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-54zwd"
Jul 17 11:48:51.644968 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:51.644042    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4fd2bab1-72c6-4376-a996-049364c9e78b-sys\") pod \"perf-node-gather-daemonset-54zwd\" (UID: \"4fd2bab1-72c6-4376-a996-049364c9e78b\") " pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-54zwd"
Jul 17 11:48:51.644968 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:51.644127    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4fd2bab1-72c6-4376-a996-049364c9e78b-podres\") pod \"perf-node-gather-daemonset-54zwd\" (UID: \"4fd2bab1-72c6-4376-a996-049364c9e78b\") " pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-54zwd"
Jul 17 11:48:51.644968 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:51.644173    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4fd2bab1-72c6-4376-a996-049364c9e78b-proc\") pod \"perf-node-gather-daemonset-54zwd\" (UID: \"4fd2bab1-72c6-4376-a996-049364c9e78b\") " pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-54zwd"
Jul 17 11:48:51.644968 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:51.644209    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swtq5\" (UniqueName: \"kubernetes.io/projected/4fd2bab1-72c6-4376-a996-049364c9e78b-kube-api-access-swtq5\") pod \"perf-node-gather-daemonset-54zwd\" (UID: \"4fd2bab1-72c6-4376-a996-049364c9e78b\") " pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-54zwd"
Jul 17 11:48:51.644968 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:51.644737    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4fd2bab1-72c6-4376-a996-049364c9e78b-lib-modules\") pod \"perf-node-gather-daemonset-54zwd\" (UID: \"4fd2bab1-72c6-4376-a996-049364c9e78b\") " pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-54zwd"
Jul 17 11:48:51.644968 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:51.644805    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4fd2bab1-72c6-4376-a996-049364c9e78b-sys\") pod \"perf-node-gather-daemonset-54zwd\" (UID: \"4fd2bab1-72c6-4376-a996-049364c9e78b\") " pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-54zwd"
Jul 17 11:48:51.644968 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:51.644888    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4fd2bab1-72c6-4376-a996-049364c9e78b-podres\") pod \"perf-node-gather-daemonset-54zwd\" (UID: \"4fd2bab1-72c6-4376-a996-049364c9e78b\") " pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-54zwd"
Jul 17 11:48:51.644968 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:51.644936    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4fd2bab1-72c6-4376-a996-049364c9e78b-proc\") pod \"perf-node-gather-daemonset-54zwd\" (UID: \"4fd2bab1-72c6-4376-a996-049364c9e78b\") " pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-54zwd"
Jul 17 11:48:51.652539 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:51.652517    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swtq5\" (UniqueName: \"kubernetes.io/projected/4fd2bab1-72c6-4376-a996-049364c9e78b-kube-api-access-swtq5\") pod \"perf-node-gather-daemonset-54zwd\" (UID: \"4fd2bab1-72c6-4376-a996-049364c9e78b\") " pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-54zwd"
Jul 17 11:48:51.786280 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:51.786197    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-54zwd"
Jul 17 11:48:51.926861 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:51.926817    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m29nl/perf-node-gather-daemonset-54zwd"]
Jul 17 11:48:51.930637 ip-10-0-143-12 kubenswrapper[2563]: W0717 11:48:51.930605    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4fd2bab1_72c6_4376_a996_049364c9e78b.slice/crio-e8b750b99215439e54ff6efba1b4cdfc2986d529e2bae498ca96bb7051375526 WatchSource:0}: Error finding container e8b750b99215439e54ff6efba1b4cdfc2986d529e2bae498ca96bb7051375526: Status 404 returned error can't find the container with id e8b750b99215439e54ff6efba1b4cdfc2986d529e2bae498ca96bb7051375526
Jul 17 11:48:52.162618 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:52.162580    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-54zwd" event={"ID":"4fd2bab1-72c6-4376-a996-049364c9e78b","Type":"ContainerStarted","Data":"a3ea0b588319c97cf75dc9ad5148538d9961878b912534011454b76c55153177"}
Jul 17 11:48:52.162838 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:52.162638    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-54zwd" event={"ID":"4fd2bab1-72c6-4376-a996-049364c9e78b","Type":"ContainerStarted","Data":"e8b750b99215439e54ff6efba1b4cdfc2986d529e2bae498ca96bb7051375526"}
Jul 17 11:48:52.162838 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:52.162660    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-54zwd"
Jul 17 11:48:52.181284 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:52.181224    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-54zwd" podStartSLOduration=1.181206471 podStartE2EDuration="1.181206471s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 11:48:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:48:52.179820447 +0000 UTC m=+3397.360853430" watchObservedRunningTime="2026-07-17 11:48:52.181206471 +0000 UTC m=+3397.362239479"
Jul 17 11:48:54.137999 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:54.137962    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kfp4f_619f03dd-a502-4c49-a66d-496a29102121/dns/0.log"
Jul 17 11:48:54.157543 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:54.157509    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kfp4f_619f03dd-a502-4c49-a66d-496a29102121/kube-rbac-proxy/0.log"
Jul 17 11:48:54.269847 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:54.269812    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rsv5j_a90ca9ac-e3c6-452c-89d5-64d3f4c9b1e9/dns-node-resolver/0.log"
Jul 17 11:48:54.857713 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:54.857679    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bpdts_d1260e44-4d64-4569-b0ce-78f616f8b412/node-ca/0.log"
Jul 17 11:48:56.191409 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:56.191371    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-zhvgn_da34ff4e-059d-480d-9814-c935bbb18fd5/payload-pre-processing/0.log"
Jul 17 11:48:56.229755 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:56.229709    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-vx4g4_51edfb3d-8631-4e95-8141-148110c6bfc1/payload-processing/0.log"
Jul 17 11:48:56.946820 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:56.946787    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j4xv5_87ba2b7a-cc06-4d60-af20-e8eb0c16b840/serve-healthcheck-canary/0.log"
Jul 17 11:48:57.604959 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:57.604929    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6c2kv_f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1/kube-rbac-proxy/0.log"
Jul 17 11:48:57.626161 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:57.626133    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6c2kv_f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1/exporter/0.log"
Jul 17 11:48:57.650132 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:57.650110    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6c2kv_f47b99d3-9f53-4a91-ac2b-e4ee8ea7c6d1/extractor/0.log"
Jul 17 11:48:58.180369 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:48:58.180347    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-54zwd"
Jul 17 11:49:00.228050 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:49:00.227940    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-76b5fcbfd-bt5lk_a2d69d0a-6d06-44c3-995b-b75a48582b92/manager/0.log"
Jul 17 11:49:00.521872 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:49:00.521749    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp_504118f3-6caf-4324-90c3-692d18de714a/manager/0.log"
Jul 17 11:49:00.544647 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:49:00.544616    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68f7bbb6f9-hhwdp_504118f3-6caf-4324-90c3-692d18de714a/copy-manifests/0.log"
Jul 17 11:49:01.607466 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:49:01.607342    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-zhvgn_da34ff4e-059d-480d-9814-c935bbb18fd5/payload-pre-processing/0.log"
Jul 17 11:49:01.637753 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:49:01.637714    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-vx4g4_51edfb3d-8631-4e95-8141-148110c6bfc1/payload-processing/0.log"
Jul 17 11:49:01.971967 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:49:01.971930    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-9895988c6-p2t2q_a0ff0652-824f-4558-aacd-d5718d65421f/manager/0.log"
Jul 17 11:49:03.171619 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:49:03.171569    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-zhvgn_da34ff4e-059d-480d-9814-c935bbb18fd5/payload-pre-processing/0.log"
Jul 17 11:49:03.200678 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:49:03.200646    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-vx4g4_51edfb3d-8631-4e95-8141-148110c6bfc1/payload-processing/0.log"
Jul 17 11:49:08.510154 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:49:08.510073    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vkxxl_85a21320-4c6f-4b3a-9d2b-3701c891a810/kube-multus-additional-cni-plugins/0.log"
Jul 17 11:49:08.532283 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:49:08.532254    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vkxxl_85a21320-4c6f-4b3a-9d2b-3701c891a810/egress-router-binary-copy/0.log"
Jul 17 11:49:08.553581 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:49:08.553558    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vkxxl_85a21320-4c6f-4b3a-9d2b-3701c891a810/cni-plugins/0.log"
Jul 17 11:49:08.575093 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:49:08.575071    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vkxxl_85a21320-4c6f-4b3a-9d2b-3701c891a810/bond-cni-plugin/0.log"
Jul 17 11:49:08.594856 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:49:08.594825    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vkxxl_85a21320-4c6f-4b3a-9d2b-3701c891a810/routeoverride-cni/0.log"
Jul 17 11:49:08.617670 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:49:08.617642    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vkxxl_85a21320-4c6f-4b3a-9d2b-3701c891a810/whereabouts-cni-bincopy/0.log"
Jul 17 11:49:08.637445 ip-10-0-143-12 kubenswrapper[2563]: I0717 11:49:08.637393    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vkxxl_85a21320-4c6f-4b3a-9d2b-3701c891a810/whereabouts-cni/0.log"